AI Evaluation Analyst
VirtualVocationsNorfolk, Virginia, United Statesjob_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Norfolk, Virginia, United States
Job_description.internal_linking.related_jobs
Veteran Owned Small Business (VOSB) that models future environments, requirements, and capabilities, and then secures the enterprise from internal and external threats compliant with Federal, State...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Adjunct Lecturer of Data Science.Data Science is the study and application of methods that extract knowledge.Data Science at W&M provides a.
We push students beyond methods and.The Data Science Prog...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
DATA AND AI SENIOR SOFTWARE DEVELOPER.DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.
We are inspired by our clients' critical missions ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Virginia Beach, VA at our wonderful G2 Ops office.In person, some remote opportunity and / or flexible working hours, not a fully remote position.
August / September 2025 Salary Range : $130-$150K p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Senior Manager, Data Engineering (Intelligent Foundations and Experiences) The minimum and maximum full-time annual salaries for this role are listed below, by location.
Please note that this salary...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Senior Data Engineer (Intelligent Foundations and Experiences) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Contractor will need to come to Richmond quarterly.The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled AI Developer UI Strategy mainly crafting a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Founded in 1995, ESN is a Small Disadvantaged Business (SDB), Service-Disabled Veteran-Owned Small Business (SDVOSB) and Veteran Owned Small Business (VOSB).
ESN delivers trusted solutions that supp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Anticipated Salary Range : $68,050.Mission Technologies' Global Security (GS) group comprises live, virtual, constructive (LVC) solutions.
fleet sustainment; nuclear and environmental; and Austr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We cannot provide sponsorship at this time.Data Analytics Manager-SQL to Big Query.At Family Dollar, we strive for exceptional collaboration between talented individuals who exhibit our values and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Suffolk, VA Position Type : Full-Time Clearance : TS / SCI AERMOR is seeking a Junior Data Analyst who will support the Office of Compliance and Assessment (OCA) and Navy leadership by providing techni...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
DATA AND AI FULL STACK DEVELOPER.DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.
We are inspired by our clients' critical missions and drive...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Lead Machine Learning Engineer - ML / AI.At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems.
Our investments in technology infrastructure and worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day 
Campaign Data Manager Kingston Strategy Location : .Suffolk / Virginia Beach / Eastville, VA Job Type : Temporary, Contract Experience Level : 1-2 Cycles preferred, not required Compensation : Sal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Ready to turn your opinions into cash? Explore the world of remote paid online survey gigs with Opinion Outpost!.It's as simple as sharing your thoughts from the comfort of your own home and watchi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Control Systems Integration firm is currently seeking full-time SCADA / PLC / HMI Programmers with a minimum of 5+ years of experience using Ignition SCADA, Allen Bradley FactoryTalk, VT SCADA, Schn...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Veteran Owned Small Business (VOSB) that models future environments, requirements, and capabilities, and then secures the enterprise from internal and external threats compliant with Federal, State...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.We are inspired by our clients' critical missions and driven to provide the most effecti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Data Scientist II with a Secret Clearance.Naval Computer and Telecommunications Area Master Station Atlantic (NCTAMS LANT) located at the Naval Station in Norfolk, VA.
This is an upcoming opportunit...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
BryceTech is a trusted leader in complex technology domains, delivering data-driven solutions in aerospace, biosecurity, and defense.
We specialize in systems engineering, advanced analytics, and R&...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
- serp_jobs.job_card.promoted
Unmanned Systems Portfolio Technician
SimIS Inc.Suffolk, VA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Adjunct Lecturer of Data Science
William & MaryWilliamsburg, VA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
DATA AND AI SENIOR SOFTWARE DEVELOPER
DEFTEC CorporationChesapeake, VA, USserp_jobs.job_card.full_time
Data Scientist / Software Engineer
G2 Ops, Inc.Virginia Beach, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Senior Manager, Data Engineering (Intelligent Foundations and Experiences)
Capital OneWilliamsburg, VA, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Senior Data Engineer (Intelligent Foundations and Experiences)
Capital OneWilliamsburg, VA, United Statesserp_jobs.job_card.full_time +1
STI is hiring : AI Developer UI Strategy in Virginia Beach
MediabistroVirginia Beach, VA, United Statesserp_jobs.job_card.full_time
Database Management Analyst lll
ENGINEERING SERVICES NETWORK, Inc.Chesapeake, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Systems Engineer (Engineer Systems 2)-25462 (JLVC Mod-Improved White Cell Effects)
HIISuffolk, VA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Analytics Manger-SQL to Big Query
Family DollarChesapeake, VA, USserp_jobs.job_card.full_time
Junior Data Analyst
AERMOR LLCSuffolk, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
DATA AND AI FULL STACK DEVELOPER
DEFTEC CorporationNorfolk, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Lead Machine Learning Engineer - ML / AI Job at Capital One in Newport News
MediabistroNewport News, VA, United Statesserp_jobs.job_card.full_time +1
1.2 Campaign Data Manager
Kingston StrategyVirginia Beachserp_jobs.job_card.temporary
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Share Your Thoughts, Pocket Some Cash : Join Opinion Outpost's Survey Opportunities!
DynataWilliamsburg, VA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
SCADA / PLC / HMI Programmer -5+ yrs Required
Systems East, Inc.Seaford, VA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Database Manager (DLA)
SimIS Inc.Suffolk, VA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
DATA SCIENCE AND AI ENGINEER
DEFTEC CorporationChesapeake, VA, USserp_jobs.job_card.full_time
Data Scientist II
Axiom ConsultantsNorfolk, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Kubernetes Engineer
BryceTechSuffolk, VA, United Statesserp_jobs.job_card.full_time