AI Evaluation Analyst
VirtualVocationsPortsmouth, Virginia, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Portsmouth, Virginia, United States
Job_description.internal_linking.related_jobs
Senior Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, coll...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Intelligence Analysis Coordinator.The Ascendancy Group's Mission : To be the unequaled provider of special operations forces (SOF) and Intelligence Community focused technical, service, and training...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
McBride has an exciting opportunity to support.Allied Command Transformation (ACT).NATO’s leading agent for change : driving, facilitating, and advocating the continuous improvement of Alliance capa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Lead Machine Learning Engineer.As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale....serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Spektrum have a wide range of exciting opportunities in several global locations.We are always looking to add great new talent to our team and look forward to hearing from you.Spektrum supports ape...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Veteran Owned Small Business (VOSB) that models future environments, requirements, and capabilities, and then secures the enterprise from internal and external threats compliant with Federal, State...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Lead Machine Learning Engineer (Intelligent Foundations & Experiences).As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learnin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Senior Manager, Data Engineering (Intelligent Foundations and Experiences).The minimum and maximum full-time annual salaries for this role are listed below, by location.
Please note that this salary...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
DATA SCIENCE AND AI ENABLEMENT SPECIALIST.DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.
We are inspired by our clients' critical missions ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!.
As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Applied Researcher II Overview : At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.
For years, Capital One has been leading the industry in using machine ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Full-Time Location : Norfolk, VA Clearance : TS / SCI Eligibility AERMOR is seeking an Exploitation Analys t to provide advanced cyber planning and analysis in support of Cyber Operational Test & E...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Lead Machine Learning Engineer - ML / AI.At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems.
Our investments in technology infrastructure and worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Senior Machine Learning Engineer.As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Senior Operations Research Analyst - Navy Warfighting Analysis.We are seeking a highly qualified.Senior Operations Research Analyst.
Navy warfighting analysis, modeling, and decision-making.This Key...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Senior Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Data & Strategic AI Analyst – Onsite at NATO ACT Norfolk Location : .HQ SACT, Norfolk, VA Position Type : Full-time, Onsite Clearance Requirement : Active NATO or National SECRET (or higher) ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Senior Lead AI Engineer (AI Foundations, LLM Core) Overview : At Capital One, we are creating responsible and reliable AI systems, changing banking for good.
For years, Capital One has been an indust...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.We are inspired by our clients' critical missions and driven to provide the most effecti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Senior Lead Data Engineer (Intelligent Foundations and Experiences)
Capital OneNEWPORT NEWS, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Intelligence Analysis Coordinator
Clearance JobsVirginia Beach, VA, USserp_jobs.job_card.full_time
Data Science & AI Data Scientist / AI Engineer (Enablement & Outreach)
McBrideNorfolk, VA, usserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Lead Machine Learning Engineer
Capital OneWilliamsburg, VA, USserp_jobs.job_card.full_time +1
Data Modeling And Business Intelligence Analyst
SpektrumNorfolk, Virginia, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Operations Research Analyst (N)
SimIS Inc.Norfolk, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Lead Machine Learning Engineer (Intelligent Foundations & Experiences)
Capital OneWILLIAMSBURG, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Senior Manager, Data Engineering (Intelligent Foundations and Experiences)
Capital OneWILLIAMSBURG, Virginia, United Statesserp_jobs.job_card.full_time +1
DATA SCIENCE AND AI ENABLEMENT SPECIALIST
DEFTEC CorporationNorfolk, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Freelance Luxury Brand Evaluator Automotive Project - Central & Coastal VA
CXGVirginia Beach, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Applied Researcher II
Capital OneCapitol, VA, USserp_jobs.job_card.full_time +1
Exploitation Analyst
AERMOR LLCNorfolk, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Lead Data Engineer (Intelligent Foundations and Experiences)
Capital OneNORFOLK, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Lead Machine Learning Engineer - ML / AI
Capital OneWILLIAMSBURG, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Senior Machine Learning Engineer
Capital OneWilliamsburg, VA, USserp_jobs.job_card.full_time +1
Senior Operations Research Analyst
Heartland ConsultingNorfolk, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Senior Data Engineer (Intelligent Foundations and Experiences)
Capital OneWILLIAMSBURG, Virginia, United Statesserp_jobs.job_card.full_time +1
Data & Strategic AI Analyst
Ironclad Defense WorksNorfolk, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Senior Lead AI Engineer (AI Foundations, LLM Core)
Capital OneCapitol, VA, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
DATA SCIENCE AND AI ENGINEER
DEFTEC CorporationChesapeake, VA, USserp_jobs.job_card.full_time