AI Agent Evaluation Analyst
VirtualVocationsChesapeake, Virginia, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Chesapeake, Virginia, United States
Job_description.internal_linking.related_jobs
Senior Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, coll...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Intelligence Analysis Coordinator.The Ascendancy Group's Mission : To be the unequaled provider of special operations forces (SOF) and Intelligence Community focused technical, service, and training...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
McBride has an exciting opportunity to support.Allied Command Transformation (ACT).NATO’s leading agent for change : driving, facilitating, and advocating the continuous improvement of Alliance capa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
The Product Management team is looking for a Product Manager with a strong background in product lifecycle and DevOps / Agile practices as well as strong communication and collaboration skills.You wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Spektrum have a wide range of exciting opportunities in several global locations.We are always looking to add great new talent to our team and look forward to hearing from you.Spektrum supports ape...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Newport News, Virginia, 23604!.Aequor is now hiring a full-time Board Certified Behavior Analyst (BCBA) for the 2023-...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
The Data Analyst will focus on asset and material maintenance and management data, as well as policy data.The data analyst will be responsible for all of the following to include but not limited to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
DATA SCIENCE AND AI ENABLEMENT SPECIALIST.DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.
We are inspired by our clients' critical missions ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!.
As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Full-Time Location : Norfolk, VA Clearance : TS / SCI Eligibility AERMOR is seeking an Exploitation Analys t to provide advanced cyber planning and analysis in support of Cyber Operational Test & E...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
We are seeking a seasoned Enterprise Architect specializing in artificial intelligence (AI) to drive the design, integration, and evolution of AI-powered solutions across our healthcare back-office...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We are revolutionizing sports betting and online gaming in the United States.We are a partnership between two powerhouse organizations-MGM Resorts International and Entain Group.You know our name t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Senior Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Data & Strategic AI Analyst – Onsite at NATO ACT Norfolk Location : .HQ SACT, Norfolk, VA Position Type : Full-time, Onsite Clearance Requirement : Active NATO or National SECRET (or higher) ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Senior Lead Data Engineer (Intelligent Foundations and Experiences)
Capital OneNEWPORT NEWS, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationSuffolk, Virginiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Intelligence Analysis Coordinator
Clearance JobsVirginia Beach, VA, USserp_jobs.job_card.full_time
Data Science & AI Data Scientist / AI Engineer (Enablement & Outreach)
McBrideNorfolk, VA, usserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationVirginia Beach, Virginiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Product Manager, Public Sector Platform & AI
RelativityVirginia Beach, VA, United Statesserp_jobs.job_card.full_time
Data Modeling And Business Intelligence Analyst
SpektrumNorfolk, Virginia, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in Newport News, VA
AlliedTravelCareersChesapeake, Virginia, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Data Analyst
GuidehouseNorfolk, VA, USserp_jobs.job_card.full_time
DATA SCIENCE AND AI ENABLEMENT SPECIALIST
DEFTEC CorporationNorfolk, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationChesapeake, Virginiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Freelance Luxury Brand Evaluator Automotive Project - Central & Coastal VA
CXGVirginia Beach, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Exploitation Analyst
AERMOR LLCNorfolk, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Lead Data Engineer (Intelligent Foundations and Experiences)
Capital OneNORFOLK, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationChesapeake, Virginiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
PRINCIPAL ENTERPRISE ARCHITECT - AI
SentaraVirginia Beach, VA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Compliance Analyst, Responsible Gaming
BetMGMVirginia Beach, VA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Senior Data Engineer (Intelligent Foundations and Experiences)
Capital OneNEWPORT NEWS, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationChesapeake, Virginiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Data & Strategic AI Analyst
Ironclad Defense WorksNorfolk, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply