AI Agent Evaluation Analyst
VirtualVocationsBaltimore, Maryland, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Baltimore, Maryland, United States
Job_description.internal_linking.related_jobs
Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day Distinguished AI Engineer (Agentic AI Platform Infrastructure).At Capital One, we are creating responsible and reliable AI systems, changing banking for good.
For years, Capital One has been an indu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day Senior Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Medical Solutions Allied is seeking a travel CT Technologist for a travel job in Bel Air, Maryland.Job Description & Requirements.
We’re seeking talented healthcare professionals whose adv...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 At Capital One, we are creating responsible and reliable AI systems, changing banking for good.For years, Capital One has been an industry leader in using machine learning to create real-time, pers...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Lead Machine Learning Engineer - ML / AI.At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems.
Our investments in technology infrastructure and worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day 
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Senior Data Engineer (Cloud Operations Resilience Engineering).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Lead Data Engineer (Cloud Operations Resilience Engineering).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day Senior Data Engineer (Bank Tech).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'll b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Lead Machine Learning Engineer (Intelligent Foundations & Experiences).As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learnin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
Lead Data Engineer (Intelligent Foundations and Experiences)
Capital OneBALTIMORE, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Distinguished AI Engineer (Agentic AI Platform Infrastructure)
Capital OneANNAPOLIS, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Senior Data Engineer (Intelligent Foundations and Experiences)
Capital OneBALTIMORE, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationAnnapolis, Marylandserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Agent Evaluation Analyst
VirtualVocationsWashington, District of Columbia, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Medical Solutions AlliedBel Air, MD, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierArlington, VA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationBowie, Marylandserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Research Lead - AI Cyber Testing & Evaluation
RAND CorporationWashington, DC, United Statesserp_jobs.job_card.temporary
- serp_jobs.job_card.promoted
Distinguished AI Engineer
Capital OneANNAPOLIS, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Lead Machine Learning Engineer - ML / AI
Capital OneANNAPOLIS, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.new
AI Multimedia Generation Product Evaluator Job at ICONMA in Washington
MediabistroWashington, DC, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Data Engineer (Cloud Operations Resilience Engineering)
Capital OneANNAPOLIS, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
English Writing and Content Reviewing Expertise Sought for AI Training
OutlierBaltimore, MD, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Lead Data Engineer (Cloud Operations Resilience Engineering)
Capital OneANNAPOLIS, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Senior Data Engineer (Bank Tech)
Capital OneANNAPOLIS, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Evaluation Analyst
VirtualVocationsArlington, Virginia, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Lead Machine Learning Engineer (Intelligent Foundations & Experiences)
Capital OneANNAPOLIS, Maryland, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationBaltimore, Marylandserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationAnnapolis, Marylandserp_jobs.filters.remote
serp_jobs.job_card.full_time +1