AI Evaluation Analyst
VirtualVocationsRichmond, Virginia, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Richmond, Virginia, United States
Job_description.internal_linking.related_jobs
Artificial Intelligence Project Manager.Universal is headquartered in Richmond, Virginia, and is the leading global leaf tobacco supplier.
Tobacco sourcing and processing has been the Company's ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Intelligence Analyst Job Overview : We are currently seeking a highly motivated and detail-oriented individuals to join our team.
You will play a crucial role in supporting our decision-making proces...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Senior Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, coll...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Intelligence Analyst Job Overview : We are currently seeking a highly motivated and detail-oriented individuals to join our team.
Is this your next job Read the full description below to find out, an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day Senior Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day Lead Full Stack Engineer, (Intelligent Foundations & Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collab...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for a Market Intelligence and Data Analyst - Annuities.Key Responsibilities Gather, analyze, model, and present competitive intelligence data to senior management and stakeho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Senior Data Engineer (Bank Tech).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'll b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!.
As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
AI Project Manager
Universal Leaf Tobacco Company, Inc.Richmond, VA, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Intelligence Analyst
US ArmyRichmond, VA, United Statesserp_jobs.job_card.part_time +1
- serp_jobs.job_card.promoted
Senior Lead Data Engineer (Intelligent Foundations and Experiences)
Capital OnePETERSBURG, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.new
AI Multimedia Generation Product Evaluator Job at ICONMA in Richmond
MediabistroRichmond, VA, United Statesserp_jobs.job_card.full_time
Hireio, Inc. is hiring : AI Communication Quality & Culture Evaluator in Richmond
MediabistroRichmond, VA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Agent Evaluation Analyst
VirtualVocationsRichmond, Virginia, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierRichmond, VA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Intelligence Analyst
United States ArmyRichmond, Virginia, USserp_jobs.job_card.part_time +1
- serp_jobs.job_card.promoted
Lead Data Engineer (Intelligent Foundations and Experiences)
Capital OnePETERSBURG, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Senior Data Engineer (Intelligent Foundations and Experiences)
Capital OneRICHMOND, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Lead Full Stack Engineer, (Intelligent Foundations & Experiences)
Capital OnePETERSBURG, Virginia, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsRichmond, Virginia, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied Researcher I
Capital OneRichmond, VA, USserp_jobs.job_card.full_time +1
Visual Data Evaluator Job at Firstsource Solutions Ltd in Richmond
MediabistroRichmond, VA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Market Intelligence Data Analyst
VirtualVocationsRichmond, Virginia, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Data Engineer (Bank Tech)
Capital OnePETERSBURG, Virginia, United Statesserp_jobs.job_card.full_time +1
Audio Evaluation Expert - Fully Remote Job at Mercor in Richmond
MediabistroRichmond, VA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator Automotive Project - Central & Coastal VA
CXGMidlothian, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply