AI Evaluation Analyst
VirtualVocationsVisalia, California, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Visalia, California, United States
Job_description.internal_linking.related_jobs
Cynet Health is seeking an experienced Registered Dietitian for an exciting Travel Allied job in Corcoran, CA.Shift : 5x8 hr days Start Date : 10 / 13 / 2025 Duration : 27 weeks Pay : $1978 / Week.Ranked #...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Atlas MedStaff is seeking an experienced Rad Tech for an exciting Travel Allied job in Porterville, CA.Shift : 5x8 hr days Start Date : 11 / 04 / 2025 Duration : 13 weeks Pay : $2328.Atlas Medstaff is curr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Staff Research Associate 2 Non-exempt - Exeter, CA, Job ID 81187.University of California Agriculture and Natural Resources.
Under supervision, incumbent performs a wide variety of standard repetiti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Cynet Health is seeking an experienced Registered Dietitian for an exciting Travel Allied job in Corcoran, CA.Shift : 5x8 hr days Start Date : 12 / 01 / 2025 Duration : 27 weeks Pay : $1820 / Week.Ranked #...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Cynet Health is seeking an experienced Rad Tech for an exciting Travel Allied job in Corcoran, CA.Shift : 5x8 hr days Start Date : 10 / 13 / 2025 Duration : 27 weeks Pay : $1583 / Week.Ranked #5 Best Trave...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour
- serp_jobs.job_card.promoted
Travel Registered Dietitian - $1978 / Week
Cynet HealthCorcoran, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Travel Rad Tech - $2328.79 / Week
Atlas MedStaffPorterville, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Evaluation Analyst
VirtualVocationsFresno, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsFresno, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationHanford, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Tax Associate - Local
IntuitLindsay, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Staff Research Associate 2 Non-exempt - Exeter, CA, Job ID 81187
University of California Agriculture and Natural ResourcesExeter, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Tax Expert - Local
IntuitLINDSAY, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationHanford, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationPorterville, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Registered Dietitian - $1820 / Week
Cynet HealthCorcoran, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Agent Evaluation Analyst
VirtualVocationsVisalia, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Tax Expert - Onsite - 2+ Yrs Paid Tax Experience Required
IntuitLINDSAY, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Tax Associate - Onsite
IntuitLINDSAY, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationFresno, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationClovis, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer
Data AnnotationHanford, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Rad Tech - $1583 / Week
Cynet HealthCorcoran, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Tax Expert - 2+ Yrs Paid Tax Experience Required
IntuitLINDSAY, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Tax Associate - Onsite - 2+ Yrs Paid Tax Experience Required
IntuitLINDSAY, California, United Statesserp_jobs.job_card.full_time