Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsRiverside, California, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Riverside, California, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationMenifee, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationIrvine, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationChino Hills, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Board Certified Behavior Analyst / BCBA

Board Certified Behavior Analyst / BCBA

JobotHemet, CA, US
serp_jobs.job_card.full_time +1
Home-based Permanent BCBA - Paid Relocation + Sign-on Bonus.This Jobot Job is hosted by : Lauren Jessup.Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Tax Associate - Onsite - 2+ Yrs Paid Tax Experience Required

Tax Associate - Onsite - 2+ Yrs Paid Tax Experience Required

IntuitPHELAN, CA, United States
serp_jobs.job_card.full_time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Product Analyst

Product Analyst

VirtualVocationsIrvine, California, United States
serp_jobs.job_card.full_time
A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsSan Bernardino, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Tax Expert - Onsite - 2+ Yrs Paid Tax Experience Required

Tax Expert - Onsite - 2+ Yrs Paid Tax Experience Required

IntuitPHELAN, California, United States
serp_jobs.job_card.full_time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Trainer

AI Trainer

VirtualVocationsMission Viejo, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst

Search Analyst

VirtualVocationsMission Viejo, California, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsMoreno Valley, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Tax Expert - 2+ Yrs Paid Tax Experience Required

Tax Expert - 2+ Yrs Paid Tax Experience Required

IntuitPHELAN, California, United States
serp_jobs.job_card.full_time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Travel CT Tech - $2,278 to $2,546 per week in Modesto, CT

Travel CT Tech - $2,278 to $2,546 per week in Modesto, CT

AlliedTravelCareersModesto, CT, US
serp_jobs.job_card.full_time
AlliedTravelCareers is working with Prime Time Healthcare to find a qualified CT Tech in Modesto, Connecticut!.Now Hiring : Allied Healthcare CT - Modesto, California. Contact us for Pay Information....serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Tax Expert - Local

Tax Expert - Local

IntuitPHELAN, California, United States
serp_jobs.job_card.full_time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationHemet, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst, SEO & SEM

Search Analyst, SEO & SEM

VirtualVocationsIrvine, California, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst, SEO & SEM.Key Responsibilities Assist in planning, executing, optimizing, and reporting on paid search campaigns Conduct keyword research, manage copy ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationLake Elsinore, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Tax Associate - Local

Tax Associate - Local

IntuitPhelan, CA, United States
serp_jobs.job_card.full_time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationYucaipa, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Quality Vendor Economics Analyst

Quality Vendor Economics Analyst

VirtualVocationsMoreno Valley, California, United States
serp_jobs.job_card.full_time
A company is looking for a Quality Vendor Economics Analyst III.Key Responsibilities Assess financial opportunities related to new and existing Quality vendor contracts Document vendor processes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours