AI Evaluation Analyst
VirtualVocationsLittleton, Colorado, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Littleton, Colorado, United States
Job_description.internal_linking.related_jobs
Taft is currently seeking a Knowledge & Research Analyst to join our Knowledge and Research Services Department.Taft Stettinius & Hollister is seeking a full-time Knowledge & Research Analyst with ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
A senior UX researcher will play a pivotal role in shaping our products and services by uncovering user insights and translating them into actionable recommendations.
They will work closely with cro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
RKA Recruiting is seeking a travel CVOR Technologist for a travel job in Brighton, Colorado.Job Description & Requirements.
Dedicated and experienced healthcare staffing professionals that put o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Uniti Med is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements.
Uniti Med is looking for a Travel Cath Lab Tech in Brighton, CO.This as...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
The Squad Lead is responsible for delivering services and solutions to Welocalize customers.The Squad Lead manages or directs a team (i.
These solutions are based on the Welocalize Four Pillars of C...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
American Traveler is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements.
American Traveler is seeking an Invasive Cardiovascular Technol...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Health Advocates Network - Allied is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements.
HANStaff Allied Job ID #476542.Pay package is b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Springboard Healthcare is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements.
Springboard Healthcare Job ID #787543.Pay package is based...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Triage Staffing is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements.
Travel Radiology : Cath Lab Tech Brighton.Location : &nb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
Knowledge & Research Analyst
Taft Stettinius & Hollister LLPDenver, CO, United Statesserp_jobs.job_card.full_time
Senior User Experience Analyst Job at Aditi Consulting in Englewood
MediabistroEnglewood, CO, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Agent Evaluation Analyst
VirtualVocationsArvada, Colorado, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationCastle Rock, Coloradoserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel CVOR Technologist
RKA RecruitingBrighton, CO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel Cath Lab Technologist
Uniti MedBrighton, CO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationAurora, Coloradoserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsAurora, Colorado, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Squad Lead
WelocalizeEvergreen, CO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationParker, Coloradoserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Invasive Cardiovascular Technologist (Cardiac Cath Lab)
American TravelerBrighton, CO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Evaluation Analyst
VirtualVocationsAurora, Colorado, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationNorthglenn, Coloradoserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationBroomfield, Coloradoserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer
Data AnnotationCastle Rock, Coloradoserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierRemote, CO, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.new
AI Multimedia Generation Product Evaluator Job at ICONMA in Denver
MediabistroDenver, CO, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel Cath Lab Technologist
Health Advocates Network - AlliedBrighton, CO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel Cath Lab Technologist
Springboard HealthcareBrighton, CO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel Cath Lab Technologist
Triage StaffingBrighton, CO, USserp_jobs.job_card.full_time