Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsSaginaw, Michigan, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Saginaw, Michigan, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Travel CVOR Technologist

Travel CVOR Technologist

PRN HealthcareMidland, MI, US
serp_jobs.job_card.full_time
PRN Healthcare is seeking a travel CVOR Technologist for a travel job in Midland, Michigan.Job Description & Requirements. PRN Healthcare Job ID #1448065.Pay package is based on 8 hour shifts an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote AI Task Reviewer – Flexible Hours, No Experience Needed

Remote AI Task Reviewer – Flexible Hours, No Experience Needed

RLDGFlint, Michigan, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Join our distributed team as a Remote AI Task Reviewer and help improve AI systems by completing short, style online tasks. This is an easy-to-learn role with full training and ongoing support.No pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Content Editor - Part Time Work From Home

AI Content Editor - Part Time Work From Home

OutlierFlint, MI, United States
serp_jobs.filters.remote
serp_jobs.job_card.part_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationSaginaw, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationSaginaw, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationMidland, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Travel Cath Lab Technologist

Travel Cath Lab Technologist

Skyline Med Staff AlliedMidland, MI, US
serp_jobs.job_card.full_time
Skyline Med Staff Allied is seeking a travel Cath Lab Technologist for a travel job in Midland, Michigan.Job Description & Requirements. Join the Top- Rated Travel Healthcare Team!.Skyline Med S...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Travel Surgical Tech - $2318 / Week

Travel Surgical Tech - $2318 / Week

Cynet HealthMidland, MI, US
serp_jobs.job_card.full_time
Cynet Health is seeking an experienced Surgical Tech for an exciting Travel Allied job in Midland, MI.Shift : 4x10 hr days Start Date : 10 / 20 / 2025 Duration : 6 weeks Pay : $2318 / Week.Ranked #5 Best T...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationMidland, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Content Editor - Part Time Work From Home

Content Editor - Part Time Work From Home

OutlierFlint, MI, United States
serp_jobs.filters.remote
serp_jobs.job_card.part_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote AI Writing Evaluator

Remote AI Writing Evaluator

OutlierFlint, MI, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Travel Telemetry RN

Travel Telemetry RN

Medical SolutionsOwosso, MI, US
serp_jobs.job_card.full_time
Medical Solutions is seeking a travel nurse RN Telemetry for a travel nursing job in Owosso, Michigan.Job Description & Requirements. We’re seeking talented healthcare professionals whose ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Freelance Writer - Work From Home

Freelance Writer - Work From Home

OutlierFlint, MI, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Travel Cath Lab Tech - $2,857 per week in Midland, MI

Travel Cath Lab Tech - $2,857 per week in Midland, MI

AlliedTravelCareersMidland, MI, US
serp_jobs.job_card.full_time +1
AlliedTravelCareers is working with Infojini Healthcare to find a qualified Cath Lab Tech in Midland, Michigan, 48670!.Cath Lab Tech travel Radiology / Imaging needed in Midland, Michigan.Self Assess...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Travel Surgical Tech - CVOR - $2210 / Week

Travel Surgical Tech - CVOR - $2210 / Week

Premier Medical Staffing Services, LLCMidland, MI, US
serp_jobs.job_card.full_time
Premier Medical Staffing Services, LLC is seeking an experienced Surgical Tech - CVOR for an exciting Travel Allied job in Midland, MI. Shift : 4x10 hr days Start Date : 10 / 20 / 2025 Duration : 6 weeks P...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationMidland, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Travel Radiology Tech in Owosso, MI

Travel Radiology Tech in Owosso, MI

AlliedTravelCareersOwosso, MI, US
serp_jobs.job_card.full_time +1
AlliedTravelCareers is working with Lancesoft Inc.Rad Tech in Owosso, Michigan, 48867!.We are currently seeking qualified candidates for Radiology / Imaging. Shift 4 - 10HR Days, 08 : 00 : 00-18 : 00 : 00, 10...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Travel CVOR Technologist

Travel CVOR Technologist

VeeAR HealthMidland, MI, US
serp_jobs.job_card.full_time
VeeAR Health is seeking a travel CVOR Technologist for a travel job in Midland, Michigan.Job Description & Requirements.Shift Notes : Days : 6 : 30A – 5 : 00P (10 Hour Days) / 1-2 Call Nights p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30