AI Agent Evaluation Analyst
VirtualVocationsRockford, Illinois, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Rockford, Illinois, United States
Job_description.internal_linking.related_jobs
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
AHS Staffing is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.Pay package is based on 12 hour shifts and 36 hours per week (subject to c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Anders Group is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.Pay package is based on 8 hour shifts and 40 hours per week (subject to co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Springboard Healthcare is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.
Springboard Healthcare Job ID #787615.Pay package is based on 8 ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.The ideal candidate must have a least 2 years of relevant clinical practice setting experience and hold a c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
PRIDE Health is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.A CT Technician operates computed tomography (CT) scanners to capture deta...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Coast Medical Service is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.
Coast Medical Service is a nationwide travel nursing & allied...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Planet Healthcare is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.
Planet Healthcare Job ID #73232574.Pay package is based on 8 hour shi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Triage Staffing is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.
Travel Radiology : CT Tech Elkhorn.Location : &nbs...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Medical Solutions Allied is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.
We’re seeking talented healthcare professionals whose ad...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Olaro is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.Pay package is based on 12 hour shifts and 36 hours per week (subject to confirma...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Anders Group is seeking a travel CT Technologist for a travel job in Elkhorn, Wisconsin.Job Description & Requirements.Pay package is based on 8 hour shifts and 40 hours per week (subject to co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierRockford, IL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Tax Associate - Onsite - 2+ Yrs Paid Tax Experience Required
IntuitHarvard, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
AHS StaffingElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Anders GroupElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Springboard HealthcareElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Alliance Services, Inc.Elkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
PRIDE HealthElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Coast Medical ServiceElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Planet HealthcareElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationJanesville, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer
Data AnnotationBeloit, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel CT Technologist
Triage StaffingElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Medical Solutions AlliedElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Evaluation Analyst
VirtualVocationsRockford, Illinois, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationBeloit, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationBeloit, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationRockford, Illinoisserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationRockford, Illinoisserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel CT Technologist
OlaroElkhorn, WI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist - General Imaging
Anders GroupElkhorn, WI, USserp_jobs.job_card.full_time