AI Agent Evaluation Analyst
VirtualVocationsLexington, Kentucky, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Lexington, Kentucky, United States
Job_description.internal_linking.related_jobs
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
TRS Healthcare is seeking a travel CT Technologist for a travel job in Stanford, Kentucky.Job Description & Requirements.
TRS Healthcare Job ID #1296731.Pay package is based on 12 hour shifts an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Cynet Health is seeking an experienced CT Tech for an exciting Travel Allied job in Georgetown, KY.Shift : 4x10 hr nights Start Date : ASAP Duration : 13 weeks Pay : $2566 / Week.Ranked #5 Best Travel ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.
Please submit your resume in English and indicate your level of En...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
TRS HealthcareStanford, KY, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2566 / Week
Cynet HealthGeorgetown, KY, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Content Editor - Part Time Work From Home
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
English Writing Editor - Part Time Work From Home
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationLexington, Kentuckyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
English AI Writer - Part Time Work From Home
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Freelance Writer - Work From Home
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Freelance Writer
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Evaluation Analyst
VirtualVocationsLexington, Kentucky, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationLexington, Kentuckyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Content Writer - Part Time Work From Home
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Freelance Writer - Part Time
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationLexington, Kentuckyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationLexington, Kentuckyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Content Editor - Part Time Work From Home
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.new
AI Agent Evaluation Analyst
MindriftKY, USserp_jobs.filters.remote
serp_jobs.job_card.part_time +1
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
English Writing and Content Reviewing Expertise Sought for AI Training
OutlierRemote, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time