AI Agent Evaluation Analyst
VirtualVocationsSpringfield, Massachusetts, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Springfield, Massachusetts, United States
Job_description.internal_linking.related_jobs
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
A Sales Career That Grows With You.Are you looking for a career path that gives you the freedom and flexibility to control your schedule, but also has the security and stability of a large company?...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
AlliedTravelCareers is working with Prime Time Healthcare to find a qualified CT Tech in Winchester, Connecticut, 06098!.
Now Hiring : Allied Healthcare CT - Winchester, VA.Contact us for Pay Informa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Lawrence, Massachusetts, 01840!.Board Certified Behavior Analyst (BCBA).
With Aequor, you can enjoy the freedom to adv...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days AlliedTravelCareers is working with Prime Time Healthcare to find a qualified CT Tech in Somerville, Connecticut, 06071!.
Now Hiring : Allied Healthcare CT - Somerville, New Jersey.Contact us for Pay...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationBristol, Connecticutserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Sales Representative (Remote)
American Income LifePelham, MA, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Search Analyst
VirtualVocationsSpringfield, Massachusetts, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,278 to $2,546 per week in Winchester, CT
AlliedTravelCareersWinchester, CT, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Evaluation Analyst
VirtualVocationsSpringfield, Massachusetts, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationWaterbury, Connecticutserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationHolyoke, Massachusettsserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in Lawrence, MA
AlliedTravelCareersSpringfield, Massachusetts, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsSpringfield, Massachusetts, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationWaterbury, Connecticutserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Freelance Writer - Part Time Work From Home
OutlierRemote, CT, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationSpringfield, Massachusettsserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierWaterbury, CT, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.new
Remote AI Writing Evaluator
MediabistroAgawam, MA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Content Editor - Part Time Work From Home
OutlierSpringfield, MA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,506 to $2,801 per week in Somerville, CT
AlliedTravelCareersSomerville, CT, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Content Writer - Part Time Work From Home
OutlierPortland, MA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
English Writing and Content Reviewing Expertise Sought for AI Training
OutlierHartford, CT, United Statesserp_jobs.job_card.full_time