AI Evaluation Analyst
VirtualVocationsSaint Louis, Missouri, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Saint Louis, Missouri, United States
Job_description.internal_linking.related_jobs
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
TravelNurseSource is working with Fusion Medical Staffing to find a qualified Telemetry RN in Alton, Illinois, 62002!.Fusion Medical Staffing is seeking a skilled Telemetry RN for a 12-week travel ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
In a role that sharpens your skills in ways that only real-world, deployed environments can offer.You’ll play as a key member within the Intelligence Community, whether during briefings of hi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Senior Equity Research Analyst.Moneta is an independent Registered Investment Advisor (RIA) wholly focused on going further for our clients.
We are one firm with many solutions and we provide a full...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
The Analyst, Research II is responsible for utilizing R-Log or designated WMS in conjunction with all available systems / data bases to reconcile discrepancies and escalates throughout the business s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Fusion Medical Staffing is seeking a ICU RN for a 12-week travel assignment in Alton, Illinois.As a member of our team, you'll have the opportunity to make a positive impact on the lives of pat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Market Intelligence and Data Analyst - Annuities.Key Responsibilities Gather, analyze, model, and present competitive intelligence data to senior management and stakeho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
The Category Intelligence Analyst will transform complex data into actionable insights that drive category strategy in the consumer packaged goods industry.
This role excels in synthesizing large da...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours TravelNurseSource is working with Care Career to find a qualified Telemetry RN in Alton, Illinois, 62002!.The Telemetry Nurse carries out patient assignments and assumes primary care responsibiliti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Audio Evaluation Expert - Fully Remote Job at Mercor in St. Louis
MediabistroSt. Louis, MO, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationSt. Louis, Missouriserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationBelleville, Illinoisserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Nurse RN - Telemetry - $1,897 to $2,018 per week in Alton, IL
TravelNurseSourceAlton, IL, USserp_jobs.job_card.full_time
Geospatial Intelligence Analyst Deployer (TS / SCI)
Xcellent Technology SolutionsSt. Louis, MO, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in St. Louis
MediabistroSt. Louis, MO, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Equity Research Analyst
MonetaSaint Louis, MO, USserp_jobs.job_card.full_time
Hireio, Inc. is hiring : AI Communication Quality & Culture Evaluator in St. Loui
MediabistroSt. Louis, MO, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Analyst, Research II
FedExEdwardsville, IL, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationBelleville, Illinoisserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsSaint Louis, Missouri, United Statesserp_jobs.job_card.full_time
Visual Data Evaluator Job at Firstsource Solutions Ltd in St. Louis
MediabistroSt. Louis, MO, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel ICU RN
Fusion Medical StaffingAlton, IL, USserp_jobs.job_card.full_time
Become a Luxury Brand Evaluator in the Upper Midwest - Apply Now
CXGSt. Louis, MO, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationBelleville, Illinoisserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Market Intelligence Data Analyst
VirtualVocationsSaint Louis, Missouri, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierSaint Louis, MO, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Category Intelligence Analyst - St. Louis MO
EnvisionSaint Louis, MO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Agent Evaluation Analyst
VirtualVocationsFlorissant, Missouri, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel Nurse RN - Telemetry - $2,182 per week in Alton, IL
TravelNurseSourceAlton, IL, USserp_jobs.job_card.full_time