AI Agent Evaluation Analyst
VirtualVocationsMesa, Arizona, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Mesa, Arizona, United States
Job_description.internal_linking.related_jobs
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Seeking Italian speakers for innovative language research.We're building next-generation AI that truly understands Italian.
Participate in our conversational recording study from the comfort of your...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Generative AI Specialist - Humanities (English and French).Flexible Part-Time Role (part-time, up to 28 hours weekly, no guaranteed hours.
Innodata (NASDAQ : INOD) is a leading data engineering compa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Symmetry is the payroll infrastructure for software & payroll platforms powering the paychecks of over 64 million workers each year.
Our fully integrated suite of payroll tax APIs and software tools...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Eurofins Scientific is a network of independent companies providing a unique range of analytical testing services to clients across multiple industries, to make life and our environment safer, heal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Reporting to the Director of Clinical Informatics for Analytics & Interfaces, the Clinical Informatics Data Analyst is responsible for the development, design, and maintenance of critical business ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
APPLICATIONS ARE REVIEWED DAILY.YOU CAN EXPECT A RESPONSE WITHIN 24 HOURS.Our Patients : An intentional focus on small caseloads with a compassionate care approach.
Our Culture : ABC Core Values are m...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Media & AI Coordinator Location : .Let’s Be Blunt Cannabis isn’t just an industry — it’s a movement.Mint Cannabis is proudly leading the charge from premium flower a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Canada Payroll Tax Research Analyst, Symmetry.Symmetry Software is part of Gusto.Symmetry is the payroll infrastructure for software & payroll platforms powering the paychecks of over 64 million wo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Location : Metropark, NJ / / Charlotte, NC.We're seeking an experienced Lead Gen AI Specialist to join our team and drive innovation in AI solutions.
The ideal candidate will have expertise in Gener...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
A pillar in the Phoenix community for 30 years, Fresh Start’s mission is to provide access and resources that help women achieve self-sufficiency and use their strength to thrive.We envision ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Hands on Exp in Oracle finance Cloud knowledge Accounts payable module Oracle Finance Cloud Implementation experience with expertise in Accounts Payable and knowledge in Ora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Totus is the modern gift card platform built for brands.We're rethinking gift cards from the ground up.We provide brands with a powerful, tech-driven platform that simplifies issuance, distribution...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationMaricopa, Arizonaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationApache Junction, Arizonaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Your Personal AI is hiring : Remote Italian Audio Study – Conversational AI Train
MediabistroPhoenix, AZ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Generative AI Specialist Humanities (English and French)
Innodata IncPhoenix, AZ, USserp_jobs.job_card.full_time +1
Become a Luxury Brand Evaluator in Phoenix, AZ - Apply Now
CXGScottsdale, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Audio Evaluation Expert - Fully Remote Job at Mercor in Phoenix
MediabistroPhoenix, AZ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Canada Tax Research AnalystScottsdale, AZ;Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA;United States - Remote
SymmetryScottsdale, AZ, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
Laboratory Analyst (W - Su, Day Shift) Eurofins Environment Testing Southwest, Phoenix, AZ
Eurofins Environment Testing Southwest, LLCUSA, Arizona, Phoenixserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Clinical Informatics Analyst (BI Engineer / SQL Programming) - REMOTE
Molina HealthcareMesa, AZ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator - Scottsdale, AZ
CXGTempe, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Board Certified Behavioral Analyst
Action Behavior CentersMaricopa, AZ, United Statesserp_jobs.job_card.full_time
Media & AI Coordinator
Mint CannabisTempe, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Remote Finance Advisor - AI Trainer
Data AnnotationGilbert, AZ, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Canada Tax Research Analyst, Symmetry Scottsdale, AZ;Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA;United States - Remote
GustoScottsdale, AZ, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
Lead Gen AI Specialist
Axiom Software Solutions LimitedPhoenix, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Data Analyst
Fresh Start Womens FoundationPhoenix, AZ, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationGilbert, Arizonaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Phoenix
MediabistroPhoenix, AZ, United Statesserp_jobs.job_card.full_time
GEN AI ENGINEER
Purple DrivePhoenix, AZ, Arizona, USAserp_jobs.job_card.full_time
Product Manager - Applied AI
TOTUSScottsdale, Arizona, United States, 85250serp_jobs.job_card.full_time