AI Evaluation Analyst
VirtualVocationsGlendale, Arizona, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Glendale, Arizona, United States
Job_description.internal_linking.related_jobs
Generative AI Specialist - Humanities (English and French).Flexible Part-Time Role (part-time, up to 28 hours weekly, no guaranteed hours.
Innodata (NASDAQ : INOD) is a leading data engineering compa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
APPLICATIONS ARE REVIEWED DAILY.YOU CAN EXPECT A RESPONSE WITHIN 24 HOURS.Our Patients : An intentional focus on small caseloads with a compassionate care approach.
Our Culture : ABC Core Values are m...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We're looking for a Senior Product Analyst to drive data-informed decision-making through advanced funnel analysis and experimentation.
This role will be instrumental in optimizing our customer jour...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Symmetry is the payroll infrastructure for software & payroll platforms powering the paychecks of over 64 million workers each year.
Our fully integrated suite of payroll tax APIs and software tools...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Eurofins Scientific is a network of independent companies providing a unique range of analytical testing services to clients across multiple industries, to make life and our environment safer, heal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
The Revenue Cycle Data Analyst utilizes various reporting platforms to generate reports.They review and clean up data, analyze datasets, and schedule automated reports, running them manually when n...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Location : Phoenix, AZ (On-Site / Office).Security Clearance : Moderate Background Investigation (MBI) Schedule : Due to the nature of law enforcement work and operation, position may require occasional...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Media & AI Coordinator Location : .Let’s Be Blunt Cannabis isn’t just an industry — it’s a movement.Mint Cannabis is proudly leading the charge from premium flower a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
STAND 8 provides end to end IT solutions to enterprise partners across the United States and with offices in Los Angeles, New York, New Jersey, Atlanta, and more including internationally in Mexico...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
The Revenue Cycle Data Analyst utilizes various reporting platforms to generate reports.They review and clean up data, analyze datasets, and schedule automated reports, running them manually when n...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Canada Payroll Tax Research Analyst, Symmetry.Symmetry Software is part of Gusto.Symmetry is the payroll infrastructure for software & payroll platforms powering the paychecks of over 64 million wo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
A pillar in the Phoenix community for 30 years, Fresh Start’s mission is to provide access and resources that help women achieve self-sufficiency and use their strength to thrive.We envision ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Planning Research Analyst Sr (Open Until Filled).Monday - Friday, 8am - 5pm; some evenings and weekends may be required.Summer Hours : Monday - Thursday, 7am-6pm.
The Maricopa County Community Colleg...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Totus is the modern gift card platform built for brands.We're rethinking gift cards from the ground up.We provide brands with a powerful, tech-driven platform that simplifies issuance, distribution...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Focus on the core content of the job post, removing all extra metadata from the top of the page.Remove hanging information like department, location, job_id, requisition_id, and others.Delete obvio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Generative AI Specialist Humanities (English and French)
Innodata IncPhoenix, AZ, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Board Certified Behavioral Analyst
Action Behavior CentersBuckeye, AZ, United Statesserp_jobs.job_card.full_time
Sr. Product Analyst
ProsperPhoenix, Arizona, United States, 85003serp_jobs.job_card.full_time
Audio Evaluation Expert - Fully Remote Job at Mercor in Phoenix
MediabistroPhoenix, AZ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Canada Tax Research AnalystScottsdale, AZ;Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA;United States - Remote
SymmetryScottsdale, AZ, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
Laboratory Analyst (W - Su, Day Shift) Eurofins Environment Testing Southwest, Phoenix, AZ
Eurofins Environment Testing Southwest, LLCUSA, Arizona, Phoenixserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Revenue Cycle Data Analyst - ON-SITE (Phoenix)
Mountain Park Health CenterPhoenix, AZ, USserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Investigative Support Analyst
Clearance JobsPhoenix, AZ, USserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationSurprise, Arizonaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Media & AI Coordinator
Mint CannabisTempe, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
KYC Data Analyst I
Stand 8USA, Arizona, Phoenixserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Revenue Cycle Data Analyst - ON-SITE
Mountain Park Health CenterPhoenix, AZ, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Canada Tax Research Analyst, Symmetry Scottsdale, AZ;Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA;United States - Remote
GustoScottsdale, AZ, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Analyst
Fresh Start Womens FoundationPhoenix, AZ, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationPeoria, Arizonaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationBuckeye, Arizonaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Phoenix
MediabistroPhoenix, AZ, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Planning Research Analyst Sr (Open Until Filled)
Maricopa Community College DistrictPhoenix, AZ, United Statesserp_jobs.job_card.full_time +1
Product Manager - Applied AI
TOTUSScottsdale, Arizona, United States, 85250serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Manager AI & Data Science
ON SemiconductorScottsdale, AZ, USserp_jobs.job_card.full_time