AI Agent Evaluation Analyst
VirtualVocationsChandler, Arizona, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Chandler, Arizona, United States
Job_description.internal_linking.related_jobs
Seeking Italian speakers for innovative language research.We're building next-generation AI that truly understands Italian.
Participate in our conversational recording study from the comfort of your...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Eurofins Scientific is a network of independent companies providing a unique range of analytical testing services to clients across multiple industries, to make life and our environment safer, heal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Symmetry is the payroll infrastructure for software & payroll platforms powering the paychecks of over 64 million workers each year.
Our fully integrated suite of payroll tax APIs and software tools...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Eurofins Scientific is a network of independent companies providing a unique range of analytical testing services to clients across multiple industries, to make life and our environment safer, heal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
This role is seeking candidates who specialize in EDI analytics, we are not seeking developers, thank you! •.As an EDI Analyst, you will be responsible for the development, implementation and ongoin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less 
Design and implement LLM-powered features using models like Gemini, LLaMA, or lighter BERT variants.Build and optimize RAG (Retrieval-Augmented Generation) pipelines, vector stores, and embedding s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Media & AI Coordinator Location : .Let’s Be Blunt Cannabis isn’t just an industry — it’s a movement.Mint Cannabis is proudly leading the charge from premium flower a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Location : Metropark, NJ / / Charlotte, NC.We're seeking an experienced Lead Gen AI Specialist to join our team and drive innovation in AI solutions.
The ideal candidate will have expertise in Gener...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Full-Time | 100% Onsite | Temp-to-Hire.Monday – Saturday, 8 : 00 a.We are seeking a highly skilled and detail-oriented.This role is critical in supporting day-to-day operations by transforming ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Hands on Exp in Oracle finance Cloud knowledge Accounts payable module Oracle Finance Cloud Implementation experience with expertise in Accounts Payable and knowledge in Ora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Totus is the modern gift card platform built for brands.We're rethinking gift cards from the ground up.We provide brands with a powerful, tech-driven platform that simplifies issuance, distribution...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Paid full-time training provided!.This role is on-site at 350 N McClintock Dr, Chandler, Arizona 85226.EchoStar is reimagining the future of connectivity.
Our business reach spans satellite televisi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Your Personal AI is hiring : Remote Italian Audio Study – Conversational AI Train
MediabistroPhoenix, AZ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Laboratory Analyst (W - Su, Day Shift) Eurofins Environment Testing Southwest, Phoenix, AZ
Eurofins USA Environment TestingPhoenix, AZ, USserp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator - Scottsdale, AZ
CXGParadise Valley, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Audio Evaluation Expert - Fully Remote Job at Mercor in Phoenix
MediabistroPhoenix, AZ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Canada Tax Research AnalystScottsdale, AZ;Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA;United States - Remote
SymmetryScottsdale, AZ, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
Laboratory Analyst (W - Su, Day Shift) Eurofins Environment Testing Southwest, Phoenix, AZ
Eurofins Environment Testing Southwest, LLCUSA, Arizona, Phoenixserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
EDI Analyst
American Vision PartnersPhoenix, AZ, USserp_jobs.job_card.full_time
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in Phoenix
MediabistroPhoenix, AZ, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Staff ML Engineer, Applied AI
Drive HealthGilbert, AZ, USserp_jobs.job_card.full_time
Media & AI Coordinator
Mint CannabisTempe, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Remote Finance Advisor - AI Trainer
Data AnnotationGilbert, AZ, United Statesserp_jobs.job_card.full_time +1
Become a Luxury Brand Evaluator in Phoenix, AZ - Apply Now
CXGPhoenix, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Lead Gen AI Specialist
Axiom Software Solutions LimitedPhoenix, AZ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationMesa, AZ, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Excel Data Analyst
WOTM - Partners ProfessionalLitchfield Park, AZ, USserp_jobs.job_card.full_time +1
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Phoenix
MediabistroPhoenix, AZ, United Statesserp_jobs.job_card.full_time
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Phoenix
MediabistroPhoenix, AZ, United Statesserp_jobs.job_card.full_time
GEN AI ENGINEER
Purple DrivePhoenix, AZ, Arizona, USAserp_jobs.job_card.full_time
Product Manager - Applied AI
TOTUSScottsdale, Arizona, United States, 85250serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Retention Agent - Entry Level
EchoStarMARICOPA, Arizona, United Statesserp_jobs.job_card.full_time