AI Agent Evaluation Analyst
VirtualVocationsOmaha, Nebraska, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Omaha, Nebraska, United States
Job_description.internal_linking.related_jobs
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days At Definitive Healthcare (NASDAQ : DH), we’re passionate about turning data, analytics, and expertise into meaningful intelligence that helps our customers achieve success and shape the future of he...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Become a Luxury Brand Evaluator in San Juan, PR - Apply Now.Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
We are revolutionizing sports betting and online gaming in the United States.We are a partnership between two powerhouse organizations-MGM Resorts International and Entain Group.You know our name t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less Compliance - Advertising Analyst.Be among the first 25 applicants.Compliance - Advertising Analyst.Come join the dynamic team at Kestra Financial! Kestra Financial provides a leading independent ad...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Posted Tuesday, August 12, 2025 at 6 : 00 AM.Come join the dynamic team at Kestra Financial! Kestra Financial provides a leading independent advisor platform that empowers sophisticated, independent ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Calling all innovators find your future at Fiserv.We're Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world.
We connect financial instit...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
This position is for proposed future work expected to begin in 2026.Offutt Air Force Base, Omaha, NE.Top Secret / SCI with NC2 / ESI eligibility.
SAP / STO eligible; CI polygraph may be required.The Senio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Seeking Italian speakers for innovative language research.We're building next-generation AI that truly understands Italian.
Participate in our conversational recording study from the comfort of your...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Join Our Team as a Work-From-Home Data Entry Research Panelist!.Are you ready to earn money from the comfort of your own home? This exciting opportunity is perfect for anyone with a variety of skil...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
ESSENTIAL JOB FUNCTIONS Analyzes global markets for IT Services, servers, storage, backup, IT security, productivity software, remote monitoring services, hyperconvergence and IoT.Studies SMB and m...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
What company will I be working for?You will be working for a national security services firm, providing cutting-edge services across DoD and other agencies.
At Inflow,we believe in making it matter ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationOmaha, Nebraskaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationOmaha, Nebraskaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Audio Evaluation Expert - Fully Remote Job at Mercor in Omaha
MediabistroOmaha, NE, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Become a Luxury Brand Evaluator in the Upper Midwest - Apply Now
CXGOmaha, NE, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Definitive Healthcare is hiring : Digital Media & Audience Analyst in Omaha
MediabistroOmaha, NE, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationCouncil Bluffs, Iowaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Become a Luxury Brand Evaluator in San Juan, PR- Apply Now Job at CXG in Omaha
MediabistroOmaha, NE, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationBellevue, Nebraskaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Compliance Analyst, Responsible Gaming
BetMGMOmaha, Nebraska, United Statesserp_jobs.job_card.full_time
Compliance - Advertising Analyst Job at Kestra Financial in Omaha
MediabistroOmaha, NE, United Statesserp_jobs.job_card.full_time +1
Compliance - Advertising Analyst Job at Kestra PWS in Omaha
MediabistroOmaha, NE, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Compliance and Data Analyst
FiservOmaha, NE, USserp_jobs.job_card.full_time
Senior All Source Analyst
The Garrett GroupBellevue, NE, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Remote Italian Audio Study – Conversational AI Training Job at Your Personal AI
MediabistroOmaha, NE, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Work At Home Remote Data Entry Research Panelist
Maxion CorpBellevue, NE, usserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Analyst
TradeJobsWorkforce68002 Arlington, NE, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior All Source Intelligence Analyst (Top Secret / SCI Clearance)
Inflow-ns68113, NE, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationBellevue, Nebraskaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Omaha
MediabistroOmaha, NE, United Statesserp_jobs.job_card.full_time
Visual Data Evaluator Job at Firstsource Solutions Ltd in Omaha
MediabistroOmaha, NE, United Statesserp_jobs.job_card.full_time