AI Agent Evaluation Analyst
VirtualVocationsIndependence, Missouri, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Independence, Missouri, United States
Job_description.internal_linking.related_jobs
Enterprise Bank & Trust was founded in the spirit of entrepreneurship and community.From the small mom-and-pop coffee shop to the large construction company that employs local people, our goal ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Want to apply to this job via text messaging? Text.The advertised program is an AI recruiting assistant that helps you apply to jobs with Compass Group.
Message and data rates may apply.Text STOP t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
City Wide is seeking a dynamic.We are looking for someone to work onsite, but will consider remote candidates.As the Data Analyst at City Wide, your mission is to empower franchise success and oper...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At TreviPay, we believe that Loyalty Begins at the Payment.TreviPay is an innovator in fintech with a 40+ year legacy in B2B payments and serves thousands of customers with our fully managed B2B pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Seeking Italian speakers for innovative language research.We're building next-generation AI that truly understands Italian.
Participate in our conversational recording study from the comfort of your...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Senior Market And Competitive Intelligence Analyst.Black & Veatch allows you to lend your talent and perspective to humanity's biggest challenges in a flexible environment where you are empowered t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Generative AI Specialist - Humanities (English and French).Flexible Part-Time Role (part-time, up to 28 hours weekly, no guaranteed hours.
Innodata (NASDAQ : INOD) is a leading data engineering compa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Become a Luxury Brand Evaluator in San Juan, PR - Apply Now.Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
About Us Concord isn't your typical consulting firm; we are an execution company with a passion for making things happen.
Our mission is to help clients enhance customer experiences, optimize operat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Take the next step in your career as our new Netflix Data Analyst to perform responsibilities as a Data Analyst.Work with your team to maintain efficiency and high standards.Deliver outstanding ser...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Evaluation Specialist
Enterprise Bank and TrustKansas City, KS, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationShawnee, Kansasserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationIndependence, Missouriserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Become a Luxury Brand Evaluator in Kansas City, MO - Apply Now
CXGKansas City, KS, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationBlue Springs, Missouriserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Kansas City
MediabistroKansas City, MO, United Statesserp_jobs.job_card.full_time
Audio Evaluation Expert - Fully Remote Job at Mercor in Kansas City
MediabistroKansas City, MO, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
SUPV, SUITES
Levy SectorKansas City, MO, USserp_jobs.job_card.full_time
Data Analyst
City Wide Facility SolutionsLenexa, KS, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Principal AI Engineer I
TreviPayOverland Park, Kansas, United States, 66204serp_jobs.job_card.full_time
Remote Italian Audio Study – Conversational AI Training Job at Your Personal AI
MediabistroKansas City, MO, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Market and Competitive Intelligence Analyst
Black & VeatchOverland Park, KS, USserp_jobs.job_card.full_time
Generative AI Specialist Humanities (English and French)
Innodata IncKansas City, MO, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
English Writing and Content Reviewing Expertise Sought for AI Training
OutlierKansas City, MO, United Statesserp_jobs.job_card.full_time
Become a Luxury Brand Evaluator in San Juan, PR- Apply Now Job at CXG in Kansas
MediabistroKansas City, MO, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierKansas City, MO, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationIndependence, Missouriserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in Kansas City
MediabistroKansas City, MO, United Statesserp_jobs.job_card.full_time
Entry-Level Analyst - Data and Analytics (2026 Program)
Concord USAParkville, MO, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Netflix Data Analyst
TradeJobsWorkforce64150 Riverside, MO, USserp_jobs.job_card.full_time