AI Evaluation Analyst
VirtualVocationsGary, Indiana, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Gary, Indiana, United States
Job_description.internal_linking.related_jobs
Competitive Intelligence Analyst.Cooley is seeking a Competitive Intelligence Analyst to join the Data Delivery team.Cooley Innovation embraces a culture of customer service excellence and all memb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties.
And for more than 90 years our innovative drive has kept us a step ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
You are a data-driven compensation professional and aficionado! You yearn for something different, new, and exciting.You enjoy, love, and get a kick out of data from using formulas, summarizing dat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Taft is currently seeking a Knowledge & Research Analyst to join our Knowledge and Research Services Department.Taft Stettinius & Hollister is seeking a full-time Knowledge & Research Analyst with ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
About Human Capital Education : .Human Capital Education (HCE) empowers colleges and universities to grow enrollment, build internal capacity, and improve student success through marketing, CRM optim...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Imagine a place where your talent can make a meaningful difference in peoples' lives.Working at Feeding America is a uniquely rewarding experience in which our employees work together as vital part...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At HCSC, our employees are the cornerstone of our business and the foundation to our success.We empower employees with curated development plans that foster growth and promote rewarding, fulfilling...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Competitive Intelligence Analyst.Cooley is seeking a Competitive Intelligence Analyst to join the Data Delivery team.Position summary : Cooley Innovation embraces a culture of customer service excel...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Market Research And Data Analysis Intern / Volunteer.The collection features high-end men's and women's clothing and accessories for timeless style.
We provide custom, hand-made items ranging from con...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Have you ever walked down an aisle in your local Target and wondered why your favorite beverage or food product moved? Have you ever wanted to modernize the brand and bottle design for an iconic be...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
AlliedTravelCareers is working with Cynet Health to find a qualified BCBA - School in Elgin, Illinois, 60120!.Job Title : Bi-Lingual Social Worker Profession : Social Worker Specialty : Special Ed...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
As a manager research analyst, your objective and independent research on funds and other investment vehicles will help individuals, intermediaries, and institutional investors make better investme...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Competitive Intelligence Analyst
Cooley LLPChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Associate Analyst, Research
Allstate InsuranceChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierChicago, IL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Compensation Analyst
Green Thumb IndustriesChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationHammond, Indianaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in Chicago
MediabistroChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Knowledge & Research Analyst
Taft Stettinius & Hollister LLPChicago, IL, United Statesserp_jobs.job_card.full_time
Audio Evaluation Expert - Fully Remote Job at Mercor in Chicago
MediabistroChicago, IL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Research Analyst
Human Capital EducationChicago, IL, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Visual Data Evaluator Job at Firstsource Solutions Ltd in Chicago
MediabistroChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Analyst, Research (Chicago / Hybrid)
Feeding AmericaChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Market Research Analyst
Health Care Service CorporationChicago, IL, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Competitive Intelligence Analyst
CooleyChicago, IL, USserp_jobs.job_card.full_time
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Chicago
MediabistroChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Market Research and Data Analysis Intern / Volunteer
The Aparecio Foundation, NFPChicago, IL, USserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
NIQ Strategic Analytics & Insights Research Analyst, Customer Success FT
NielsenIQChicago, IL, USserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationGary, Indianaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationOak Lawn, Illinoisserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Board Certified Behavioral Analyst (BCBA) - School - $2,219 per week in Elgin, IL
AlliedTravelCareersChicago, Illinois, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Analyst, Manager Research
MorningstarChicago, IL, USserp_jobs.job_card.full_time