AI Agent Evaluation Analyst
VirtualVocationsIndianapolis, Indiana, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Indianapolis, Indiana, United States
Job_description.internal_linking.related_jobs
The work we do at Eurofins matters, and so do our employees.At Eurofins, we put a focus on your professional growth.We provide our employees the ability to break into the biopharmaceutical industry...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Generative AI Specialist - Humanities (English and German).Alaska, California, Colorado, Nevada, Puerto Rico).Flexible Part-Time Role (part-time, up to 25 hours weekly, no guaranteed hours.Innodata...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Implementation Analyst | Professional Services | USA | Remote or Hybrid.RLDatix is on a mission to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality car...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
CS / Sales Agent - Entry Level & Remote.With consistent growth year over year, we're looking to add more talented individuals to our rapidly growing company.
This career allows you to determine your o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
SH-727 Healthcare Data Quality Analyst Indianapolis IN.Summary : Position Summary : serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Generative AI Specialist - Humanities (English and Chinese).Alaska, California, Colorado, Nevada, Puerto Rico).Flexible Part-Time Role (part-time, up to 25 hours weekly).
Innodata (NASDAQ : INOD) is ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Generative AI Specialist - Humanities (English and Italian).Alaska, California, Colorado, Nevada, Puerto Rico).Flexible Part-Time Role (part-time, up to 25 hours weekly).
Innodata (NASDAQ : INOD) is ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
As part of a diverse community of faculty and staff who represent many faith systems and worldviews, Marian University is seeking a detail-oriented, analytical, and mission-driven Prospect Research...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
The Science Team at Russell Tobin & Associates supporting the Pharmaceutical Industry has an opening for Dispute Research Analyst in Indianapolis, IN.
Position Summary : The Dispute Research Analyst ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Eurofins Scientific is an international life sciences company, providing a unique range of analytical testing services to clients across multiple industries, to make life and our environment safer,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At Definitive Healthcare (NASDAQ : DH), we’re passionate about turning data, analytics, and expertise into meaningful intelligence that helps our customers achieve success and shape the future of he...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Own requirements gathering process and facilitate discussions with business and technical team to manage enhancement flow.
Coordinate and Execute BST & UAT testing leveraging a strong understand...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Operational Intelligence Center Analyst.The Operational Intelligence Center (OIC) is a sophisticated command center focused on security support for retail centers across North America.This position...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Epic Community Connect Analyst.EpicCare Ambulatory build, implementation, and support.The ideal candidate will have a blend of.
Epic skills and clinical workflow understanding.Build, configure, and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Seeking Italian speakers for innovative language research.We're building next-generation AI that truly understands Italian.
Participate in our conversational recording study from the comfort of your...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
Bioassay Analyst
Eurofins USA PSS Insourcing SolutionsIndianapolis, IN, USserp_jobs.job_card.full_time
Generative AI Specialist Humanities (English and German)
Innodata IncIndianapolis, IN, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Implementation Analyst
RLDatixCarmel, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
CS / Sales Agent - Entry Level & REMOTE, work by Appointments
Global EliteNoblesville, IN, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationLawrence, Indianaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Healthcare Data Quality Analyst
SyrahealthIndianapolis, IN, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Generative AI Specialist Humanities (English and Chinese)
Innodata IncIndianapolis, IN, USserp_jobs.job_card.full_time +1
Generative AI Specialist Humanities (English and Italian)
Innodata IncIndianapolis, IN, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Prospect Research Analyst
Marian UniversityIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Dispute Research Analyst
Pride GlobalIndianapolis, IN, USserp_jobs.job_card.full_time
Bioassay Analyst
Eurofins Lancaster Laboratories Professional Scientific Services, LLCUSA, Indiana, Indianapolisserp_jobs.job_card.full_time
Digital Media & Audience Analyst Job at Definitive Healthcare in Indianapolis
MediabistroIndianapolis, IN, United Statesserp_jobs.job_card.full_time
Analyst 2 - Validation
eTeam IncMooresville, Indiana, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Asset Management, Leveraged Credit Research Analyst - Global Fixed Income, Currency, and Commodities Team
ChaseIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Analyst, Intelligence-Third Shift
Simon Property GroupIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationColumbus, Indianaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Epic Ambulatory Analyst
ClinDCast LLCZionsville, IN, USserp_jobs.job_card.full_time
Your Personal AI is hiring : Remote Italian Audio Study – Conversational AI Train
MediabistroIndianapolis, IN, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Asset Management, Leveraged Credit Research Analyst - Global Fixed Income, Currency, and Commodities Team
JPMorgan ChaseIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationColumbus, Indianaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1