AI Evaluation Analyst
VirtualVocationsSouthport, Indiana, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Southport, Indiana, United States
Job_description.internal_linking.related_jobs
The Heritage Group (THG) is partnering with Orr Fellowship in the hiring of an early career individual for its Data Science Rotational Development Program where the Fellow will complete three eight...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
The work we do at Eurofins matters, and so do our employees.At Eurofins, we put a focus on your professional growth.We provide our employees the ability to break into the biopharmaceutical industry...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Implementation Analyst | Professional Services | USA | Remote or Hybrid.RLDatix is on a mission to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality car...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At Lighthouse, we believe in ongoing progression in the field of ABA! We emphasize the importance of individualized, comprehensive treatment packages, and accomplish this through our collaborative ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Senior Implementation Analyst | Professional Services | USA | Hybrid or Remote.RLDatix (RLD) is on a mission to help raise the standard of care…everywhere.
Trusted by over 10,000 healthcare o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
SH-727 Healthcare Data Quality Analyst Indianapolis IN.Summary : Position Summary : serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
As part of a diverse community of faculty and staff who represent many faith systems and worldviews, Marian University is seeking a detail-oriented, analytical, and mission-driven Prospect Research...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
The Science Team at Russell Tobin & Associates supporting the Pharmaceutical Industry has an opening for Dispute Research Analyst in Indianapolis, IN.
Position Summary : The Dispute Research Analyst ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Own requirements gathering process and facilitate discussions with business and technical team to manage enhancement flow.
Coordinate and Execute BST & UAT testing leveraging a strong understand...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Eurofins Scientific is an international life sciences company, providing a unique range of analytical testing services to clients across multiple industries, to make life and our environment safer,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At Definitive Healthcare (NASDAQ : DH), we’re passionate about turning data, analytics, and expertise into meaningful intelligence that helps our customers achieve success and shape the future of he...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Operational Intelligence Center Analyst.The Operational Intelligence Center (OIC) is a sophisticated command center focused on security support for retail centers across North America.This position...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Epic Community Connect Analyst.EpicCare Ambulatory build, implementation, and support.The ideal candidate will have a blend of.
Epic skills and clinical workflow understanding.Build, configure, and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Analytics and Artificial Intelligence Orr Fellow - Data Science Rotational Development Program
The Heritage GroupUSA, Indiana, Indianapolisserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Bioassay Analyst
Eurofins USA PSS Insourcing SolutionsIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Implementation Analyst
RLDatixCarmel, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Board Certified Behavior Analyst
Lighthouse Autism CenterNoblesville, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Tax Expert - Local
IntuitMARTINSVILLE, Indiana, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Implementation Analyst
RLDatixCarmel, IN, USserp_jobs.job_card.full_time
Healthcare Data Quality Analyst
SyrahealthIndianapolis, IN, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Tax Expert
IntuitMARTINSVILLE, Indiana, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Prospect Research Analyst
Marian UniversityIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Dispute Research Analyst
Pride GlobalIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Asset Management, Leveraged Credit Research Analyst - Global Fixed Income, Currency, and Commodities Team
ChaseIndianapolis, IN, USserp_jobs.job_card.full_time
Analyst 2 - Validation
eTeam IncMooresville, Indiana, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Bioassay Analyst
Eurofins Lancaster Laboratories Professional Scientific Services, LLCUSA, Indiana, Indianapolisserp_jobs.job_card.full_time
Digital Media & Audience Analyst Job at Definitive Healthcare in Indianapolis
MediabistroIndianapolis, IN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Analyst, Intelligence-Third Shift
Simon Property GroupIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Tax Expert - Onsite - 2+ Yrs Paid Tax Experience Required
IntuitMARTINSVILLE, Indiana, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Asset Management, Leveraged Credit Research Analyst - Global Fixed Income, Currency, and Commodities Team
JPMorgan ChaseIndianapolis, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Remote Financial Analyst - AI Trainer
Data AnnotationFishers, IN, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Epic Ambulatory Analyst
ClinDCast LLCZionsville, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Tax Expert - 2+ Yrs Paid Tax Experience Required
IntuitMARTINSVILLE, Indiana, United Statesserp_jobs.job_card.full_time