Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsSouth Bend, Indiana, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • South Bend, Indiana, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationElkhart, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Sr. Technical SEO Analyst Job at Tire Rack in South Bend

Sr. Technical SEO Analyst Job at Tire Rack in South Bend

MediabistroSouth Bend, IN, United States
serp_jobs.job_card.full_time
We are seeking a highly skilled.You will be responsible for ensuring optimal crawlability, indexation, site speed, and linking architecture, while working closely with cross-functional teams.If you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Systems Analyst

Systems Analyst

University of Notre DameNotre Dame, IN, US
serp_jobs.job_card.full_time
For over 180 years, the University of Notre Dame has been a leading American research university, offering a distinct perspective in higher education. This Catholic institution, based in Notre Dame,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Employer Consultant

Employer Consultant

Ivy TechSouth Bend, IN, US
serp_jobs.job_card.full_time
The Employer Consultant provides leadership for workforce training initiatives and business and industry partnerships to advance the development of and enrollment in college-ready programs for busi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Patient Accounts Training & Quality Analyst

Patient Accounts Training & Quality Analyst

Beacon Health SystemGranger, Indiana, United States, 46530
serp_jobs.job_card.full_time
Patient Accounts Training & Quality Analyst.The Patient Accounts Trainer is responsible for operationalizing and maintaining successful education programs for the department, as well as researching...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Institutional Research Specialist

Institutional Research Specialist

University of Notre DameNotre Dame, IN, US
serp_jobs.job_card.full_time
The University of Notre Dame is more than a workplace! We are a vibrant, mission-driven community where every employee is valued and supported. Rooted in a tradition of excellence and inspired by ou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationSouth Bend, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationMishawaka, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Plant Operations Analyst- Warsaw, IN

Plant Operations Analyst- Warsaw, IN

Happy Egg CompanyWarsaw, IN, US
serp_jobs.job_card.full_time
The Operations Analyst will play a key role in improving efficiency and effectiveness across Happy Egg by identifying process gaps, analyzing data, and developing actionable recommendations.This ro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Survey Research Analyst (Hiring Immediately)

Remote Survey Research Analyst (Hiring Immediately)

Earn HausBenton Harbor, Michigan, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time +2
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Client Support Analyst

Client Support Analyst

PG ForstaSouth Bend, IN, United States
serp_jobs.job_card.full_time
PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Procurement Analyst

Procurement Analyst

Tecomet, Inc.Warsaw, IN, US
serp_jobs.job_card.full_time
As the critical member of the Tecomet Global Procurement and Supply Chain team.Procurement Analyst will manage all procurement data analytics, purchasing workflows, PowerBI data integrity and dashb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Board Certified Behavior Analyst

Board Certified Behavior Analyst

Journeys Behavior Learning CenterMishawaka, IN, USA
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Journeys Autism Center is a center-based ABA service provider located in Mishawaka, IN.The center offers individualized and ongoing programming to promote socially significant skills that increase ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Board Certified Behavior Analyst (BCBA) / INDIANA LBA

Board Certified Behavior Analyst (BCBA) / INDIANA LBA

Astra IndianaSouth Bend, Indiana
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Come join us at Astra ABA as we transform the field of Applied Behavior Analysis! If you have the passion, we have the support. Let’s work together to help children receive the best kind of ABA ther...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Quality Analyst

Quality Analyst

Zimmer BiometWarsaw, IN, United States
serp_jobs.job_card.full_time
At Zimmer Biomet, we believe in pushing the boundaries of innovation and driving our mission forward.As a global medical technology leader for nearly 100 years, a patient's mobility is enhanced by ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationSouth Bend, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Board Certified Behavior Analyst (BCBA)

Board Certified Behavior Analyst (BCBA)

UNIFI Autism CareMishawaka, IN, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Join UNIFI Autism Care and Lead with Purpose and Passion!.Are you a BCBA with a heart for making a real difference in the lives of children with autism? Do you crave meaningful, hands-on ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationElkhart, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Care Delivery Board Certified Behavior Analyst (BCBA)

Care Delivery Board Certified Behavior Analyst (BCBA)

UNIFI Autism CareMishawaka, IN, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Become a BCBA at UNIFI Autism Care.RBTs to bring treatment plans to life.As a BCBA at UNIFI, you’ll have the opportunity to coach and empower RBTs, collaborate closely with our Programming BCBAs, a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationElkhart, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30