Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsEvansville, Indiana, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Evansville, Indiana, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Travel Certified Surgical Technologist

Travel Certified Surgical Technologist

Talent4HealthNewburgh, IN, US
serp_jobs.job_card.full_time
Talent4Health is seeking a travel Certified Surgical Technologist for a travel job in Newburgh, Indiana.Job Description & Requirements. Certified Surgical Technologist.A leader and innovator, of...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
CT Technologist

CT Technologist

RTTEMPS LLCNewburgh, IN, US
serp_jobs.job_card.permanent
RTTEMPS provides short-term & long-term travel assignments and permanent placement of health care professionals to clients nationwide. Building on a rich history of service to the health care fi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationEvansville, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationEvansville, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Travel Certified Surgical Technologist

Travel Certified Surgical Technologist

Nightingale Nurses - AlliedNewburgh, IN, US
serp_jobs.job_card.full_time
Nightingale Nurses - Allied is seeking a travel Certified Surgical Technologist for a travel job in Newburgh, Indiana.Job Description & Requirements. Certified Surgical Technologist.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Quality Vendor Economics Analyst

Quality Vendor Economics Analyst

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Quality Vendor Economics Analyst III.Key Responsibilities Assess financial opportunities related to new and existing Quality vendor contracts Document vendor processes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationEvansville, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Generative AI Specialist

Generative AI Specialist

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Director of Applied AI

Director of Applied AI

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Director of Applied AI.Key Responsibilities Lead the strategy and execution of applied AI initiatives across the organization Develop training programs to enhance AI f...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Staff Product Manager, AI

Staff Product Manager, AI

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Staff Product Manager, AI Evaluations.Key Responsibilities Define and drive the roadmap for the AI Evaluation Framework, focusing on quantitative metrics and human-in-t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Data Analyst

Data Analyst

Old National BankEvansville, IN, United States
serp_jobs.job_card.full_time
US-IL-Chicago | US-IN-Evansville | US-MN-Saint Paul | US-WI-Milwaukee | US-MN-St Louis Park | US-TN-Nashville | US-IN-Indianapolis. Old National Bank has been serving clients and communities since 1...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Medical Records Specialist

Medical Records Specialist

TEKsystemsMount Vernon, IN, US
serp_jobs.job_card.full_time
Prepping, scanning, indexing, retrieval of documents, reconciliation of accounts, answering phones, and other duties.This candidate will perform clerical duties associated with medical records proc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Data Analyst 2

Data Analyst 2

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Data Analyst 2 to work remotely.Key Responsibilities Assist in designing and implementing analytics platform components using Microsoft Azure, Databricks, and PowerBI ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst, SEO & SEM

Search Analyst, SEO & SEM

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst, SEO & SEM.Key Responsibilities Assist in planning, executing, optimizing, and reporting on paid search campaigns Conduct keyword research, manage copy ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationEvansville, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Adoption Solutions Architect

AI Adoption Solutions Architect

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Prototype Specialist

AI Prototype Specialist

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Data Scientist, AI Healthcare

Data Scientist, AI Healthcare

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Data Scientist, Care Intelligence (All Levels).Key Responsibilities Become an expert in the business model and patient experience to identify AI product development opp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Senior CRO Analyst

Senior CRO Analyst

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Senior Conversion Rate Optimization (CRO) Analyst to drive optimization initiatives and enhance user experience across digital properties. Key Responsibilities Own key c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours