Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsEvansville, Indiana, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Evansville, Indiana, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Entry Level Tax Preparer

Entry Level Tax Preparer

Jackson Hewitt - 3356Princeton, IN, US
serp_jobs.job_card.full_time
Seeking a job that fits around your life? Look no further! We provide.Embrace the possibilities by adding this side gig or growing a new career at Jackson Hewitt and apply today!.You will also have...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
CT Technologist

CT Technologist

RTTEMPS LLCNewburgh, IN, US
serp_jobs.job_card.permanent
RTTEMPS provides short-term & long-term travel assignments and permanent placement of health care professionals to clients nationwide. Building on a rich history of service to the health care fi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationEvansville, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst

Search Analyst

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Real Estate Sales Agent

Real Estate Sales Agent

Trueblood Real EstateEvansville, IN, US
serp_jobs.job_card.full_time
Active Real Estate License in Indiana Required.Elevate your real estate career with Trueblood Real Estate, where exceptional opportunities await to unlock your full potential!.Join our dynamic team...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI / ML Engineer

AI / ML Engineer

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for an AI / ML Engineer (REMOTE).Key Responsibilities Develop, train, evaluate, and deploy machine learning models focused on computer vision and predictive analytics Optimize...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationEvansville, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Trainer

AI Trainer

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Engineer

AI Engineer

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for an AI Engineer (FinTech Workflow Automation).Key Responsibilities Design, build, and deploy AI models into production Develop and maintain backend Python services for in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Content Editor

AI Content Editor

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for an AI Content Editor to join their SEO team in a remote, full-time capacity.Key Responsibilities Proofread and fact-check AI-assisted content for accuracy, clarity, and c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Market Intelligence Data Analyst

Market Intelligence Data Analyst

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Market Intelligence and Data Analyst - Annuities.Key Responsibilities Gather, analyze, model, and present competitive intelligence data to senior management and stakeho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour
  • serp_jobs.job_card.promoted
Generative AI Specialist

Generative AI Specialist

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Product Analyst

Product Analyst

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst, SEO & SEM

Search Analyst, SEO & SEM

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst, SEO & SEM.Key Responsibilities Assist in planning, executing, optimizing, and reporting on paid search campaigns Conduct keyword research, manage copy ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Staff AI & ML Engineer

Staff AI & ML Engineer

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Staff AI & ML Engineer to build and own end-to-end applications across the business.Key Responsibilities Build technical solutions using appropriate frameworks and data...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationEvansville, Indiana
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Sustaining Engineer Principal

AI Sustaining Engineer Principal

VirtualVocationsEvansville, Indiana, United States
serp_jobs.job_card.full_time
A company is looking for a Principal AI Sustaining Engineer for its AI Center of Excellence, working remotely.Key Responsibilities Represent expertise in AI and Machine Learning solutions to supp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours