Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsSan Buenaventura, California, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • San Buenaventura, California, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Local Family Driver - Apply Today for Flexible Work

Local Family Driver - Apply Today for Flexible Work

Copilot CareersFrazier Park, CA, United States
serp_jobs.job_card.full_time
Make a difference in your community while earning up to $50 per ride with HopSkipDrive’s $500 Welcome Guarantee! Terms apply. We partnered with HopSkipDrive to find responsible CareDrivers to provid...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Data Analyst 2

Data Analyst 2

VirtualVocationsOxnard, California, United States
serp_jobs.job_card.full_time
A company is looking for a Data Analyst 2 to work remotely.Key Responsibilities Assist in designing and implementing analytics platform components using Microsoft Azure, Databricks, and PowerBI ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationSanta Barbara, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationThousand Oaks, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Local Child Driver - Pick Your Schedule - Support Families

Local Child Driver - Pick Your Schedule - Support Families

Copilot CareersFrazier Park, CA, United States
serp_jobs.job_card.full_time
Make a difference in your community while earning up to $50 per ride with HopSkipDrive’s $500 Welcome Guarantee! Terms apply. We partnered with HopSkipDrive to find responsible CareDrivers to provid...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst

Search Analyst

VirtualVocationsSan Buenaventura, California, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Director of Applied AI

Director of Applied AI

VirtualVocationsSan Buenaventura, California, United States
serp_jobs.job_card.full_time
A company is looking for a Director of Applied AI.Key Responsibilities Lead the strategy and execution of applied AI initiatives across the organization Develop training programs to enhance AI f...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Trainer

AI Trainer

VirtualVocationsSan Buenaventura, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationSanta Barbara, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationCamarillo, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Product Analyst

Product Analyst

VirtualVocationsSan Buenaventura, California, United States
serp_jobs.job_card.full_time
A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Quality Vendor Economics Analyst

Quality Vendor Economics Analyst

VirtualVocationsOxnard, California, United States
serp_jobs.job_card.full_time
A company is looking for a Quality Vendor Economics Analyst III.Key Responsibilities Assess financial opportunities related to new and existing Quality vendor contracts Document vendor processes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst, SEO & SEM

Search Analyst, SEO & SEM

VirtualVocationsOxnard, California, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst, SEO & SEM.Key Responsibilities Assist in planning, executing, optimizing, and reporting on paid search campaigns Conduct keyword research, manage copy ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationOxnard, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Business Data Analyst

Business Data Analyst

VirtualVocationsOxnard, California, United States
serp_jobs.job_card.full_time
A company is looking for a Business Data Analyst II.Key Responsibilities Analyze complex business problems using data to provide insights for decision-makers Deliver tailored insights focusing o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsSan Buenaventura, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationOxnard, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Local Family Driver - Flexible Hours - Apply Now

Local Family Driver - Flexible Hours - Apply Now

Copilot CareersFrazier Park, CA, United States
serp_jobs.job_card.full_time
Make a difference in your community while earning up to $50 per ride with HopSkipDrive’s $500 Welcome Guarantee! Terms apply. We partnered with HopSkipDrive to find responsible CareDrivers to provid...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days