Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsSignal Hill, California, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Signal Hill, California, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationLakewood, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Strategy Analyst

Strategy Analyst

EVPassportSanta Monica, CA, US
serp_jobs.job_card.full_time
EVPassport is the EV Charging hardware and software platform for purpose-driven organizations.Brands committed to sustainability rely on EVPassport to provide their customers with the most seamless...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Become a Luxury Brand Evaluator in Los Angeles, CA- Apply Now

Become a Luxury Brand Evaluator in Los Angeles, CA- Apply Now

CXGCentury City, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Data and Systems Analyst

Data and Systems Analyst

InsideHigherEdOrange, California, United States
serp_jobs.job_card.full_time +1
Fair Labor Standard Act Classification : .Chapman University is required to provide a reasonable estimate of the compensation range for this position. This range takes into account a variety of factor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
International Research Equity Analyst

International Research Equity Analyst

Virtus Investment PartnersLos Angeles, CA, US
serp_jobs.job_card.full_time
International Research Analyst.Kayne Anderson Rudnick Investment, a Registered Investment Advisor based in Los Angeles, is currently searching for an International Research Analyst with a small / mid...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Credit Research Analyst, Municipals

Credit Research Analyst, Municipals

PIMCONewport Coast, CA, US
serp_jobs.job_card.full_time
Municipal Credit Research Analyst.PIMCO is a global leader in active fixed income with deep expertise across public and private markets. We invest our clients' capital across a range of fixed income...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Remote Financial Analyst - AI Trainer (Whittier)

Remote Financial Analyst - AI Trainer (Whittier)

Data AnnotationWhittier, CA, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less
Technical Research Associate - AI

Technical Research Associate - AI

Keywords StudiosLos Angeles, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
USA Remote (Prefer PST Time Zone).The Technical Research Associate is a non-traditional role in which you will work on our AI data collection team. You have a background in QA or data analysis and a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Human Intelligence Analyst

Human Intelligence Analyst

beBeeIntelligenceAnaheim, California, US
serp_jobs.job_card.full_time
Human Intelligence Collector Job Description.Check all associated application documentation thoroughly before clicking on the apply button at the bottom of this description.This is an exciting oppo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Research Analyst Global Equities (Consumer Staples)

Research Analyst Global Equities (Consumer Staples)

Causeway Capital ManagementLos Angeles, CA, US
serp_jobs.job_card.full_time
Company Overview : Causeway Capital Management LLC provides equity investment management services primarily to institutional clients including corporations, pension plans, sovereign wealth funds, su...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Analyst, Prospect Management and Research

Analyst, Prospect Management and Research

Loyola Marymount UniversityLos Angeles, CA, US
serp_jobs.job_card.full_time
This position reports to the Director of Prospect Management and Research (PMR).The Analyst is an essential part of a team dedicated to supporting University Advancement philanthropic goals and mis...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Analytics Specialist

Analytics Specialist

Joni and FriendsAgoura Hills, CA, US
serp_jobs.job_card.full_time
Under the supervision of the Data Batching Team Lead, support the overall objectives of Joni and Friends.Perform duties and responsibilities including, but not limited to : .Daily Scanning of Checks ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Remote Senior Financial Analyst - AI Trainer (Arcadia)

Remote Senior Financial Analyst - AI Trainer (Arcadia)

Data AnnotationArcadia, CA, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationBellflower, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationGarden Grove, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Los Angeles

Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Los Angeles

MediabistroLos Angeles, CA, United States
serp_jobs.job_card.full_time
Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Project Lead - AI

Project Lead - AI

Keywords StudiosLos Angeles, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
USA Remote (Prefer PST Time Zone).This exciting new Lead role focuses on the managing of a 50-person team who are accountable for the training of an AI engine and coordinating work / hand-offs to alt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Freelance Luxury Brand Evaluator Automotive Project - Greater Los Angeles

Freelance Luxury Brand Evaluator Automotive Project - Greater Los Angeles

CXGDockweiler, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!. As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationRancho Palos Verdes, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Remote Video Research Participant $25 / Session Help Build AI Security Tools

Remote Video Research Participant $25 / Session Help Build AI Security Tools

Your Personal AILos Angeles, CA, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Join a cutting-edge research initiative developing AI systems that protect against digital fraud and deepfakes.We're seeking participants across major North American cities to contribute to this im...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30