Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsGlendale, California, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Glendale, California, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationAnaheim, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationCovina, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND CorporationSanta Monica, CA, United States
serp_jobs.job_card.temporary
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in Chastworth, CA

Travel Board Certified Behavioral Analyst (BCBA) - School in Chastworth, CA

AlliedTravelCareersChastworth, CA, US
serp_jobs.job_card.full_time
AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Chastworth, California, 91311!.Board Certified Behavior Analyst (BCBA). With Aequor, you can enjoy the freedom to adva...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Research Data Analyst 3

Research Data Analyst 3

University of California - Los Angeles (UCLA)Los Angeles, CA, United States
serp_jobs.job_card.full_time
The California Policy Lab is seeking an experienced Data Analyst with a background or interest in labor economics and policy to contribute to our organization's proven track record bridging the gap...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Strategy Analyst

Strategy Analyst

EVPassportSanta Monica, CA, US
serp_jobs.job_card.full_time
EVPassport is the EV Charging hardware and software platform for purpose-driven organizations.Brands committed to sustainability rely on EVPassport to provide their customers with the most seamless...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Project Manager

AI Project Manager

E-SolutionsTorrance, CA, US
serp_jobs.job_card.full_time
About the client : Our client is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, acce.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Intelligence Analyst

Intelligence Analyst

SpaceXInglewood, CA, US
serp_jobs.job_card.permanent
SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technolo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Data and Systems Analyst

Data and Systems Analyst

InsideHigherEdOrange, California, United States
serp_jobs.job_card.full_time +1
Fair Labor Standard Act Classification : .Chapman University is required to provide a reasonable estimate of the compensation range for this position. This range takes into account a variety of factor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Technical Research Associate - AI

Technical Research Associate - AI

Keywords StudiosLos Angeles, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
USA Remote (Prefer PST Time Zone).The Technical Research Associate is a non-traditional role in which you will work on our AI data collection team. You have a background in QA or data analysis and a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Quantitative Analyst - Applied Quantitative Solutions (ML-AI)

Quantitative Analyst - Applied Quantitative Solutions (ML-AI)

Capital GroupLos Angeles, CA, United States
serp_jobs.job_card.full_time
I can succeed as a Quantitative Analyst at Capital Group".As a member of the Quantitative Research and Analytics group (QRA) at Capital Group (CG), you conduct rigorous peer-reviewed quantitative r...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Los Angeles

AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Los Angeles

MediabistroLos Angeles, CA, United States
serp_jobs.job_card.full_time
Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging. Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
International Research Equity Analyst

International Research Equity Analyst

Kayne Anderson Capital AdvisorsLos Angeles, CA, US
serp_jobs.job_card.full_time
International Research Analyst.Kayne Anderson Rudnick Investment, a Registered Investment Advisor based in Los Angeles, is currently searching for an International Research Analyst with a small / mid...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Research and Development Analyst Senior-Hybrid

Research and Development Analyst Senior-Hybrid

Logix Federal Credit UnionValencia, CA, United States
serp_jobs.job_card.full_time
Research and Development Analyst Senior-Hybrid.Research & Development Senior Analyst.Research & Development, including but not limited to product management activities, analyses of member and / or co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Research and Development Analyst III-Hybrid

Research and Development Analyst III-Hybrid

Logix Federal Credit UnionValencia, CA, United States
serp_jobs.job_card.full_time
Research and Development Analyst III-Hybrid.Research & Development Analyst III.Ensures integrity and accuracy of data gathering and reporting and communicates results in an informative and effectiv...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles

Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles

MediabistroLos Angeles, CA, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Research Data Analyst 3

Research Data Analyst 3

InsideHigherEdLos Angeles, California, United States
serp_jobs.job_card.full_time
About the California Policy LabThe California Policy Lab generates research insights for government impact.Through hands-on partnerships with government agencies, CPL performs rigorous research acr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationGarden Grove, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Human Data Research Analyst

Human Data Research Analyst

Keywords StudiosLos Angeles, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
USA Remote (Prefer PST Time Zone).This is a non-traditional Human Data Research Analyst role working with an exciting AI start-up based in San Francisco. In this role your responsibilities will invo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Los Angeles

Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Los Angeles

MediabistroLos Angeles, CA, United States
serp_jobs.job_card.full_time
Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days