Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsLong Beach, California, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Long Beach, California, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND CorporationSanta Monica, CA, United States
serp_jobs.job_card.temporary
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Project Manager

AI Project Manager

E-SolutionsTorrance, CA, US
serp_jobs.job_card.full_time
About the client : Our client is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, acce.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Research Data Analyst 3

Research Data Analyst 3

University of California - Los Angeles (UCLA)Los Angeles, CA, United States
serp_jobs.job_card.full_time
The California Policy Lab is seeking an experienced Data Analyst with a background or interest in labor economics and policy to contribute to our organization's proven track record bridging the gap...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationPico Rivera, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Intelligence Analyst

Intelligence Analyst

SpaceXInglewood, CA, US
serp_jobs.job_card.permanent
SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technolo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Technical Research Associate - AI

Technical Research Associate - AI

Keywords StudiosLos Angeles, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
USA Remote (Prefer PST Time Zone).The Technical Research Associate is a non-traditional role in which you will work on our AI data collection team. You have a background in QA or data analysis and a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Quantitative Analyst - Applied Quantitative Solutions (ML-AI)

Quantitative Analyst - Applied Quantitative Solutions (ML-AI)

Capital GroupLos Angeles, CA, United States
serp_jobs.job_card.full_time
I can succeed as a Quantitative Analyst at Capital Group".As a member of the Quantitative Research and Analytics group (QRA) at Capital Group (CG), you conduct rigorous peer-reviewed quantitative r...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Los Angeles

AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Los Angeles

MediabistroLos Angeles, CA, United States
serp_jobs.job_card.full_time
Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging. Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationLa Habra, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles

Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles

MediabistroLos Angeles, CA, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Sr. Business Intelligence Analyst

Sr. Business Intelligence Analyst

Cathay Bank - HeadquartersRosemead, CA, United States
serp_jobs.job_card.full_time
Are you enthusiastic, highly motivated, and have a strong work ethic? If yes, come join our team! At Cathay Bank - we strive to provide a caring culture that supports your aspirations and success....serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Become a Luxury Brand Evaluator in Los Angeles, CA- Apply Now

Become a Luxury Brand Evaluator in Los Angeles, CA- Apply Now

CXGWest Hollywood, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Research Data Analyst 3

Research Data Analyst 3

InsideHigherEdLos Angeles, California, United States
serp_jobs.job_card.full_time
About the California Policy LabThe California Policy Lab generates research insights for government impact.Through hands-on partnerships with government agencies, CPL performs rigorous research acr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Reforge is hiring : AI Content Marketer in Los Angeles

Reforge is hiring : AI Content Marketer in Los Angeles

MediabistroLos Angeles, CA, United States
serp_jobs.job_card.full_time
Reforge is evolving to empower product teams beyond education.Alongside expert training, we now offer AI-powered tools designed to help teams ship high-quality software faster.Our operating values ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Become a Luxury Brand Evaluator in Santa Monica, CA - Apply Now

Become a Luxury Brand Evaluator in Santa Monica, CA - Apply Now

CXGMalibu, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Los Angeles

Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Los Angeles

MediabistroLos Angeles, CA, United States
serp_jobs.job_card.full_time
Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Staff AI / ML Engineer

Staff AI / ML Engineer

Cairns HealthLos Angeles, CA, US
serp_jobs.job_card.full_time
We are seeking a highly skilled AI / ML Engineer to join our team, focusing on the development of cutting-edge radar-based systems for vital signs inference and contextual activity tracking (e.This r...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationHuntington Beach, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Staff AI / ML Engineer (Los Angeles)

Staff AI / ML Engineer (Los Angeles)

Cairns HealthLos Angeles, CA, US
serp_jobs.job_card.part_time
We are seeking a highly skilled AI / ML Engineer to join our team, focusing on the development of cutting-edge radar-based systems for vital signs inference and contextual activity tracking (e.This r...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Freelance Luxury Brand Evaluator Automotive Project - Greater Los Angeles

Freelance Luxury Brand Evaluator Automotive Project - Greater Los Angeles

CXGHawthorne, CA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!. As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days