Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsDenver, Colorado, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Denver, Colorado, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Knowledge & Research Analyst

Knowledge & Research Analyst

Taft Stettinius & Hollister LLPDenver, CO, United States
serp_jobs.job_card.full_time
Taft is currently seeking a Knowledge & Research Analyst to join our Knowledge and Research Services Department.Taft Stettinius & Hollister is seeking a full-time Knowledge & Research Analyst with ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Associate Director, AI & Data, Energy Providers (Hiring Immediately)

Associate Director, AI & Data, Energy Providers (Hiring Immediately)

GuidehouseBOULDER, CO, US
serp_jobs.job_card.part_time
We are seeking an experienced Associate Director to join our growing AI and Data practice, with a dedicated focus on commercial energy providers. This individual will be a hands-on leader, responsib...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
eDiscovery Analyst

eDiscovery Analyst

Taft Stettinius & Hollister LLPDenver, CO, United States
serp_jobs.job_card.full_time
Taft is seeking an eDiscovery Analyst to serve our eDiscovery Services team in Taft's Chicago, Cincinnati, Cleveland, Columbus, Dayton, Denver, Detroit, Indianapolis or Minneapolis office.We are se...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationAurora, Colorado
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Freelance Luxury Brand Evaluator Automotive Project - Colorado

Freelance Luxury Brand Evaluator Automotive Project - Colorado

CXGLittleton, CO, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!. As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Senior Market Research Analyst - Computing & PC Markets

Senior Market Research Analyst - Computing & PC Markets

TechInsightsGreenwood Village, CO, US
serp_jobs.job_card.permanent
serp_jobs.filters_job_card.quick_apply
OUR STORY TechInsights is the information platform for the semiconductor industry.Regarded as the most trusted source of actionable, in-depth intelligence related to semiconductor innovation ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationWestminster, Colorado
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
CXG is hiring : Become a Luxury Brand Evaluator in San Juan, PR- Apply Now in Den

CXG is hiring : Become a Luxury Brand Evaluator in San Juan, PR- Apply Now in Den

MediabistroDenver, CO, United States
serp_jobs.job_card.full_time
Become a Luxury Brand Evaluator in San Juan, PR - Apply Now.Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Product & AI Innovation Lead

Product & AI Innovation Lead

American Financing CorpAurora, CO, US
serp_jobs.job_card.full_time
Compensation : $200 - 250K annually.At American Financing, we're innovators with imagination.We do what it takes to help customers achieve their financial goals. And we stay ahead of the competit...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Remote Italian Audio Study – Conversational AI Training Job at Your Personal AI

Remote Italian Audio Study – Conversational AI Training Job at Your Personal AI

MediabistroDenver, CO, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Seeking Italian speakers for innovative language research.We're building next-generation AI that truly understands Italian. Participate in our conversational recording study from the comfort of your...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Freelance Luxury Brand Evaluator - Denver, CO

Freelance Luxury Brand Evaluator - Denver, CO

CXGLakewood, CO, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Squad Lead

AI Squad Lead

WelocalizeEvergreen, CO, US
serp_jobs.job_card.full_time
The Squad Lead is responsible for delivering services and solutions to Welocalize customers.The Squad Lead manages or directs a team (i. These solutions are based on the Welocalize Four Pillars of C...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Denver

Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Denver

MediabistroDenver, CO, United States
serp_jobs.job_card.full_time
Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Job Surveillance Agent

Job Surveillance Agent

PENN EntertainmentBlack Hawk, CO, US
serp_jobs.job_card.full_time
We're always looking for talent that believes in having fun.At PENN Entertainment, you'll get to be a part of an exciting industry, where the days and nights are fast paced.You'll work with an incr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Compliance Analyst, Responsible Gaming

Compliance Analyst, Responsible Gaming

BetMGMDenver, CO, United States
serp_jobs.job_card.full_time
We are revolutionizing sports betting and online gaming in the United States.We are a partnership between two powerhouse organizations-MGM Resorts International and Entain Group.You know our name t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationCommerce City, Colorado
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Denver

AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Denver

MediabistroDenver, CO, United States
serp_jobs.job_card.full_time
Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging. Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Staff Software Engineer - AI Developer Experience

Staff Software Engineer - AI Developer Experience

The Trade DeskDenver, CO, United States
serp_jobs.job_card.full_time
The Trade Desk is a global technology company with a mission to create a better, more open internet for everyone through principled, intelligent advertising. Handling over 1 trillion queries per day...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationWestminster, Colorado
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Product Evaluations Engineer III

Product Evaluations Engineer III

BDC LaboratoriesWheat Ridge, CO, USA
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Are you a mechanical maestro ready to unleash your expertise? At BDC Laboratories, we invite you to immerse yourself in an exhilarating role as a Full-Time Product Evaluations Engineer III onsite i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days