AI Evaluation Analyst

VirtualVocationsLakewood, Colorado, United States

job_description.job_card.1_day_ago

serp_jobs.job_preview.job_type

serp_jobs.job_card.full_time

job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Lakewood, Colorado, United States

Job_description.internal_linking.related_jobs

serp_jobs.job_card.promoted

Knowledge & Research Analyst

Taft Stettinius & Hollister LLPDenver, CO, United States

serp_jobs.job_card.full_time

Taft is currently seeking a Knowledge & Research Analyst to join our Knowledge and Research Services Department.Taft Stettinius & Hollister is seeking a full-time Knowledge & Research Analyst with ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30

Senior User Experience Analyst Job at Aditi Consulting in Englewood

MediabistroEnglewood, CO, United States

serp_jobs.job_card.full_time

A senior UX researcher will play a pivotal role in shaping our products and services by uncovering user insights and translating them into actionable recommendations. They will work closely with cro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30

serp_jobs.job_card.promoted

Travel Cath Lab Technologist

Prime Time HealthcareBrighton, CO, US

serp_jobs.job_card.full_time

Prime Time Healthcare is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements. Prime Time Healthcare is a leading provider of traveling he...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30

serp_jobs.job_card.promoted

Remote Financial Analyst - AI Trainer

Data AnnotationWestminster, Colorado

serp_jobs.filters.remote

serp_jobs.job_card.full_time +1

We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30

serp_jobs.job_card.promoted

Remote AI Writing Evaluator

OutlierBoulder, CO, United States

serp_jobs.filters.remote

serp_jobs.job_card.full_time

Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days

serp_jobs.job_card.promoted
serp_jobs.job_card.new

Market Intelligence Data Analyst

VirtualVocationsArvada, Colorado, United States

serp_jobs.job_card.full_time

A company is looking for a Market Intelligence and Data Analyst - Annuities.Key Responsibilities Gather, analyze, model, and present competitive intelligence data to senior management and stakeho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours

serp_jobs.job_card.promoted

Travel CVOR Technologist

RKA RecruitingBrighton, CO, US

serp_jobs.job_card.full_time

RKA Recruiting is seeking a travel CVOR Technologist for a travel job in Brighton, Colorado.Job Description & Requirements. Dedicated and experienced healthcare staffing professionals that put o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days

serp_jobs.job_card.promoted

Travel Cath Lab Technologist

Uniti MedBrighton, CO, US

serp_jobs.job_card.full_time

Uniti Med is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements. Uniti Med is looking for a Travel Cath Lab Tech in Brighton, CO.This as...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30

serp_jobs.job_card.promoted

Remote Senior Financial Analyst - AI Trainer

Data AnnotationWestminster, Colorado

serp_jobs.filters.remote

serp_jobs.job_card.full_time +1

serp_jobs.job_card.promoted

AI Agent Evaluation Analyst

VirtualVocationsLittleton, Colorado, United States

serp_jobs.job_card.full_time

A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day

serp_jobs.job_card.promoted
serp_jobs.job_card.new

AI Trainer

VirtualVocationsLakewood, Colorado, United States

serp_jobs.job_card.full_time

A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours

serp_jobs.job_card.promoted

Travel Invasive Cardiovascular Technologist (Cardiac Cath Lab)

American TravelerBrighton, CO, US

serp_jobs.job_card.full_time

American Traveler is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements. American Traveler is seeking an Invasive Cardiovascular Technol...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days

serp_jobs.job_card.promoted

Travel Cath Lab Technologist

Host HealthcareCastle Rock, CO, US

serp_jobs.job_card.full_time

Host Healthcare is seeking a travel Cath Lab Technologist for a travel job in Castle Rock, Colorado.Job Description & Requirements. Pay package is based on 10 hour shifts and 40 hours per week (...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days

serp_jobs.job_card.promoted

Travel Invasive Cardiovascular Technologist (Cardiac Cath Lab)

Medical SolutionsBrighton, CO, US

serp_jobs.job_card.full_time

Medical Solutions is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements. We’re seeking talented healthcare professionals whose adv...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days

AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Denver

MediabistroDenver, CO, United States

serp_jobs.job_card.full_time

Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging. Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days

serp_jobs.job_card.promoted

Travel Cath Lab Technologist

Health Advocates Network - AlliedBrighton, CO, US

serp_jobs.job_card.full_time

Health Advocates Network - Allied is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements. HANStaff Allied Job ID #476542.Pay package is b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days

serp_jobs.job_card.promoted

Implementation Analyst

KinectiveGolden, CO, US

serp_jobs.job_card.full_time

Ready to be a part of the company transforming FinTech and how the world accesses banking services?.When was the last time you were excited about interacting with your bank or credit union? If the ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30

Product Evaluations Engineer III

BDC LaboratoriesWheat Ridge, CO, USA

serp_jobs.job_card.full_time

serp_jobs.filters_job_card.quick_apply

Are you a mechanical maestro ready to unleash your expertise? At BDC Laboratories, we invite you to immerse yourself in an exhilarating role as a Full-Time Product Evaluations Engineer III onsite i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days

serp_jobs.job_card.promoted

Travel Cath Lab Technologist

Springboard HealthcareBrighton, CO, US

serp_jobs.job_card.full_time

Springboard Healthcare is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements. Springboard Healthcare Job ID #787543.Pay package is based...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30

serp_jobs.job_card.promoted

Travel Cath Lab Technologist

Triage StaffingBrighton, CO, US

serp_jobs.job_card.full_time

Triage Staffing is seeking a travel Cath Lab Technologist for a travel job in Brighton, Colorado.Job Description & Requirements. Travel Radiology : Cath Lab Tech Brighton.Location : &nb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30