AI Agent Evaluation Analyst
VirtualVocationsBoulder, Colorado, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Boulder, Colorado, United States
Job_description.internal_linking.related_jobs
We are seeking an experienced Associate Director to join our growing AI and Data practice, with a dedicated focus on commercial energy providers.
This individual will be a hands-on leader, responsib...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
R&I Specification Analyst— Plant-Based Beverages.Join Danone’s Research & Innovation team in Louisville, CO to bridge the gap between formulation and manufacturing.As R&I Sp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!.
As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Please submit your resume in English and indicate your level of English.The Toloka Annotators connects individuals with Generative AI projects from leading tech innovators.Our mission is to unlock ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
OUR STORY TechInsights is the information platform for the semiconductor industry.Regarded as the most trusted source of actionable, in-depth intelligence related to semiconductor innovation ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Become a Luxury Brand Evaluator in San Juan, PR - Apply Now.Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Seeking Italian speakers for innovative language research.We're building next-generation AI that truly understands Italian.
Participate in our conversational recording study from the comfort of your...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
The D365 CE / F&O Report Developer is responsible for creating, enhancing, and supporting business intelligence and operational reports across Microsoft Dynamics 365 Finance and Operations (D365 F&O)...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Founded in 2007, Growth Acceleration Partners (GAP) is a consulting and technology services company.We consult, design, build and modernize revenue-generating software and data engineering solution...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
The Squad Lead is responsible for delivering services and solutions to Welocalize customers.The Squad Lead manages or directs a team (i.
These solutions are based on the Welocalize Four Pillars of C...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
We're always looking for talent that believes in having fun.At PENN Entertainment, you'll get to be a part of an exciting industry, where the days and nights are fast paced.You'll work with an incr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
We believe in using the power of collective human intelligence to ethically shape the future of AI.The Mindrift platform, launched and powered by.
AI projects from innovative tech clients.Our missio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Lift Ventures, a remote-first startup studio whose portfolio of businesses has reached over 250 million consumers to date, is seeking an experienced part-time AI Content Specialist to support new p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Are you a mechanical maestro ready to unleash your expertise? At BDC Laboratories, we invite you to immerse yourself in an exhilarating role as a Full-Time Product Evaluations Engineer III onsite i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At SonderMind, we believe everyone deserves one personalized, connected, and effective mental health destination to take care of their mental health and well-being at any stage of life.SonderMind c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Associate Director, AI & Data, Energy Providers (Hiring Immediately)
GuidehouseBOULDER, CO, USserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
R&I Specification Analyst
Cross Resource GroupLouisville, CO, USserp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator Automotive Project - Colorado
CXGLittleton, CO, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Trainer - Freelance Data Annotator
Toloka AnnotatorsCO, USserp_jobs.filters.remote
serp_jobs.job_card.part_time
serp_jobs.filters_job_card.quick_apply
Senior Market Research Analyst - Computing & PC Markets
TechInsightsGreenwood Village, CO, USserp_jobs.job_card.permanent
serp_jobs.filters_job_card.quick_apply
CXG is hiring : Become a Luxury Brand Evaluator in San Juan, PR- Apply Now in Den
MediabistroDenver, CO, United Statesserp_jobs.job_card.full_time
Remote Italian Audio Study – Conversational AI Training Job at Your Personal AI
MediabistroDenver, CO, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Data Analyst and Report Developer
LONG Building TechnologiesLittleton, CO, USserp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator - Denver, CO
CXGLakewood, CO, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Senior Data & AI Engineer
Growth Acceleration PartnersRemote, COserp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
AI Squad Lead
WelocalizeEvergreen, CO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Remote Financial Analyst - AI Trainer
Data AnnotationBoulder, CO, United Statesserp_jobs.job_card.full_time +1
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Denver
MediabistroDenver, CO, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Job Surveillance Agent
PENN EntertainmentBlack Hawk, CO, USserp_jobs.job_card.full_time
- serp_jobs.job_card.new
AI Multimedia Generation Product Evaluator Job at ICONMA in Denver
MediabistroDenver, CO, United Statesserp_jobs.job_card.full_time
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Denver
MediabistroDenver, CO, United Statesserp_jobs.job_card.full_time
Evaluation Scenario Writer - QA
MindriftCO, USserp_jobs.filters.remote
serp_jobs.job_card.part_time +1
serp_jobs.filters_job_card.quick_apply
AI Content Specialist
SuperSummaryUnited States, CO, USserp_jobs.job_card.part_time
Product Evaluations Engineer III
BDC LaboratoriesWheat Ridge, CO, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Staff AI Engineer
SonderMind CareersDenver, CO, USserp_jobs.job_card.full_time