AI Agent Evaluation Analyst
VirtualVocationsHayward, California, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Hayward, California, United States
Job_description.internal_linking.related_jobs
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
The company has developed an artificial intelligence (AI) powered technology stack purpose-built for commercial trucking and the public sector.
The company delivers freight daily for its customers a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
The application window is expected to close on 10 / 25 / 2025.Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.This is a hybrid role w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
We believe in using space to help life on Earth.Planet designs, builds, and operates the largest constellation of imaging satellites in history.
This constellation delivers an unprecedented dataset ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI / ML Engineer (REMOTE).Key Responsibilities Develop, train, evaluate, and deploy machine learning models focused on computer vision and predictive analytics Optimize...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Engineer (FinTech Workflow Automation).Key Responsibilities Design, build, and deploy AI models into production Develop and maintain backend Python services for in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Staff AI & ML Engineer to build and own end-to-end applications across the business.Key Responsibilities Build technical solutions using appropriate frameworks and data...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Content Editor to join their SEO team in a remote, full-time capacity.Key Responsibilities Proofread and fact-check AI-assisted content for accuracy, clarity, and c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationVallejo, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Applied AI Engineer – Generative AI
KodiakSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationBerkeley, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer
Data AnnotationOakley, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Researcher
Cisco Systems, Inc.San Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationLivermore, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationOakley, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Applied AI Engineer, Digital Employee Experience
Planet Labs PBCSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Trainer
VirtualVocationsHayward, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Search Analyst
VirtualVocationsConcord, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Generative AI Specialist
VirtualVocationsFremont, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI / ML Engineer
VirtualVocationsConcord, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Evaluation Analyst
VirtualVocationsHayward, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationConcord, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Engineer
VirtualVocationsFremont, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Staff AI & ML Engineer
VirtualVocationsConcord, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Content Editor
VirtualVocationsConcord, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Agent Evaluation Analyst
VirtualVocationsConcord, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Software Engineer, Perception Evaluation
WaymoMountain View, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Adoption Solutions Architect
VirtualVocationsHayward, California, United Statesserp_jobs.job_card.full_time