AI Evaluation Analyst
VirtualVocationsSan Francisco, California, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • San Francisco, California, United States
Job_description.internal_linking.related_jobs A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Competitive Intelligence Analyst.Cooley is seeking a Competitive Intelligence Analyst to join the Data Delivery team.Cooley Innovation embraces a culture of customer service excellence and all memb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Applied AI company on a mission to automate sales, marketing, and customer success for B2B companies.We build the most complete and accurate picture of the B2B buyer.
We use this data to power appli...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
The application window is expected to close on 10 / 25 / 2025.Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.This is a hybrid role w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We believe in using space to help life on Earth.Planet designs, builds, and operates the largest constellation of imaging satellites in history.
This constellation delivers an unprecedented dataset ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for a Market Intelligence and Data Analyst - Annuities.Key Responsibilities Gather, analyze, model, and present competitive intelligence data to senior management and stakeho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less 
Demonstrates good judgment in selecting methods and techniques for obtaining solutions.The Bodansky and DeRisi laboratories at the University of California at San Francisco are seeking a Research D...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Demonstrates good judgment in selecting methods and techniques for obtaining solutions.The Bodansky and DeRisi laboratories at the University of California at San Francisco are seeking a Research D...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
At Schwab, you will build a rewarding career while making a difference in the lives of our millions of clients.Here, innovative thinking meets creative problem solving as we work together to challe...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
At the University of California, Berkeley, we are dedicated to fostering a community where everyone feels welcome and can thrive.
Our culture of openness, freedom and belonging make it a special pla...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At Parafin, we’re on a mission to grow small businesses.Small businesses are the backbone of our economy, but traditional banks often don’t have their backs.
We build tech that makes it simple for s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast.Backed by top investors including IVP, Spark Capital, Greylock, and Conviction, we’re ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
As a member of our Frontier Tech Consultant team, you will play a critical role in advancing cutting-edge AI innovations by conducting high-impact experiments and ensuring seamless execution at the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Job Description : We are seeking a Program Manager to take end-to-end ownership of the Tech Impact Awards Program, a high-visibility recognition initiative celebrating the organization's most impact...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsOakland, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Competitive Intelligence Analyst
Cooley LLPSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in San Jose
MediabistroSan Jose, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Analyst
HockeyStack, Inc.San Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Researcher
Cisco Systems, Inc.San Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied AI Engineer, Digital Employee Experience
Planet Labs PBCSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Market Intelligence Data Analyst
VirtualVocationsOakland, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Research Data Analyst
University of California - San Francisco Campus and HealthSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Research Data Analyst
University of California - San FranciscoSan Francisco, CA, United Statesserp_jobs.job_card.full_time
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in San Francisc
MediabistroSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Researcher
Charles SchwabSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in San Francisco
MediabistroSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Evaluation Analyst
VirtualVocationsHayward, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Research Data Analyst (6256U), Haas School of Business - #81170
University of California-BerkeleyBerkeley, CA, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Applied AI Engineer
Parafin Inc.San Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied AI Inference Engineer
BasetenSan Francisco, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Strategy Consultant, Frontier Tech
Scale AI, Inc.San Francisco, CA, United Statesserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Recognition Programs & AI Workforce Trends PgM
US Tech SolutionsMountain View, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Agent Evaluation Analyst
VirtualVocationsHayward, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Software Engineer, Perception Evaluation
WaymoMountain View, CA, United Statesserp_jobs.job_card.full_time