Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsRedding, California, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Redding, California, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
CRNA - Anesthesiology job available in Red Bluff, California

CRNA - Anesthesiology job available in Red Bluff, California

VituityRed Bluff, CA, US
serp_jobs.job_card.full_time +1
Up to 50K Sign On Bonus – Red Bluff, CA – Seeking CRNAs.Become a Valued Member of Your Anesthesia Team.As a CRNA, you play a critical role in our mission to improve lives in Anesthesiol...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Generative AI Specialist

Generative AI Specialist

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Data Analyst 2

Data Analyst 2

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Data Analyst 2 to work remotely.Key Responsibilities Assist in designing and implementing analytics platform components using Microsoft Azure, Databricks, and PowerBI ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Data Scientist, AI Healthcare

Data Scientist, AI Healthcare

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Data Scientist, Care Intelligence (All Levels).Key Responsibilities Become an expert in the business model and patient experience to identify AI product development opp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst

Search Analyst

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Director of Applied AI

Director of Applied AI

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Director of Applied AI.Key Responsibilities Lead the strategy and execution of applied AI initiatives across the organization Develop training programs to enhance AI f...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Prototype Specialist

AI Prototype Specialist

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationRedding, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Adoption Solutions Architect

AI Adoption Solutions Architect

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Trainer

AI Trainer

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationRedding, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationRedding, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationRedding, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Quality Vendor Economics Analyst

Quality Vendor Economics Analyst

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Quality Vendor Economics Analyst III.Key Responsibilities Assess financial opportunities related to new and existing Quality vendor contracts Document vendor processes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Product Analyst

Product Analyst

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Data Analyst

Data Analyst

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Data Analyst to support its growth and drive insights through data analytics.Key Responsibilities Own the end-to-end analytics process from data collection to visualiza...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst, SEO & SEM

Search Analyst, SEO & SEM

VirtualVocationsRedding, California, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst, SEO & SEM.Key Responsibilities Assist in planning, executing, optimizing, and reporting on paid search campaigns Conduct keyword research, manage copy ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour