Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsOceanside, California, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Oceanside, California, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Adoption Solutions Architect

AI Adoption Solutions Architect

VirtualVocationsEscondido, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Data Scientist, AI Healthcare

Data Scientist, AI Healthcare

VirtualVocationsIrvine, California, United States
serp_jobs.job_card.full_time
A company is looking for a Data Scientist, Care Intelligence (All Levels).Key Responsibilities Become an expert in the business model and patient experience to identify AI product development opp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Biology Tutors Jobs

Biology Tutors Jobs

Tutor MapTemecula, California, US
serp_jobs.job_card.full_time
Tutor Map are offering new tuition and teaching positions in Temecula.We are seeking Biology tutors and teachers in Temecula. You can register for free, we take zero commission.Tutor Map is the larg...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Engineer

AI Engineer

VirtualVocationsEscondido, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Engineer (FinTech Workflow Automation).Key Responsibilities Design, build, and deploy AI models into production Develop and maintain backend Python services for in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationOceanside, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Content Editor

AI Content Editor

VirtualVocationsMission Viejo, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Content Editor to join their SEO team in a remote, full-time capacity.Key Responsibilities Proofread and fact-check AI-assisted content for accuracy, clarity, and c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Data Analyst 2

Data Analyst 2

VirtualVocationsOceanside, California, United States
serp_jobs.job_card.full_time
A company is looking for a Data Analyst 2 to work remotely.Key Responsibilities Assist in designing and implementing analytics platform components using Microsoft Azure, Databricks, and PowerBI ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsMission Viejo, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationPoway, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationPerris, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationSan Clemente, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Generative AI Specialist

Generative AI Specialist

VirtualVocationsEscondido, California, United States
serp_jobs.job_card.full_time
A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI / ML Engineer

AI / ML Engineer

VirtualVocationsMission Viejo, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI / ML Engineer (REMOTE).Key Responsibilities Develop, train, evaluate, and deploy machine learning models focused on computer vision and predictive analytics Optimize...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsOceanside, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationSan Marcos, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationSan Marcos, California
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst

Search Analyst

VirtualVocationsEscondido, California, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Staff AI & ML Engineer

Staff AI & ML Engineer

VirtualVocationsOceanside, California, United States
serp_jobs.job_card.full_time
A company is looking for a Staff AI & ML Engineer to build and own end-to-end applications across the business.Key Responsibilities Build technical solutions using appropriate frameworks and data...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Product Analyst

Product Analyst

VirtualVocationsEscondido, California, United States
serp_jobs.job_card.full_time
A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Prototype Specialist

AI Prototype Specialist

VirtualVocationsIrvine, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours