Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsPasadena, California, United States
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Pasadena, California, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Deep Learning Software Engineer

Deep Learning Software Engineer

VirtualVocationsBurbank, California, United States
serp_jobs.job_card.full_time
A company is looking for a Deep Learning Software Engineer, Inference and Model Optimization - New College Grad 2025.Key Responsibilities Train, develop, and deploy generative AI models using the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Senior Machine Learning Engineer

Senior Machine Learning Engineer

Capital GroupLos Angeles, CA, United States
serp_jobs.job_card.full_time
I can succeed as a Machine Learning Engineer at Capital Solutions Group Technology (CSGT)".As a Machine Learning Engineer in CSGT, you will design and implement intelligent systems that enhance por...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Solutions Specialist

AI Solutions Specialist

VirtualVocationsHuntington Beach, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Solutions Specialist to drive business innovation through artificial intelligence.Key Responsibilities Analyze complex datasets to uncover trends and actionable ins...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Tech Lead for AI & Data

Tech Lead for AI & Data

VirtualVocationsLong Beach, California, United States
serp_jobs.job_card.full_time
A company is looking for a Tech Lead with AI & Data expertise (Remote, LATAM).Key Responsibilities Lead the technical effort for the Delivery Team, ensuring clarity and confidence with clients an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsTorrance, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Senior AI Consultant

Senior AI Consultant

VirtualVocationsTorrance, California, United States
serp_jobs.job_card.full_time
A company is looking for a Senior Consultant AI.Key Responsibilities Utilize Azure AI Services to build and optimize OpenAI solutions Develop and manage data ingestion and transformation pipelin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Senior Business Intelligence Developer

Senior Business Intelligence Developer

VirtualVocationsGlendale, California, United States
serp_jobs.job_card.full_time
A company is looking for a Senior Business Intelligence Developer - Product & Platform Innovation.Key Responsibilities Collaborate with cross-functional teams to drive data enablement and support...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Analytics Engineer

Analytics Engineer

VirtualVocationsSignal Hill, California, United States
serp_jobs.job_card.full_time
A company is looking for an Analytics Engineer to support their operations team by leveraging data to understand user needs and improve customer experiences. Key Responsibilities Refine data, buil...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Advanced Analytics Expert

Advanced Analytics Expert

VirtualVocationsWhittier, California, United States
serp_jobs.job_card.full_time
A company is looking for an Advanced Analytics Expert to collaborate with teams and utilize advanced analytics for data-driven decision-making. Key Responsibilities Builds advanced analytics solut...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
Cortex XSIAM Engineer

Cortex XSIAM Engineer

VirtualVocationsSignal Hill, California, United States
serp_jobs.job_card.full_time
A company is looking for a Cortex XSIAM Consultant to join a premier cyber security organization remotely.Key Responsibilities Develop log ingestion strategies in collaboration with the technical...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Junior Machine Learning Engineer

Junior Machine Learning Engineer

VirtualVocationsOrange, California, United States
serp_jobs.job_card.full_time
A company is looking for a Junior Machine Learning Engineer to support the design, development, and deployment of machine learning models. Key Responsibilities Support the end-to-end lifecycle of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Epic Certified BI Developer

Epic Certified BI Developer

VirtualVocationsGlendale, California, United States
serp_jobs.job_card.full_time
A company is looking for an IT Data Solutions Developer Associate.Key Responsibilities Analyze, develop, and improve BI solutions to meet business needs Collaborate with operations teams to desi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Senior AI Agent Developer

Senior AI Agent Developer

VirtualVocationsIrvine, California, United States
serp_jobs.job_card.full_time
Key Responsibilities Design, develop, and deploy production-ready AI agents that support critical workflows across the enterprise Rapidly prototype, test, and refine agents to ensure high perfor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Business Intelligence Developer

Business Intelligence Developer

VirtualVocationsSignal Hill, California, United States
serp_jobs.job_card.full_time
A company is looking for a BI Developer to transform data into actionable insights supporting strategic decision-making.Key Responsibilities Design, develop, deploy, and document interactive dash...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Generative AI Scientist

Generative AI Scientist

VirtualVocationsCarson, California, United States
serp_jobs.job_card.full_time
A company is looking for a Generative AI Scientist.Key Responsibilities Deliver solutions to identify payment integrity issues and improve healthcare quality Develop exploratory data analysis ap...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Generative AI Specialist

Generative AI Specialist

VirtualVocationsSignal Hill, California, United States
serp_jobs.job_card.full_time
A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Implementation Specialist

AI Implementation Specialist

VirtualVocationsBurbank, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Implementation Specialist for Automated Portfolio Analysis and Reporting.Key Responsibilities Develop a GUI-based prototype for AI-powered document analysis and vis...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior Analytics Engineer

Senior Analytics Engineer

VirtualVocationsSignal Hill, California, United States
serp_jobs.job_card.full_time
A company is looking for a Senior Analytics Engineer.Key Responsibilities Design and maintain data models and transformation logic for analytics and reporting Own the semantic layer, managing sh...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30