Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsRochester, New York, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Rochester, New York, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationRochester, New York
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationRochester, New York
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Product Analyst

Product Analyst

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Data Analyst 2

Data Analyst 2

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for a Data Analyst 2 to work remotely.Key Responsibilities Assist in designing and implementing analytics platform components using Microsoft Azure, Databricks, and PowerBI ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Travel CT Tech - $1,663 to $1,859 per week in Gainesville, CT

Travel CT Tech - $1,663 to $1,859 per week in Gainesville, CT

AlliedTravelCareersGainesville, CT, US
serp_jobs.job_card.full_time
AlliedTravelCareers is working with Prime Time Healthcare to find a qualified CT Tech in Gainesville, Connecticut!.Now Hiring : Allied Healthcare CT - Gainesville, Florida.Contact us for Pay Informa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Content Editor

AI Content Editor

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for an AI Content Editor to join their SEO team in a remote, full-time capacity.Key Responsibilities Proofread and fact-check AI-assisted content for accuracy, clarity, and c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationRochester, New York
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Lead, Pre-Sales Systems Engineer

Lead, Pre-Sales Systems Engineer

L3Harris TechnologiesPULTNEYVILLE, New York, United States
serp_jobs.job_card.full_time
L3Harris is dedicated to recruiting and developing high-performing talent who are passionate about what they do.Our employees are unified in a shared dedication to our customers’ mission and quest ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
Scientist, Advanced Concept Systems Engineer 1

Scientist, Advanced Concept Systems Engineer 1

L3Harris TechnologiesWEBSTER, New York, United States
serp_jobs.job_card.full_time
L3Harris is dedicated to recruiting and developing high-performing talent who are passionate about what they do.Our employees are unified in a shared dedication to our customers’ mission and quest ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Sustaining Engineer Principal

AI Sustaining Engineer Principal

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for a Principal AI Sustaining Engineer for its AI Center of Excellence, working remotely.Key Responsibilities Represent expertise in AI and Machine Learning solutions to supp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Adoption Solutions Architect

AI Adoption Solutions Architect

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Architect

AI Architect

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for an AI Architect to design and implement advanced AI solutions for clients.Key Responsibilities Design end-to-end AI architectures, including data pipelines and model depl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Engineer

AI Engineer

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for an AI Engineer (FinTech Workflow Automation).Key Responsibilities Design, build, and deploy AI models into production Develop and maintain backend Python services for in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI / ML Engineer

AI / ML Engineer

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for an AI / ML Engineer (REMOTE).Key Responsibilities Develop, train, evaluate, and deploy machine learning models focused on computer vision and predictive analytics Optimize...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst

Search Analyst

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Prototype Specialist

AI Prototype Specialist

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst, SEO & SEM

Search Analyst, SEO & SEM

VirtualVocationsRochester, New York, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst, SEO & SEM.Key Responsibilities Assist in planning, executing, optimizing, and reporting on paid search campaigns Conduct keyword research, manage copy ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less