Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsDayton, Ohio, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Dayton, Ohio, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Segment Analyst

Segment Analyst

RELXDayton, OH, US
serp_jobs.job_card.full_time
This is a hybrid position, which will require working from our Dayton, Ohio office every Monday and Tuesday.Are you a customer-centric and data-driven individual? Are you a strategic planner and pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Research Support Coordinator

Research Support Coordinator

SierTeK Ltd.Wright-Patterson AFB, OH, USA
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
SierTeK proudly serves our clients by providing expertise in the Program Management, Information Technology, and Administrative Support domains. Founded in 2007 as a minority and service-disabled ve...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Data Analyst

Data Analyst

Objectwin Technology Inc.Mason, Ohio, United States
serp_jobs.job_card.temporary
serp_jobs.filters_job_card.quick_apply
Location : CINCINNATI SERVICE CENTER, MASON OH, 45040 (Hybrid (in office 2 days a week : Tuesday & Wednesday).Temporary 6 to 9 months (could turn into perm in 2026 potentially).Data analyst will...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Compliance Analyst

Compliance Analyst

Dayton FreightDayton, OH, US
serp_jobs.job_card.full_time
As a Compliance Analyst, you will maintain, monitor and report data from the Company's Safety systems.Monitoring Safety systems for critical and time sensitive information.Managing the flow of conf...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Revenue Management Analyst

Revenue Management Analyst

Clopay CorporationMason, OH, US
serp_jobs.job_card.full_time +1
Professional who uses data analysis to determine the optimal price for Clopay products by researching previous sales trends, competitor pricing, market trends and consumer behavior, ultimately aimi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Writing Tutor Job at DataAnnotation in Wyoming

Writing Tutor Job at DataAnnotation in Wyoming

MediabistroWyoming, OH, United States
serp_jobs.job_card.full_time +1
We are looking for a Writing Tutor to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each mo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationHamilton, OH, United States
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Independent Medical Evaluator

Independent Medical Evaluator

MRG ExamsWest Chester, OH, United States
serp_jobs.job_card.permanent
Job Title : Independent Medical Evaluators - Occupational Medicine, Physical Medicine & Rehab, Orthopedists, Psychologists, Psychiatrists. Location : Ohio (Southern Ohio Preferred).MRG Exams is a lead...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Netflix Data Analyst

Netflix Data Analyst

TradeJobsWorkforce45431 Beavercreek, OH, US
serp_jobs.job_card.full_time
Make an impact in the role of Netflix Data Analyst to analyze viewer data to guide content decisions.Ensure all safety and quality standards are met. Work closely with your team to maintain high per...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Category Analyst (CPG)

Category Analyst (CPG)

AcostaOxford, OH, US
serp_jobs.job_card.full_time
Acosta Category Management Analyst.This position is open to candidates located within a two-hour drive of Cincinnati, Ohio. You will be expected to travel to the Cincinnati office for monthly in-per...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Freelance Luxury Brand Evaluator - Cincinnati, OH

Freelance Luxury Brand Evaluator - Cincinnati, OH

CXGKenwood, OH, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationDayton, OH, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour
  • serp_jobs.job_card.promoted
Independent Medical Evaluator

Independent Medical Evaluator

NoneHarrison, OH, United States
serp_jobs.job_card.permanent
Job Title : Independent Medical Evaluators - Occupational Medicine, Physical Medicine & Rehab, Orthopedists, Psychologists, Psychiatrists. Location : Ohio (Southern Ohio Preferred)Company Overview : MRG...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Analyst - Earn Up to $37 / hr

Analyst - Earn Up to $37 / hr

TradeJobsWorkforce45431 Beavercreek, OH, US
serp_jobs.job_card.full_time
ESSENTIAL JOB FUNCTIONS Analyzes global markets for IT Services, servers, storage, backup, IT security, productivity software, remote monitoring services, hyperconvergence and IoT.Studies SMB and m...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Target Digital Network Analyst 3 (Ohio)

Target Digital Network Analyst 3 (Ohio)

Prime Time Consulting, L.L.CWright-Patterson Air Force Base, Ohio, United States, 45433
serp_jobs.job_card.full_time
Prime Time Consulting provides clients with expert intelligence analysis services.Our clients include defense contractors, industrial and service corporations, and departments and agencies of the U...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Research Engineer

Research Engineer

Galois, Inc.Dayton, OH, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
From building digital engineering tools that make space exploration safer to verifying cryptographic libraries that protect some of the world’s most valuable data, Galois develops technology to gua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Digital Marketer Job at DataAnnotation in Wyoming

Digital Marketer Job at DataAnnotation in Wyoming

MediabistroWyoming, OH, United States
serp_jobs.job_card.full_time +1
We are looking for a Digital Marketer to join our team to train AI models.You will measure the progress of AI chatbots, evaluate their logic, and solve problems to improve the quality of each model...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Become a Luxury Brand Evaluator in Central & Southern Ohio - Apply Now

Become a Luxury Brand Evaluator in Central & Southern Ohio - Apply Now

CXGDayton, OH, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Healthcare Data Analyst

Healthcare Data Analyst

GlobalchannelmanagementMason, Ohio, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Data Analyst needs 3+ years experience in Operations in the Healthcare industry.Experience understanding claim adjudication for member and provider reimbursements. Experience with Facets platform us...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Planning Analyst

Planning Analyst

Spiraledge, IncWest Chester, Ohio, United States, 45011
serp_jobs.job_card.full_time
Spiraledge is a collection of companies focused on health and wellness and a leading U.Spiraledge operates through two primary online stores SwimOutlet. We have offices in Boston, Massachusetts, Wes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30