AI Evaluation Analyst
VirtualVocationsDayton, Ohio, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Dayton, Ohio, United States
Job_description.internal_linking.related_jobs
This is a hybrid position, which will require working from our Dayton, Ohio office every Monday and Tuesday.Are you a customer-centric and data-driven individual? Are you a strategic planner and pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Avery Dennison Identification Solutions group is seeking a Quality Analyst to join their Miamisburg Team! The Quality Analyst is responsible for the administration, troubleshooting, and improvement...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Location : CINCINNATI SERVICE CENTER, MASON OH, 45040 (Hybrid (in office 2 days a week : Tuesday & Wednesday).Temporary 6 to 9 months (could turn into perm in 2026 potentially).Data analyst will...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
As a Compliance Analyst, you will maintain, monitor and report data from the Company's Safety systems.Monitoring Safety systems for critical and time sensitive information.Managing the flow of conf...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Job Description – Statistical Quality Engineer.We are seeking a highly analytical and detail-oriented.This role is focused on using data to identify waste, perform capability studies, and sup...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Make an impact in the role of Netflix Data Analyst to analyze viewer data to guide content decisions.Ensure all safety and quality standards are met.
Work closely with your team to maintain high per...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Job Title : Independent Medical Evaluators - Occupational Medicine, Physical Medicine & Rehab, Orthopedists, Psychologists, Psychiatrists.
Location : Ohio (Southern Ohio Preferred) Company Overview : ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less
Job Title : Independent Medical Evaluators - Occupational Medicine, Physical Medicine & Rehab, Orthopedists, Psychologists, Psychiatrists.
Location : Ohio (Southern Ohio Preferred) Company Overview : M...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Job Title : Independent Medical Evaluators - Occupational Medicine, Physical Medicine & Rehab, Orthopedists, Psychologists, Psychiatrists.
Location : Ohio (Southern Ohio Preferred)Company Overview : MRG...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
From building digital engineering tools that make space exploration safer to verifying cryptographic libraries that protect some of the world’s most valuable data, Galois develops technology to gua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a Digital Marketer to join our team to train AI models.You will measure the progress of AI chatbots, evaluate their logic, and solve problems to improve the quality of each model...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Data Analyst needs 3+ years experience in Operations in the Healthcare industry.Experience understanding claim adjudication for member and provider reimbursements.
Experience with Facets platform us...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Spiraledge is a collection of companies focused on health and wellness and a leading U.Spiraledge operates through two primary online stores SwimOutlet.
We have offices in Boston, Massachusetts, Wes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Quality Analyst - Miamisburg, OH.Our organization works with partner companies to source qualified talent for their open roles.
The following position is available to Veterans, Transitioning Militar...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Segment Analyst
RELXDayton, OH, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationHamilton, Ohioserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Quality Analyst
Avery DennisonMiamisburg, OH, USserp_jobs.job_card.full_time
Data Analyst
Objectwin Technology Inc.Mason, Ohio, United Statesserp_jobs.job_card.temporary
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Compliance Analyst
Dayton FreightDayton, OH, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Statistical Quality Engineer
Precision ImpactsMiamisburg, OH, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Netflix Data Analyst
TradeJobsWorkforce45431 Beavercreek, OH, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
▷ Apply Now! Independent Medical Evaluator...
MRG ExamsHarrison, Ohio, USserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Independent Medical Evaluator
MRG ExamsHarrison, OH, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationFairfield, Ohioserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationHamilton, Ohioserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Freelance Luxury Brand Evaluator - Cincinnati, OH
CXGKenwood, OH, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Independent Medical Evaluator
NoneHarrison, OH, United Statesserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationHuber Heights, Ohioserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Research Engineer
Galois, Inc.Dayton, OH, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Digital Marketer Job at DataAnnotation in Wyoming
MediabistroWyoming, OH, United Statesserp_jobs.job_card.full_time +1
Become a Luxury Brand Evaluator in Central & Southern Ohio - Apply Now
CXGDayton, OH, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Healthcare Data Analyst
GlobalchannelmanagementMason, Ohio, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Planning Analyst
Spiraledge, IncWest Chester, Ohio, United States, 45011serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Quality Analyst - Miamisburg, OH
VetJobsMiamisburg, OH, USserp_jobs.job_card.full_time