AI Agent Evaluation Analyst
VirtualVocationsDayton, Ohio, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Dayton, Ohio, United States
Job_description.internal_linking.related_jobs
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
This is a hybrid position, which will require working from our Dayton, Ohio office every Monday and Tuesday.Are you a customer-centric and data-driven individual? Are you a strategic planner and pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Location : CINCINNATI SERVICE CENTER, MASON OH, 45040 (Hybrid (in office 2 days a week : Tuesday & Wednesday).Temporary 6 to 9 months (could turn into perm in 2026 potentially).Data analyst will...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Job Description – Statistical Quality Engineer.We are seeking a highly analytical and detail-oriented.This role is focused on using data to identify waste, perform capability studies, and sup...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Taft is seeking an eDiscovery Analyst to serve our eDiscovery Services team in Taft's Chicago, Cincinnati, Cleveland, Columbus, Dayton, Denver, Detroit, Indianapolis or Minneapolis office.We are se...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Make an impact in the role of Netflix Data Analyst to analyze viewer data to guide content decisions.Ensure all safety and quality standards are met.
Work closely with your team to maintain high per...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Job Title : Independent Medical Evaluators - Occupational Medicine, Physical Medicine & Rehab, Orthopedists, Psychologists, Psychiatrists.
Location : Ohio (Southern Ohio Preferred) Company Overview : M...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Phalanx Griffon (PG) is the Air Force’s next‑gen airborne node connecting warfighters to decision‑quality data across the DAF BATTLE NETWORK.
Major Release 2 (FY 25‑27).In...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Job Title : Independent Medical Evaluators - Occupational Medicine, Physical Medicine & Rehab, Orthopedists, Psychologists, Psychiatrists.
Location : Ohio (Southern Ohio Preferred)Company Overview : MRG...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
From building digital engineering tools that make space exploration safer to verifying cryptographic libraries that protect some of the world’s most valuable data, Galois develops technology to gua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a Digital Marketer to join our team to train AI models.You will measure the progress of AI chatbots, evaluate their logic, and solve problems to improve the quality of each model...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Spiraledge is a collection of companies focused on health and wellness and a leading U.Spiraledge operates through two primary online stores SwimOutlet.
We have offices in Boston, Massachusetts, Wes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Data Analyst needs 3+ years experience in Operations in the Healthcare industry.Experience understanding claim adjudication for member and provider reimbursements.
Experience with Facets platform us...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Quality Analyst - Miamisburg, OH.Our organization works with partner companies to source qualified talent for their open roles.
The following position is available to Veterans, Transitioning Militar...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationFairfield, Ohioserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Segment Analyst
RELXDayton, OH, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationMiddletown, Ohioserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Data Analyst
Objectwin Technology Inc.Mason, Ohio, United Statesserp_jobs.job_card.temporary
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Statistical Quality Engineer
Precision ImpactsMiamisburg, OH, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
eDiscovery Analyst
Taft Stettinius & Hollister LLPDayton, OH, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Netflix Data Analyst
TradeJobsWorkforce45431 Beavercreek, OH, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationMiddletown, Ohioserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Independent Medical Evaluator
MRG ExamsHarrison, OH, United Statesserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationKettering, Ohioserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Freelance Market Research Analyst (Hiring Immediately)
Earn HausWaynesville, Ohio, USserp_jobs.job_card.full_time +2
- serp_jobs.job_card.promoted
Senior Test Engineer Analyst
DCS CorpDayton, OH, USserp_jobs.job_card.temporary
- serp_jobs.job_card.promoted
Independent Medical Evaluator
NoneHarrison, OH, United Statesserp_jobs.job_card.permanent
Research Engineer
Galois, Inc.Dayton, OH, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Digital Marketer Job at DataAnnotation in Wyoming
MediabistroWyoming, OH, United Statesserp_jobs.job_card.full_time +1
Become a Luxury Brand Evaluator in Central & Southern Ohio - Apply Now
CXGDayton, OH, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Freelance Luxury Brand Evaluator - Cincinnati, OH
CXGMason, OH, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Planning Analyst
Spiraledge, IncWest Chester, Ohio, United States, 45011serp_jobs.job_card.full_time
Healthcare Data Analyst
GlobalchannelmanagementMason, Ohio, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Quality Analyst - Miamisburg, OH
VetJobsMiamisburg, OH, USserp_jobs.job_card.full_time