AI Evaluation Analyst
VirtualVocationsAlpharetta, Georgia, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Alpharetta, Georgia, United States
Job_description.internal_linking.related_jobs
LRS Healthcare - Allied is seeking a travel MRI Technologist for a travel job in Canton, Georgia.Job Description & Requirements.
LRS Healthcare - Allied Job ID #30I-16909.Pay package is based on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Medical Solutions Allied is seeking a travel CT Technologist for a travel job in Conyers, Georgia.Job Description & Requirements.
We’re seeking talented healthcare professionals whose adve...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for a Market Intelligence and Data Analyst - Annuities.Key Responsibilities Gather, analyze, model, and present competitive intelligence data to senior management and stakeho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Planet Healthcare is seeking a travel MRI Technologist for a travel job in Canton, Georgia.Job Description & Requirements.
Planet Healthcare Job ID #73030131.Pay package is based on 8 hour shift...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Uniti Med is seeking a travel CT Technologist for a travel job in Cumming, Georgia.Job Description & Requirements.Uniti Med is looking for a Travel CT Tech (ARRT, CT) in Cumming, GA.This assign...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Spire is seeking a travel CT Technologist for a travel job in Canton, Georgia.Job Description & Requirements.Facility uses Siemens and Cerner.
F / S / S | 7p-7 : 30a | No Call\n\n\n\n- 2+ years recent...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
LanceSoft is seeking a travel MRI Technologist for a travel job in Canton, Georgia.Job Description & Requirements.Requirements : (No local candidates within 50 miles).
Minimum 2 years of experien...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Skyline Med Staff Allied is seeking a travel MRI Technologist for a travel job in Canton, Georgia.Job Description & Requirements.
Join the Top- Rated Travel Healthcare Team!.Skyline Med Staff wa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 LanceSoft is seeking a travel CT Technologist for a travel job in Canton, Georgia.Job Description & Requirements.Requirements : (No local candidates within 50 miles).
Minimum 2 years of experienc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
TRS Healthcare is seeking a travel CT Technologist for a travel job in Cumming, Georgia.Job Description & Requirements.CT Technologist needed to provide diagnostic imaging services at a VIP Par...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Data Analyst with advanced SQL expertise to support our Data Science and AI initiatives through high-impact analytics and insights.
This role is pivotal in enabling the development of safe, effectiv...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
- serp_jobs.job_card.promoted
Travel MRI Technologist
LRS Healthcare - AlliedCanton, GA, USserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Travel CT Technologist
Medical Solutions AlliedConyers, GA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Investigation Analyst (Atlanta)
Pyramid Consulting, IncAtlanta, GA, United Statesserp_jobs.job_card.temporary
Visual Data Evaluator Job at Firstsource Solutions Ltd in Atlanta
MediabistroAtlanta, GA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.new
Market Intelligence Data Analyst
VirtualVocationsDecatur, Georgia, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel MRI Technologist
Planet HealthcareCanton, GA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Uniti MedCumming, GA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationPeachtree Corners, Georgiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierRoswell, GA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
SpireCanton, GA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel MRI Technologist
LanceSoftCanton, GA, USserp_jobs.job_card.permanent
AI Evaluation Analyst
VirtualVocationsLawrenceville, Georgia, United Statesserp_jobs.job_card.full_time
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Atlanta
MediabistroAtlanta, GA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
AI Trainer
VirtualVocationsAtlanta, Georgia, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel MRI Technologist
Skyline Med Staff AlliedCanton, GA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
LanceSoftCanton, GA, USserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Travel CT Technologist
TRS HealthcareCumming, GA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationSmyrna, Georgiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Sr. Data Analyst, AI
NEXTGEN HealthcareAtlanta, GA, United Statesserp_jobs.job_card.full_time
AI Agent Evaluation Analyst
VirtualVocationsDecatur, Georgia, United Statesserp_jobs.job_card.full_time