AI Evaluation Analyst
VirtualVocationsMurfreesboro, Tennessee, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Murfreesboro, Tennessee, United States
Job_description.internal_linking.related_jobs
VALUE-BASED PURCHASING RESEARCH AND DATA ANALYST.Long Term Services & Support (LTSS).Salary : Minimum Monthly Salary $5,050 / month TennCare compensation is equitable and will be based on education an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Focus on the core content of the job post, removing all extra metadata, navigation, and redundant headers.The job title and description are the main focus, presented in a clean and beautiful format.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
You're a collaborative professional, driven by the potential to make a meaningful impact in healthcare.The challenges of healthcare don't deter you—instead, you see them as opportunit...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Career Fulfillment & Culture People come to work for Deque because of what we do : .The personal fulfillment employees feel here is unparalleled.
In addition to the altruistic nature of our jobs, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Overview Our UX Research team is designing for the broad spectrum of human needs, which requires us to understand the behaviors of the people behind them.
Our researchers tackle some of the most com...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Dean's Professional Services is actively seeking a detail-oriented.The ideal candidate will serve as a subject matter expert for HOME and the Roster, providing technical and operational support...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Job Summary : The Procurement Data Analyst will be a key member of the newly formed Corporate Procurement team at Helix Traffic Solutions, supporting the company's transformation towards a centrali...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Responsibilities : Conducts unapplied cash research by validating customer payment history.Communicates effectively with customers (via email and phone) to achieve resolution of unapplied cash withi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Details Department : Ascension Studio Schedule : Full-time Location : Fully Remote Benefits Paid time off (PTO) Various health insurance options & wellness plans Retirement benefits including employer...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Artificial Intelligence Engineer.This person delivers AI, Gen-AI and machine learning software solutions with high customer impact.
Performs R&D, architecture, and development activities with a spec...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Join a high-performing team that is going for a home run!.Business Intelligence Analyst will be responsible for delivering data-driven insights through enterprise reporting and visualization.This r...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
VALUE-BASED PURCHASING RESEARCH AND DATA ANALYST - 71243
State of TennesseeNashville, TN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Intelligence Analyst
SecuritasNashville, TN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Risk Adjustment Data Analyst
Honest HealthNashville, TN, USserp_jobs.job_card.full_time
AI Engineer
Deque SystemsNashville, TN, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
UX Researcher, Quantitative Job at Meta in Nashville
MediabistroNashville, TN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationBrentwood, Tennesseeserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.new
AI Multimedia Generation Product Evaluator Job at ICONMA in Nashville
MediabistroNashville, TN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Associate Information Analyst (Onsite)
Dean's Professional ServicesNashville, TN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Procurement Data Analyst
Helix Traffic Solutions, LLCMurfreesboro, TN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierRemote, TN, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationSmyrna, Tennesseeserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
English Writing and Content Reviewing Expertise Sought for AI Training
OutlierMurfreesboro, TN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AR Analyst
Cynet SystemsNashville, TN, USserp_jobs.job_card.full_time
Sr. Design Researcher Job at Healthcare Ascension in Nashville
MediabistroNashville, TN, United Statesserp_jobs.job_card.full_time
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Nashville
MediabistroNashville, TN, United Statesserp_jobs.job_card.full_time
Ingram Content Group is hiring : Artificial Intelligence Engineer in La Vergne
MediabistroLa Vergne, TN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationNashville, Tennesseeserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Nashville
MediabistroNashville, TN, United Statesserp_jobs.job_card.full_time
Audio Evaluation Expert - Fully Remote Job at Mercor in Nashville
MediabistroNashville, TN, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Sr. Business Intelligence Analyst
CopperweldBrentwood, TN, USserp_jobs.job_card.full_time