Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsGreenville, South Carolina, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Greenville, South Carolina, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationSpartanburg, South Carolina
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Data Analyst | 2026 Start

Data Analyst | 2026 Start

American Credit AcceptanceSpartanburg, SC, US
serp_jobs.job_card.full_time
Launch your career with us! We’re looking for students graduating between Fall 2025 and Summer 2026 who are ready to jump in and start full-time in 2026. Are you ready to turn complex data into clea...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Board Certified Behavior Analyst

Board Certified Behavior Analyst

Carolina Therapeutics, PLLCGreenville, SC, US
serp_jobs.job_card.full_time
Welcome to Carolina Therapeutics, PLLC! We are committed to providing clinic, in home and community based Speech Therapy, Physical Therapy, Occupational Therapy, and Applied Behavioral Analysis (AB...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Business Analyst

Business Analyst

Calculated HireGreenville, SC, US
serp_jobs.job_card.full_time
The position is responsible for detailed analysis of Emergent Work plan performance reporting, KPI’s, monitoring and budget variances for the PGO Transmission Asset Replacement Programs.This ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationSpartanburg, South Carolina
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Freelance Luxury Brand Evaluator Automotive Project - South Carolina

Freelance Luxury Brand Evaluator Automotive Project - South Carolina

CXGGreenville, SC, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!. As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Quality Analyst (Onsite) Greenville, SC

Quality Analyst (Onsite) Greenville, SC

Transcom LimitedGreenville, SC, United States
serp_jobs.job_card.full_time
Location Greenville, SC Job ID 8417 Job Category Operations Language Requirement English.Quality Specialists are responsible for executing the campaign's quality assurance program, ensuring that cl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationGreenville, South Carolina
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Strategy Analyst

Strategy Analyst

American Credit AcceptanceSpartanburg, SC, US
serp_jobs.job_card.full_time
The Strategy Analyst is responsible for improving organizational efficiency by analyzing, streamlining, and optimizing business processes in partnership with senior leaders.Reasonable accommodation...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Support Analyst, Customer Wayfinding, My Chart, FT, Days, - Remote

Support Analyst, Customer Wayfinding, My Chart, FT, Days, - Remote

Prisma HealthGreenville, South Carolina, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Answers incoming calls from patients who want to place orders, respond to inquiries, manage complaints, troubleshoot significant customer service problems, and provide general information.Member of...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Legal Analyst

Legal Analyst

American Credit AcceptanceSpartanburg, SC, US
serp_jobs.job_card.full_time
Location : Spartanburg, SC | Full-Time | Fully Onsite.Launch your legal career… or take it to the next level with American Credit Acceptance (ACA). Legal Department, where you'll play a key role in s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Board Certified Behavior Analyst (Greenville)

Board Certified Behavior Analyst (Greenville)

Carolina Therapeutics, PLLCGreenville, SC, US
serp_jobs.job_card.part_time
Welcome to Carolina Therapeutics, PLLC! We are committed to providing clinic, in home and community based Speech Therapy, Physical Therapy, Occupational Therapy, and Applied Behavioral Analysis (AB...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Data Credit Risk Analyst

Data Credit Risk Analyst

Security FinanceSpartanburg, SC, US
serp_jobs.job_card.full_time
In this role, you will have the opportunity to aid in the development of risk models, perform statistical analysis, portfolio credit risk analysis, and stay current with the credit risk industry as...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior Prog Control Analyst

Senior Prog Control Analyst

ARA BrandGreenville, SC, US
serp_jobs.job_card.full_time
The Integrated Products Division (IPD) of Applied Research Associates, Inc.Senior Project Analyst to join our team in Greenville, SC. The IPD team strives to develop and deliver solutions to challen...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Business Intelligence Analyst

Business Intelligence Analyst

Integrated Power ServicesGreenville, SC, US
serp_jobs.job_card.full_time
Integrated Power Services is seeking a Business Intelligence Analyst to help design, implement, and manage our growing analytics platform and dashboards. The Business Intelligence Analyst will work ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Compliance Analyst

Compliance Analyst

American Credit AcceptanceSpartanburg, SC, US
serp_jobs.job_card.full_time
The Compliance Analyst will provide tactical and analytical support to the Compliance Department, assist with governance efforts and issue management, liaise with other departments, and develop sub...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationGreenville, South Carolina
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
GENAI / MACHINE LEARNING AI / DATA Scientist

GENAI / MACHINE LEARNING AI / DATA Scientist

Hudson ManpowerGreenville, SC, US
serp_jobs.job_card.full_time
I hope this message finds you well.I’m reaching out to share an exciting opportunity that I believe aligns with your experience and expertise in the field for my client. If you are interested, I’d l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationGreenville, South Carolina
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Strategy Analyst | 2026 Start

Strategy Analyst | 2026 Start

American Credit AcceptanceSpartanburg, SC, US
serp_jobs.job_card.full_time
Launch your career with us! We’re looking for students graduating between Fall 2025 and Summer 2026 who are ready to jump in and start full-time in 2026. Are you a problem solver with a passion for ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30