Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsTulsa, Oklahoma, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Tulsa, Oklahoma, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationTulsa, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationBroken Arrow, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Director of Data, Analytics & AI

Director of Data, Analytics & AI

SageNet LLCTulsa, OK, US
serp_jobs.job_card.full_time
Empowering Connections, Inspiring Possibility.SageNet is a leading managed services provider specializing in connectivity, digital signage and cybersecurity. The company connects, manages and protec...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Fraud Prevention and Detection Analyst

Fraud Prevention and Detection Analyst

BOK FinancialTulsa, OK, US
serp_jobs.job_card.full_time
Fraud Prevention And Detection Analyst.The role of a Fraud Prevention and Detection Analyst is crucial in safeguarding the organization from fraudulent activities, which includes overseeing fraud p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Senior Revenue Cycle Analyst

Senior Revenue Cycle Analyst

Saint Francis Health SystemTulsa, OK, US
serp_jobs.job_card.full_time
Schedule : Monday - Friday | 8 : 00am - 5 : 00pm.Please note : This position is onsite in Tulsa, Oklahoma is NOT eligible for remote work. Job Summary : The Senior Revenue Cycle Analyst leads advanced anal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
NEW Value Analysis Specialist Opening (Onsite Role)

NEW Value Analysis Specialist Opening (Onsite Role)

K.A. RecruitingTulsa, OK, US
serp_jobs.job_card.full_time
Seeking a detail-oriented and collaborative Value Analysis Specialist to support cost-effective, high-quality patient care through data-driven decision making. In this role, youll serve as the key l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Value Analysis Specialist

Value Analysis Specialist

Saint Francis Health SystemTulsa, OK, US
serp_jobs.job_card.full_time
Full Time Days Monday-Friday 8am-4 : 30pm.Job Summary : The Value Analysis Specialist supports the value chain analysis process acting as a key liaison between the strategic sourcing team and clinical...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Project Controls Analyst I / II

Project Controls Analyst I / II

WilliamsTulsa, OK, US
serp_jobs.job_card.full_time
Williams is committed to creating a diverse and inclusive environment and is proud to be an equal opportunity employer.All qualified applicants will receive consideration for employment without reg...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Supv Data Analytics & Technology

Supv Data Analytics & Technology

WilliamsTulsa, OK, US
serp_jobs.job_card.full_time
Supervisor of Internal Audit Data Analytics & Technology.Williams is committed to creating a diverse and inclusive environment and is proud to be an equal opportunity employer.All qualified applica...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationBroken Arrow, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior Project Controls Analyst

Senior Project Controls Analyst

Matrix ServiceCatoosa, OK, US
serp_jobs.job_card.full_time
Senior Project Controls Analyst.Project Controls Analyst will report directly to the Director of Project Controls and works with the Project Management, Estimating, Cost Control, Scheduling, Field ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationBroken Arrow, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationTulsa, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Records Examiner / Analyst Supporting the FBI

Records Examiner / Analyst Supporting the FBI

Clearance JobsTulsa, OK, US
serp_jobs.job_card.full_time
Be a part of the nationwide law enforcement initiative that removes the tools of crime from criminal organizations, depriving wrongdoers of proceeds from their crime and impacting the infrastructur...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Financial Systems & Automation Analyst III

Financial Systems & Automation Analyst III

WilliamsTulsa, OK, US
serp_jobs.job_card.full_time
Financial Systems & Automation Analyst III.Williams is committed to creating a diverse and inclusive environment and is proud to be an equal opportunity employer. All qualified applicants will recei...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Project Controls Analyst

Project Controls Analyst

ActalentTulsa, OK, US
serp_jobs.job_card.full_time
Actalent connects passion with purpose.We are supporting critical engineering and sciences initiatives that advance how companies serve the world. With almost 40 years of experience, our scalable ta...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Market Research Contributor (Hiring Immediately)

Remote Market Research Contributor (Hiring Immediately)

Earn HausCoweta, Oklahoma, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time +2
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Revenue Cycle Analyst

Revenue Cycle Analyst

Saint Francis Health SystemTulsa, OK, US
serp_jobs.job_card.full_time
Schedule : Monday - Friday | 8 : 00am - 5 : 00pm.Please note : This position is onsite in Tulsa, Oklahoma is NOT eligible for remote work. The Revenue Cycle Analyst supports the financial performance of t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Support Analyst I

Support Analyst I

Care ATC IncTulsa, OK, US
serp_jobs.job_card.full_time
Make a Difference in Healthcare Technology.Why CareATC is Different (and Why You'll Love It Here) : .At CareATC, we believe that better technology leads to better care, and our Support Analyst te...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationBroken Arrow, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30