Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsTulsa, Oklahoma, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Tulsa, Oklahoma, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationTulsa, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationBroken Arrow, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Travel ICU RN Job in Tulsa, Oklahoma

Travel ICU RN Job in Tulsa, Oklahoma

Gifted HealthcareMannford, OK, US
serp_jobs.job_card.full_time
Intensive Care Unit RNs (ICU RNs) specialize in delivering care to patients in intensive care units of hospitals and healthcare facilities. ICU RNs evaluate the patient's conditions, administer ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
PRN Psych RN Job in Sapulpa, Oklahoma

PRN Psych RN Job in Sapulpa, Oklahoma

Gifted HealthcareBristow, OK, US
serp_jobs.job_card.full_time
Psychiatric RNs provide direct care to patients and work within a multidisciplinary team to provide outcome-based treatment for patients. The Psych RN responds to distressed patients and educates pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote AI Writing Evaluator

Remote AI Writing Evaluator

OutlierBroken Arrow, OK, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationBroken Arrow, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
English Writing Editor - Part Time Work From Home

English Writing Editor - Part Time Work From Home

OutlierBroken Arrow, OK, United States
serp_jobs.filters.remote
serp_jobs.job_card.part_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
PRN LTAC RN Job in Tulsa, Oklahoma

PRN LTAC RN Job in Tulsa, Oklahoma

Gifted HealthcareMannford, OK, US
serp_jobs.job_card.full_time
Long Term Acute Care RNs (LTAC RNs) provide quality patient care during the patient assessment, intervention, and evaluation process. LTAC RNs collaborate with all members of a patient's healthc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationBroken Arrow, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Tax Associate - Onsite - 2+ Yrs Paid Tax Experience Required

Tax Associate - Onsite - 2+ Yrs Paid Tax Experience Required

IntuitCatoosa, OK, United States
serp_jobs.job_card.full_time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationTulsa, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsTulsa, Oklahoma, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Freelance Writer

Freelance Writer

OutlierBroken Arrow, OK, United States
serp_jobs.job_card.full_time
Earn up to $35 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Insurance Sales Agent - Bonuses and Travel Incentives

Insurance Sales Agent - Bonuses and Travel Incentives

Platinum Supplemental InsuranceBroken Arrow, Oklahoma
serp_jobs.job_card.full_time
Ready to jump-start your career and take charge of your earning potential?.At Platinum Supplemental Insurance, we’re looking for motivated individuals ready to learn, grow, and thrive in a fast-pac...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Content Writer - Part Time Work From Home

AI Content Writer - Part Time Work From Home

OutlierBroken Arrow, OK, United States
serp_jobs.filters.remote
serp_jobs.job_card.part_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationBroken Arrow, Oklahoma
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Content Editor - Part Time Work From Home

AI Content Editor - Part Time Work From Home

OutlierBroken Arrow, OK, United States
serp_jobs.filters.remote
serp_jobs.job_card.part_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Freelance Writer - Flexible

Freelance Writer - Flexible

OutlierBroken Arrow, OK, United States
serp_jobs.job_card.full_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days