Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsYonkers, New York, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Yonkers, New York, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsJackson Heights, New York, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in New York

ICONMA is hiring : AI Multimedia Generation Product Evaluator in New York

MediabistroNew York, NY, United States
serp_jobs.job_card.full_time
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location. The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Senior AI Research Engineer, Model Inference (100% Remote)

Senior AI Research Engineer, Model Inference (100% Remote)

Tether Operations LimitedNew York, NY, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from ex...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Senior Product Manager, AI Content Discovery

Senior Product Manager, AI Content Discovery

Amazon.comPaterson, NJ, USA
serp_jobs.job_card.full_time
At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
Applied AI Engineer

Applied AI Engineer

Columbia UniversityNew York, NY, United States
serp_jobs.job_card.full_time
Job Type : Officer of Administration.Salary Range : $130,000-$150,000.The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departm...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Applied Researcher I

Applied Researcher I

Capital OneNew York, NY, US
serp_jobs.job_card.full_time +1
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Research Analyst

Research Analyst

BERGEN COMM COLLEGEParamus, NJ, US
serp_jobs.job_card.full_time
This grant-funded position supports the Center for Institutional Effectiveness in developing and implementing a systematic institutional research program to provide critical information to college ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationStamford, Connecticut
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote AI Writing Evaluator

Remote AI Writing Evaluator

OutlierJersey City, NJ, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Applied AI Investor

Applied AI Investor

Index VenturesNew York, NY, US
serp_jobs.job_card.full_time
Index Ventures is an international venture capital firm with headquarters in New York City, San Francisco, and London.We take a people-first approach to investing in technology-enabled companies.Ou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Applied AI Lead

Applied AI Lead

Vessel TechnologiesNew York, New York, United States, 10001
serp_jobs.job_card.full_time
Imagine what you could build here.At Vessel, were reimagining how people live.Our mission is to deliver beautifully designed, affordable homes at scale. To do this, we need bold thinkers who see pos...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationPerth Amboy, New Jersey
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Applied AI Researcher

Applied AI Researcher

VerneekNew York, NY, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Do you want to be part of the core team building truly AI-native helpful experiences across the consumer space? Do you want to be at the cutting edge of what is next in the AI space but apply it to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Buyside Industrials Equity Research Analyst

Buyside Industrials Equity Research Analyst

Selby JenningsNew York, NY, US
serp_jobs.job_card.full_time
Industrials | Multi-Manager Hedge Fund | Flexible Location.Our client, a leading multi-manager equity hedge fund, is seeking a driven and intellectually curious. Portfolio Manager with a strong trac...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
AI Business Analyst

AI Business Analyst

Tekshapers IncIselin, NJ, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Position : AI Business Analyst Location : Iselin NJ Duration : Long Term Contract Job ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationClifton, New Jersey
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Data Analyst

Data Analyst

New Jersey Institute of TechnologyNewark, NJ, United States
serp_jobs.job_card.part_time
Dist Professor Bio-Medical Engineering.The candidate will process and analyze neuroimaging datasets.They will help build models to better understand brain activity. They will also help the PI in wri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Epic Research Analyst

Epic Research Analyst

Medisys Health Network, Inc.Hicksville, NY, United States
serp_jobs.job_card.full_time
The Epic Research Analyst I will be the principal analyst for the Epic Research module and the Research departments systems that might interface into Epic. They should have a thorough understanding ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsPaterson, New Jersey, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Hourly Research Analyst

Hourly Research Analyst

New Jersey Institute of TechnologyNewark, NJ, United States
serp_jobs.job_card.part_time
Distinguished Professor, Physics.The Dias Lab is hiring a data analyst to design short peptides that can target cancer cells. The candidate is expected to use computational tools to design different...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30