AI Evaluation Analyst
VirtualVocationsYonkers, New York, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Yonkers, New York, United States
Job_description.internal_linking.related_jobs
Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.
Our cutting-edge solutions empower businesses—from ex...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
AI-Enabled Global Study Data Leader.Are you ready to shape the future of medicine? The race is on to speed up drug discovery and development to find answers for patients and their families.Your ski...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Job Title : AI-Enabled Global Study Manager Location : Morristown, NJ Cambridge, MA About the Job Are you ready to shape the future of medicine? The race is on to speed up drug discovery and devel...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Join us in advancing AI technology that protects against deepfake videos! Your Personal AI is conducting important research to improve systems that detect manipulated video content.Your participati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Index Ventures is an international venture capital firm with headquarters in New York City, San Francisco, and London.We take a people-first approach to investing in technology-enabled companies.Ou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Imagine what you could build here.At Vessel, were reimagining how people live.Our mission is to deliver beautifully designed, affordable homes at scale.
To do this, we need bold thinkers who see pos...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
About Vitalief Vitalief partners with Sites, Sponsors, and CROs to streamline research operations, reduce costs, and accelerate breakthroughs that improve patient care.
We bring deep clinical resear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Do you want to be part of the core team building truly AI-native helpful experiences across the consumer space? Do you want to be at the cutting edge of what is next in the AI space but apply it to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Position : AI Business Analyst Location : Iselin NJ Duration : Long Term Contract Job ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Decision Science (DS) Analyst / Associate Positions Are you looking for a consulting opportunity that uses your analytical skills, predictive modeling, and AI / ML?.
Does the thought of working with eme...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Hedgeye Risk Management is seeking a dynamic and intellectually curious Equity Research Analyst to join our Software sector coverage.
This is a high-impact opportunity to shape the direc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Senior Analyst / Associate, Fundamental Research Platform.Reporting to the Senior Director, the Senior Analyst / Associate, Fundamental Research Platform will play an active role in conducting in-depth...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Around $100,000 (may vary depending on experience).Conduct in-depth research and analysis of U.Assist in developing strategies for fixed income, private credit, and other investment.Prepare detaile...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Applied Researcher I (AI Foundations).At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.
For years, Capital One has been leading the industry in using ma...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Senior AI Research Engineer, Model Inference (100% Remote)
Tether Operations LimitedNew York, NY, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI-Enabled Global Study Data Leader
SanofiMorristown, NJ, USserp_jobs.job_card.full_time
Hireio, Inc. is hiring : AI Communication Quality & Culture Evaluator in New York
MediabistroNew York, NY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI-Enabled Global Study Manager
SanofiMorristown, New Jersey, USserp_jobs.job_card.full_time
Research Participant AI Deepfake Detection Study
Your Personal AINew York, NY, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied Researcher I
Capital OneNEW YORK, New York, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationWhite Plains, New Yorkserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationMount Vernon, New Yorkserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Applied AI Investor
Index VenturesNew York, NY, USserp_jobs.job_card.full_time
Applied AI Lead
Vessel TechnologiesNew York, New York, United States, 10001serp_jobs.job_card.full_time
Research Misconduct Investigations Analyst
VitaliefPiscataway, NJ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationElizabeth, New Jerseyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Applied AI Researcher
VerneekNew York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Business Analyst
Tekshapers IncIselin, NJ, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Campus 2026 : Decision Science (DS) Analyst / Associate
Axtria, Inc.Berkeley Heights, NJ, USserp_jobs.job_card.permanent
serp_jobs.filters_job_card.quick_apply
Equity Research, Software Sector
Hedgeye Risk ManagementStamford, CT, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Senior Analyst, Global Alpha, Fundamental Research Platform
Public Sector Pension Investment BoardNew York, NY, USserp_jobs.job_card.full_time
Research Analyst
DHD ConsultingNew York, New York, United Statesserp_jobs.job_card.full_time +1
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Applied Researcher I (AI Foundations)
Capital OneNew York, NY, USserp_jobs.job_card.full_time +1
Visual Data Evaluator Job at Firstsource Solutions Ltd in New York
MediabistroNew York, NY, United Statesserp_jobs.job_card.full_time