AI Evaluation Analyst
VirtualVocationsYonkers, New York, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Yonkers, New York, United States
Job_description.internal_linking.related_jobs
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.
Our cutting-edge solutions empower businesses—from ex...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
AI-Enabled Global Study Data Leader.Are you ready to shape the future of medicine? The race is on to speed up drug discovery and development to find answers for patients and their families.Your ski...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Job Title : AI-Enabled Global Study Manager Location : Morristown, NJ Cambridge, MA About the Job Are you ready to shape the future of medicine? The race is on to speed up drug discovery and devel...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
This grant-funded position supports the Center for Institutional Effectiveness in developing and implementing a systematic institutional research program to provide critical information to college ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Class Action Capital is a boutique class action claims management firm in the global litigation finance industry specializing in the identification, research, data analysis and filing of complex cl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Join us in advancing AI technology that protects against deepfake videos! Your Personal AI is conducting important research to improve systems that detect manipulated video content.Your participati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Index Ventures is an international venture capital firm with headquarters in New York City, San Francisco, and London.We take a people-first approach to investing in technology-enabled companies.Ou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Imagine what you could build here.At Vessel, were reimagining how people live.Our mission is to deliver beautifully designed, affordable homes at scale.
To do this, we need bold thinkers who see pos...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
ABI Research seeks intellectually curious analysts at all levels, from entry-level to seasoned research directors.Reporting to one of our group Vice Presidents, successful candidates will contribut...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Do you want to be part of the core team building truly AI-native helpful experiences across the consumer space? Do you want to be at the cutting edge of what is next in the AI space but apply it to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Industrials | Multi-Manager Hedge Fund | Flexible Location.Our client, a leading multi-manager equity hedge fund, is seeking a driven and intellectually curious.
Portfolio Manager with a strong trac...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Position : AI Business Analyst Location : Iselin NJ Duration : Long Term Contract Job ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Senior Analyst / Associate, Fundamental Research Platform.Reporting to the Senior Director, the Senior Analyst / Associate, Fundamental Research Platform will play an active role in conducting in-depth...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Around $100,000 (may vary depending on experience).Conduct in-depth research and analysis of U.Assist in developing strategies for fixed income, private credit, and other investment.Prepare detaile...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Applied Researcher I (AI Foundations).At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.
For years, Capital One has been leading the industry in using ma...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Redesign Health is a global venture builder that empowers founders to launch and scale transformative healthcare companies.
We help founders overcome the unique challenges of healthcare innovation w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in New York
MediabistroNew York, NY, United Statesserp_jobs.job_card.full_time
Senior AI Research Engineer, Model Inference (100% Remote)
Tether Operations LimitedNew York, NY, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI-Enabled Global Study Data Leader
SanofiMorristown, NJ, USserp_jobs.job_card.full_time
Hireio, Inc. is hiring : AI Communication Quality & Culture Evaluator in New York
MediabistroNew York, NY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI-Enabled Global Study Manager
SanofiMorristown, New Jersey, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Research Analyst
BERGEN COMM COLLEGEParamus, NJ, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Research Analyst
Class Action Capital Recovery LLCNew York, NY, USserp_jobs.job_card.full_time
Research Participant AI Deepfake Detection Study
Your Personal AINew York, NY, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied Researcher I
Capital OneNEW YORK, New York, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Applied AI Investor
Index VenturesNew York, NY, USserp_jobs.job_card.full_time
Applied AI Lead
Vessel TechnologiesNew York, New York, United States, 10001serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Technology Research Analyst
ABI ResearchNew York, NY, USserp_jobs.job_card.full_time
Applied AI Researcher
VerneekNew York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Buyside Industrials Equity Research Analyst
Selby JenningsNew York, NY, USserp_jobs.job_card.full_time
AI Business Analyst
Tekshapers IncIselin, NJ, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Senior Analyst, Global Alpha, Fundamental Research Platform
Public Sector Pension Investment BoardNew York, NY, USserp_jobs.job_card.full_time
Research Analyst
DHD ConsultingNew York, New York, United Statesserp_jobs.job_card.full_time +1
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Applied Researcher I (AI Foundations)
Capital OneNew York, NY, USserp_jobs.job_card.full_time +1
Visual Data Evaluator Job at Firstsource Solutions Ltd in New York
MediabistroNew York, NY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied AI Engineer
Redesign HealthNew York, NY, USserp_jobs.job_card.full_time