AI Evaluation Analyst
VirtualVocationsYonkers, New York, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Yonkers, New York, United States
Job_description.internal_linking.related_jobs A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.
Our cutting-edge solutions empower businesses—from ex...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Job Type : Officer of Administration.Salary Range : $130,000-$150,000.The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departm...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
This grant-funded position supports the Center for Institutional Effectiveness in developing and implementing a systematic institutional research program to provide critical information to college ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Index Ventures is an international venture capital firm with headquarters in New York City, San Francisco, and London.We take a people-first approach to investing in technology-enabled companies.Ou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Imagine what you could build here.At Vessel, were reimagining how people live.Our mission is to deliver beautifully designed, affordable homes at scale.
To do this, we need bold thinkers who see pos...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Do you want to be part of the core team building truly AI-native helpful experiences across the consumer space? Do you want to be at the cutting edge of what is next in the AI space but apply it to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Industrials | Multi-Manager Hedge Fund | Flexible Location.Our client, a leading multi-manager equity hedge fund, is seeking a driven and intellectually curious.
Portfolio Manager with a strong trac...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Position : AI Business Analyst Location : Iselin NJ Duration : Long Term Contract Job ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Dist Professor Bio-Medical Engineering.The candidate will process and analyze neuroimaging datasets.They will help build models to better understand brain activity.
They will also help the PI in wri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
The Epic Research Analyst I will be the principal analyst for the Epic Research module and the Research departments systems that might interface into Epic.
They should have a thorough understanding ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Distinguished Professor, Physics.The Dias Lab is hiring a data analyst to design short peptides that can target cancer cells.
The candidate is expected to use computational tools to design different...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Agent Evaluation Analyst
VirtualVocationsJackson Heights, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in New York
MediabistroNew York, NY, United Statesserp_jobs.job_card.full_time
Senior AI Research Engineer, Model Inference (100% Remote)
Tether Operations LimitedNew York, NY, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Product Manager, AI Content Discovery
Amazon.comPaterson, NJ, USAserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied AI Engineer
Columbia UniversityNew York, NY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied Researcher I
Capital OneNew York, NY, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Research Analyst
BERGEN COMM COLLEGEParamus, NJ, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationStamford, Connecticutserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierJersey City, NJ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied AI Investor
Index VenturesNew York, NY, USserp_jobs.job_card.full_time
Applied AI Lead
Vessel TechnologiesNew York, New York, United States, 10001serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationPerth Amboy, New Jerseyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Applied AI Researcher
VerneekNew York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Buyside Industrials Equity Research Analyst
Selby JenningsNew York, NY, USserp_jobs.job_card.full_time
AI Business Analyst
Tekshapers IncIselin, NJ, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationClifton, New Jerseyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Data Analyst
New Jersey Institute of TechnologyNewark, NJ, United Statesserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Epic Research Analyst
Medisys Health Network, Inc.Hicksville, NY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Evaluation Analyst
VirtualVocationsPaterson, New Jersey, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Hourly Research Analyst
New Jersey Institute of TechnologyNewark, NJ, United Statesserp_jobs.job_card.part_time