Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsJackson Heights, New York, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Jackson Heights, New York, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Lead Machine Learning Engineer (Intelligent Foundations & Experiences)

Lead Machine Learning Engineer (Intelligent Foundations & Experiences)

Capital OneNew York City, NY, US
serp_jobs.job_card.full_time +1
AVP, Specialty Underwriting & Portfolio Management - Corporate & Sponsor Lending.The Commercial Underwriting and Portfolio Management organization is responsible for working with internal partners ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Lead Machine Learning Engineer - ML / AI

Lead Machine Learning Engineer - ML / AI

Capital OneNew York City, NY, US
serp_jobs.job_card.full_time +1
Lead Machine Learning Engineer - ML / AI.At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems. Our investments in technology infrastructure and worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Machine Learning Engineer

Machine Learning Engineer

Akaasa TechnologiesNew York City, NY, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Job Description : We're looking for a forward-thinking AI Solutions Engineer with deep expertise in Generative AI to join our team. This role is ideal for someone wh...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Developer- Agent Specialist

AI Developer- Agent Specialist

EisnerAmperIselin, NJ, United States
serp_jobs.job_card.full_time
At EisnerAmper, we look for individuals who welcome new ideas, encourage innovation, and are eager to make an impact.Whether you're starting out in your career or taking your next step as a seasone...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Reserving Data & Applications Lead

Reserving Data & Applications Lead

Axis CapitalRed Bank, NJ, United States
serp_jobs.job_card.full_time
This is your opportunity to join AXIS Capital - a trusted.We stand apart for our outstanding client service, intelligent risk taking and superior risk adjusted returns for our shareholders.We also ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Ceded Re Reporting and Analytics Intern

Ceded Re Reporting and Analytics Intern

Sompo InternationalGarden City, NY, US
serp_jobs.job_card.part_time
Sompo International Internship Opportunity.We are seeking a Summer 2026 Ceded Reinsurance Reporting and Analytics Intern for the Ceded Reinsurance Reporting Group within the Ceded Reinsurance team,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Machine Learning Engineer

Machine Learning Engineer

5 Star RecruitmentNewark, New Jersey, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
As a Machine Learning Engineer, you will play a pivotal role in driving the development and implementation of cutting-edge machine learning solutions for our client. Your responsibilities will encom...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Data Engineer

Data Engineer

SynapOneBronx, NY, United States
serp_jobs.job_card.full_time
Job Title : Data Engineering Contractor.Join our dynamic team of talented engineers with a proven track record in constructing data. We are on a mission to fuel Unite Us' ongoing expansion and.This p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Machine Learning Engineer, Planning

Machine Learning Engineer, Planning

WaymoNew York, NY, United States
serp_jobs.job_card.full_time
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Staff Machine Learning Engineer, Snowflake & Databricks

Staff Machine Learning Engineer, Snowflake & Databricks

Teladoc HealthPurchase, NY, United States
serp_jobs.job_card.full_time
Update Coming to the Teladoc Health Careers page URL.As part of a system transition on October 11-12, 2025, current job posting links will no longer be accessible. To continue viewing this job or ot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
TIBCO developer

TIBCO developer

LuxoftHolmdel, NJ, US
serp_jobs.job_card.full_time
Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface been technology and business, we con...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Machine Learning Engineer

Machine Learning Engineer

Tiger AnalyticsJersey City, NJ, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Tiger Analytics is an advanced analytics consulting firm.We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data.Our consultants b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Principal AI / Machine Learning Engineer

Principal AI / Machine Learning Engineer

ZT Systems groupSecaucus, NJ, United States
serp_jobs.job_card.full_time
About The Role • •The Principal AI / Machine Learning Engineer will oversee defining and executing ZT’s roadmap for applying artificial intelligence and machine learning in manufacturing.The AI / ML Tran...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
AI / Machine Learning Engineer

AI / Machine Learning Engineer

1KosmosIselin, NJ, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Are you ready to shape the future of authentication? Join 1Kosmos and help lead the next wave in identity assurance and passwordless innovation. Kosmos is driving the future of identity security, em...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Spotify is hiring : Machine Learning Engineer - Advertising in New York

Spotify is hiring : Machine Learning Engineer - Advertising in New York

MediabistroNew York, NY, United States
serp_jobs.job_card.full_time
Our mission on the Advertising Product & Technology team is to build a next generation advertising platform that aligns with our unique value proposition for audio and video.We work to scale the us...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Machine Learning Engineer

Machine Learning Engineer

OpenkyberNY, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI / ML Engineer Work Location : Jersey City, NJ / NYC, NY - Day1 onsite Duration : Long Term Job Description Designing and developing AI / ML appl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Machine Learning Engineer, Prediction

Machine Learning Engineer, Prediction

WaymoNew York, NY, United States
serp_jobs.job_card.full_time
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Data Scientist

Data Scientist

New York Blood CenterRye, NY, United States
serp_jobs.job_card.full_time
New York Blood Center Enterprises (NYBCe).NYBCe is one of the largest nonprofit blood centers, spanning 17+ states and serving 75 million people. NYBCe operates Blood Bank of Delmarva, Community Blo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Applied AI engineer

Applied AI engineer

HSAD North AmericaEnglewood Cliffs, New Jersey, United States
serp_jobs.job_card.full_time
We are seeking an Applied AI Engineer with a strong software engineering background to join our AI initiative team, focusing on building production LLM applications and implementing cutting-edge AI...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Machine Learning Engineer (15265-1) Newark, NJ

Machine Learning Engineer (15265-1) Newark, NJ

ESRhealthcareNewark, New Jersey, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Machine Learning Engineer (15265-1) Newark, NJ.Experience level : Mid-senior Experience required : 7 Years Education level : Bachelors degree Job function : Information Technology Industry : Information...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30