AI Evaluation Analyst
VirtualVocationsFlushing, New York, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Flushing, New York, United States
Job_description.internal_linking.related_jobs A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Norwalk, Connecticut, 06852!.Board Certified Behavior Analyst (BCBA).
Board Certified Behavioral Analyst.Hours : Varyin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
I can succeed as a Quantitative Analyst at Capital Group".As a member of the Quantitative Research and Analytics group (QRA) at Capital Group (CG), you conduct rigorous peer-reviewed quantitative r...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Quality Vendor Economics Analyst III.Key Responsibilities Assess financial opportunities related to new and existing Quality vendor contracts Document vendor processes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Search Analyst, SEO & SEM.Key Responsibilities Assist in planning, executing, optimizing, and reporting on paid search campaigns Conduct keyword research, manage copy ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Market Intelligence and Data Analyst - Annuities.Key Responsibilities Gather, analyze, model, and present competitive intelligence data to senior management and stakeho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Do you want to be part of the core team building truly AI-native helpful experiences across the consumer space? Do you want to be at the cutting edge of what is next in the AI space but apply it to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
AI Evaluation Analyst
VirtualVocationsAstoria, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationNorwalk, Connecticutserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationWhite Plains, New Yorkserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationWhite Plains, New Yorkserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in Norwalk, CT
AlliedTravelCareersNorwalk, CT, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Quantitative Analyst - Applied Quantitative Solutions (ML-AI)
Capital GroupNew York, NY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Quality Vendor Economics Analyst
VirtualVocationsFlushing, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Search Analyst, SEO & SEM
VirtualVocationsJamaica, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied Researcher I
Capital OneNEW YORK, New York, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationWhite Plains, New Yorkserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Market Intelligence Data Analyst
VirtualVocationsJackson Heights, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierJersey City, NJ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Trainer
VirtualVocationsAstoria, New York, United Statesserp_jobs.job_card.full_time
Applied AI Researcher
VerneekNew York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer
Data AnnotationNorwalk, Connecticutserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Agent Evaluation Analyst
VirtualVocationsStaten Island, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationNorwalk, Connecticutserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Adoption Solutions Architect
VirtualVocationsFlushing, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Search Analyst
VirtualVocationsFlushing, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Product Analyst
VirtualVocationsJamaica, New York, United Statesserp_jobs.job_card.full_time