AI Evaluation Analyst
VirtualVocationsElizabeth, New Jersey, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Elizabeth, New Jersey, United States
Job_description.internal_linking.related_jobs
We are looking for an Agentic AI Developer to join our growing Agentic AI Platform team.This role will focus on developing, integrating, and managing enterprise-scale AI and MCP (Model Context Prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
I can succeed as a Quantitative Analyst at Capital Group".As a member of the Quantitative Research and Analytics group (QRA) at Capital Group (CG), you conduct rigorous peer-reviewed quantitative r...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Vineland, New Jersey, 08360!.Aequor is now hiring a full-time Board Certified Behavior Analyst (BCBA) for the 2023-20...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Franklin, New Jersey, 07416!.Board Certified Behavior Analyst (BCBA).
With Aequor, you can enjoy the freedom to advanc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in West Milford, New Jersey, 07480!.Aequor is now hiring a full-time Board Certified Behavior Analyst (BCBA) for the 202...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Do you want to be part of the core team building truly AI-native helpful experiences across the consumer space? Do you want to be at the cutting edge of what is next in the AI space but apply it to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Market Intelligence and Data Analyst - Annuities.Key Responsibilities Gather, analyze, model, and present competitive intelligence data to senior management and stakeho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Agentic AI Developer
TEKsystemsNewark, NJ, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Search Analyst
VirtualVocationsElizabeth, New Jersey, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Agent Evaluation Analyst
VirtualVocationsPaterson, New Jersey, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
English Writing and Content Reviewing Expertise Sought for AI Training
OutlierTrenton, NJ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Quantitative Analyst - Applied Quantitative Solutions (ML-AI)
Capital GroupNew York, NY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Applied Researcher I
Capital OneNEW YORK, New York, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in Vineland, NJ
AlliedTravelCareersPaterson, New Jersey, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationTrenton, New Jerseyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierJersey City, NJ, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationNew Brunswick, New Jerseyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in Franklin, NJ
AlliedTravelCareersFranklin, NJ, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in West Milford, NJ
AlliedTravelCareersPaterson, New Jersey, USserp_jobs.job_card.full_time
Applied AI Researcher
VerneekNew York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationElizabeth, New Jerseyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsStaten Island, New York, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationNew Brunswick, New Jerseyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Competitive Intelligence Analyst (Hybrid)
Selective InsuranceShort Hills, NJ, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Evaluation Analyst
VirtualVocationsPaterson, New Jersey, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationSayreville, New Jerseyserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Market Intelligence Data Analyst
VirtualVocationsElizabeth, New Jersey, United Statesserp_jobs.job_card.full_time