AI Agent Evaluation Analyst
VirtualVocationsBronx, New York, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Bronx, New York, United States
Job_description.internal_linking.related_jobs
AI Finance Analyst for healthcare operators.Our product acts like an embedded analyst, surfacing insights across service lines, contracts, and staffing—without needing deep technical or finan...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
American International Group, Inc.AIG) is a leading global insurance organization.AIG member companies provide a wide range of property casualty insurance in approximately 70 countries and jurisdic...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Grow your career with an innovative global bank in New York, NY as an Operations AI Lead.Contract role with strong possibility of extension or conversion to full-time employment.Will require workin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
LifeMD is a leading digital healthcare company committed to expanding access to virtual care, pharmacy services, and diagnostics by making them more affordable and convenient for all.Focused on bot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
AI Developer Natural Language Processing, Machine Learning & AWS New York, NY (Need Onsite day 1, hybrid 3 days from office< / b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
ETL Developer needs 6 years experience.Bachelor's degree preferred or equivalent experience.Coppell, TX ; Tampa, FL, Jersey City, NJ.
Strong hands-on experience with Oracle Data Integrator (ODI) dev...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Database Development Job Duties : Database Developers are responsible for data gathering before development of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Sompo International Internship Opportunity.We are seeking a Summer 2026 Ceded Reinsurance Reporting and Analytics Intern for the Ceded Reinsurance Reporting Group within the Ceded Reinsurance team,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Develop, implement, and optimize NLP solutions utilizing LLMs tailored for financial data and equities.Manage and deploy Machine Computing Platforms (MCP) to support scalable AI workloads.Collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Required Location : Hybrid / Midtown New York City or 100% Remote A senior AI Quality Engineer role is critical in ensur...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Who We Are At Amsive, we're more than just a performance marketing agency; we're a team that thrives on collaboration and innovation.
We offer a supportive environment where personal growth is just ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Do you want to be part of the core team building truly AI-native helpful experiences across the consumer space? Do you want to be at the cutting edge of what is next in the AI space but apply it to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Software Engineer, AI — Brooklyn, NY — Engineering — In office — Full-time.In the next 30 years, the world will transform every part of the built environment to be climate positive green infrastruc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Overview : serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Role : Collibra Data Quality Technical SME Location : New York, NY (3 days a week onsite) Job Type : Contract< / b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Are you ready to shape the future of authentication? Join 1Kosmos and help lead the next wave in identity assurance and passwordless innovation.
Kosmos is driving the future of identity security, em...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Interactive Brokers Group, Inc.Greenwich, CT, USA, with offices in over 15 countries.We have been at the forefront of financial innovation for over four decades, known for our cutting-edge technolo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Table" style="border-collapse : collapse; border : solid #a3a3a3 1.AI / ML Engineer < / t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Demonstrated experience with full BI Administration cycle.Experience with BI architecture (tables, attributes, facts, hierarchies, etc.
Proficient in designing and developing reporting solutions.Exp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Machine Learning Engineer (15265-1) Newark, NJ.Experience level : Mid-senior Experience required : 7 Years Education level : Bachelors degree Job function : Information Technology Industry : Information...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
AI Engineer
TranslucentNew York, NY, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Financial Statement Analytics Analyst
AIGMorris Plains, NJ, USserp_jobs.job_card.full_time
AI Engineer
OpenkyberNY, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Engineer
LifeMDNew York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Developer
Cortex consultants LLCNew York, NY, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
ETL Developer
GlobalchannelmanagementJersey City, New Jersey, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Database Development
TradeJobsWorkForce10040 New York, NY, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Ceded Re Reporting and Analytics Intern
Sompo InternationalGarden City, NY, USserp_jobs.job_card.part_time
AI Developer, Natural Language Processing
Apptad IncNew York, NY, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Quality Engineer
Akaasa TechnologiesNew York City, NY, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Agent Developer
AmsiveNew York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Applied AI Researcher
VerneekNew York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Software Engineer, AI
Epoch BiodesignNew York, NY, United Statesserp_jobs.job_card.full_time
Collibra Data Quality Technical SME
TekWissen LLCNew York City, NY, United Statesserp_jobs.job_card.temporary
serp_jobs.filters_job_card.quick_apply
Collibra Data Quality Technical SME
Saransh IncNew York, NY, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI / Machine Learning Engineer
1KosmosIselin, NJ, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Market Data Team LeadMumbai, India
Interactive BrokersOld Greenwich, CT, USserp_jobs.job_card.full_time
AI / ML Engineer
Akaasa TechnologiesNew York, NY, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
BI Developer
Two95 International Inc.New York, NY, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Machine Learning Engineer (15265-1) Newark, NJ
ESRhealthcareNewark, New Jersey, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply