AI Evaluation Analyst
VirtualVocationsVan Nuys, California, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Van Nuys, California, United States
Job_description.internal_linking.related_jobs
Data Modeler Analysis, Design, Architecture, Customer coordination Data Modeler - Erwin, Data Vault, Insurance Domain (Policy & Qu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Pelletier & Leo is a trusted accounting and advisory firm dedicated to providing proactive solutions that help clients achieve their goals.
This role is perfect for a professional who thrives at...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Hybrid in the Pasadena, California area.Salary : $175,000 - $230,000 base + Bonus.Candidates must be okay with up to 30% travel across the United States.
This is a rare opportunity to launch and lead...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
This individual will be responsible for design, build, and maintenance of machine learning models.The MLOps Engineer will play an integral role in implementing artificial intelligence solutions the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Helping Our Most Vulnerable Change Their Life Stories.Volunteers of America is a non-profit human services organization committed to serving people in need, strengthening families, and building com...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Hi, Hope you are doing well, I was trying to reach you for below mentioned job role, let me know if you are ava...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Senior Data Modeler Location : Los Angeles, California, (Day one Onsite) Duration : 12+ Months&l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Our client, a dynamic player in the dietary supplement industry, is seeking a Data Reporting Specialist to join its team.
As a Data Reporting Specialist, you will be part of the P&IL department supp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Lead the analysis, design, and architecture of enterprise data solutions in the insurance domain.Collaborate with stakeholders to gather requirements and convert business needs into scalable data m...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Machine Learning Scientist with Audio DSP background Collaborate with senior machine learning researchers, engineers and speech processing researchers.
Provide technical expertise to address supervi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Under the supervision of the Director, Data & Process Management, support the overall objectives of Joni and Friends’ Development department.
Perform duties and responsibilities including,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Under the supervision of the Data Batching Team Lead, support the overall objectives of Joni and Friends.Perform duties and responsibilities including, but not limited to : .Daily Scanning of Checks ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Data Engineer Job DescriptionJob Responsibilities : .Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
Ensure data quality, integrity, and secu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At TWG Group Holdings, LLC ("TWG Global"), we drive innovation and business transformation across a range of industries, including financial services, insurance, technology, media, and sports, by l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Primary Skills : Machine Learning (Expert), Ad Platform (Intermediate), Microservices (Advanced), Algorithm Development (Expert), Big Data (Advanced).
Location : Santa Monica / SFO / Santa Clara CA (Hybri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Database Development Job Duties : Database Developers are responsible for data gathering before development of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Our client is seeking a Machine Learning Engineer to join their team! This position is located in Burbank, California.Design, develop, debug, and deploy advanced machine learning applications using...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Changing Lives Productions is seeking an Audience Growth Lead to join our growing Data & Insights team.Reporting to the Head of Audience Development & Insights, this role will act as a growth hacke...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Responsibilities : Own and manage the full project lifecyclefrom initiation to deliveryacross multiple, concurrent AI product development workstreams.
Create and maintain detailed project plans, sche...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
This role is not eligible for work visa sponsorship).Caldera Medical’s Mission - To Improve the Quality of Life for Women!.
Message from the Hiring Manager : .The R&D Sustaining Engineer wil...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Data Modeler
Purple DriveCULVER CITY, California, USAserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Sage Intacct Implementor
Pelletier & Leo, LLPCity of Industry, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Artificial Intelligence Consultant
HarnhamPasadena, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Machine Learning Engineer (Remote)
Irvine Technology CorporationLos Angeles, CA, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Quality Specialist
Volunteers of America Los AngelesLos Angeles, CA, USserp_jobs.job_card.full_time
Technical Architect (AI)
Edge GlobalValencia, CA, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Senior Data Modeler
Lorven technologiesLos Angeles, CA, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Data Reporting Specialist
ManpowerSanta Clarita, CA, United Statesserp_jobs.job_card.full_time
Data modeler
Purple DriveCULVER CITY, California, USAserp_jobs.job_card.full_time
Machine Learning Scientist with Audio DSP background Job at punchcard in Pasaden
MediabistroPasadena, CA, United Statesserp_jobs.job_card.full_time
Team Lead, Data Batching
Joni and FriendsAgoura Hills, CA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Analytics Specialist
Joni and FriendsAgoura Hills, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Engineer
Wallbanger AcademyCovina, CA, USserp_jobs.job_card.full_time
Senior Associate, Machine Learning Engineer
TWG Global AISanta Monica, CA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Machine Learning Engineer : 24-02866- (No C2C)
Akraya IncSanta Monica, California, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Database Development
TradeJobsWorkForce91335 Los Angeles, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Machine Learning Engineer
KellyMitchell GroupBurbank, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Audience Growth, Data / Insights Lead
Changing Lives ProductionsBurbank, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Project Manager with AI / ML
Cynet SystemsWoodland Hills, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
R&D Sustaining Engineer
Caldera MedicalWestlake Village, CA, USserp_jobs.job_card.full_time