AI Evaluation Analyst
VirtualVocationsOrange, California, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Orange, California, United States
Job_description.internal_linking.related_jobs
EVPassport is the EV Charging hardware and software platform for purpose-driven organizations.Brands committed to sustainability rely on EVPassport to provide their customers with the most seamless...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
About the client : Our client is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, acce.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not.
Today SpaceX is actively developing the technolo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Fair Labor Standard Act Classification : .Chapman University is required to provide a reasonable estimate of the compensation range for this position.
This range takes into account a variety of factor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
International Research Analyst.Kayne Anderson Rudnick Investment, a Registered Investment Advisor based in Los Angeles, is currently searching for an International Research Analyst with a small / mid...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Municipal Credit Research Analyst.PIMCO is a global leader in active fixed income with deep expertise across public and private markets.
We invest our clients' capital across a range of fixed income...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
USA Remote (Prefer PST Time Zone).The Technical Research Associate is a non-traditional role in which you will work on our AI data collection team.
You have a background in QA or data analysis and a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Strategy And Operations Analyst, Search And Gemini Partnerships.This role may also be located in our Playa Vista, CA campus.
Applicants in the County of Los Angeles : Qualified applications with arre...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Company Overview : Causeway Capital Management LLC provides equity investment management services primarily to institutional clients including corporations, pension plans, sovereign wealth funds, su...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda.As Research Lead - AI Cyb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour About the California Policy LabThe California Policy Lab generates research insights for government impact.Through hands-on partnerships with government agencies, CPL performs rigorous research acr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
BLDG Partners LLC is a Southern California-based real estate investment firm founded in 2010, focused on the preservation and creation of workforce and affordable housing.We pursue opportunities to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days USA Remote (Prefer PST Time Zone).This is a non-traditional Human Data Research Analyst role working with an exciting AI start-up based in San Francisco.
In this role your responsibilities will invo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
At TaxRise, we don't just provide tax relief services; we provide hope, stability, and solutions to individuals and families facing financial uncertainty.
Our team is passionate about reshaping ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Strategy Analyst
EVPassportSanta Monica, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Project Manager
E-SolutionsTorrance, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationNorwalk, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Intelligence Analyst
SpaceXInglewood, CA, USserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Data and Systems Analyst
InsideHigherEdOrange, California, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
International Research Equity Analyst
Virtus Investment PartnersLos Angeles, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Credit Research Analyst, Municipals
PIMCONewport Coast, CA, USserp_jobs.job_card.full_time
Technical Research Associate - AI
Keywords StudiosLos Angeles, CA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationDiamond Bar, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Strategy and Operations Analyst, Search and Gemini Partnerships
GoogleLos Angeles, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Research Analyst Global Equities (Consumer Staples)
Causeway Capital ManagementLos Angeles, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationBrea, Californiaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Research Lead - AI Cyber Testing & Evaluation
RAND CorporationSanta Monica, CA, United Statesserp_jobs.job_card.temporary
Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles
MediabistroLos Angeles, CA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Remote Senior Financial Analyst - AI Trainer (Arcadia)
Data AnnotationArcadia, CA, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Research Data Analyst 3
InsideHigherEdLos Angeles, California, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Acquisition Analyst / Associate (Beverly Hills)
BLDG PartnersBeverly Hills, CA, USserp_jobs.job_card.part_time
Human Data Research Analyst
Keywords StudiosLos Angeles, CA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Los Angeles
MediabistroLos Angeles, CA, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Analyst
TaxRiseIrvine, CA, USserp_jobs.job_card.full_time