AI Evaluation Analyst
VirtualVocationsStockton, California, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Stockton, California, United States
Job_description.internal_linking.related_jobs
ESSENTIAL JOB FUNCTIONS Analyzes global markets for IT Services, servers, storage, backup, IT security, productivity software, remote monitoring services, hyperconvergence and IoT.Studies SMB and m...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
QA Analyst Remote Job Duties : • Partner with the product and engineering team to understand project o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Join our growing team as a Netflix Data Analyst to perform daily responsibilities with dedication.Provide excellent interactions with customers and colleagues.
Provide excellent interactions with cu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Research Assistant Job Duties : Generates hypotheses and designs and performs experiments to test th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Business Analyst Job Duties : Elicits, analyzes, specifies, and validates the business needs of st...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Conduct thorough analysis of financial statements and assessment of credit requests, including new requests, changed requests, refinancing and annual due diligence Provide recommendations tied to a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Documentation for reporting requirements.Create testing scenarios for pre-UAT and UAT for the reporting.Support execution of scenarios & testing during UAT with the Business.Maintain the Issues...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Under general guidance, the Administrative Research Associate III works closely with PI, providing technical and / or administrative support in large or multi-project oriented labs.May be requested b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
The Customer Support Analyst is responsible for the duties listed below and is the support staff supporting our customers' needs, along with any additional duties as assigned by management.Strategi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Operations Analyst Job Duties : Identifies project requirements by interviewing customers; analyzing ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Join us and make YOUR mark on the World!.Are you interested in joining some of the brightest talent in the world to strengthen the United States' security? Come join Lawrence Livermore National Lab...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Want to make extra money on YOUR schedule? Join our exclusive list of research study participants and .Perfect for anyone seeking remote, part-time, or temporary work, these opportunities require n...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Join us and make YOUR mark on the World! Are you interested in joining some of the brightest talent in the world to strengthen the United States' security? Come join Lawrence Livermore National Lab...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Job Title : IT Information Analyst, (Contractor).Duration : 09 months on W2 Contract.IT Product Specialist (Remote Bay Area Candidates Only).
Fast Learner, Attention to Detail, Proficiency in Micros...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!.
As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Documentation for reporting requirements.Create testing scenarios for pre-UAT and UAT for the reporting.Support execution of scenarios & testing during UAT with the Business.Maintain the Issues Tra...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
AGE Solutions is a premier technology and professional services company, providing in-depth consulting, advanced technology solutions, and essential services throughout the U.Prioritizing innovatio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Analyst
TradeJobsWorkforce94206 Sacramento, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
QA Analyst - Remote
TradeJobsWorkForce95832 Sacramento, CA, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
Become a Luxury Brand Evaluator in Livermore, CA- Apply Now
CXGLivermore, CA, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Netflix Data Analyst
TradeJobsWorkforce95828 Florin, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Research Assistant
TradeJobsWorkForce94283 Sacramento, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Business Analyst
TradeJobsWorkforce95828 Florin, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Credit Analyst
TradeJobsWorkForce95829 Vineyard, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Business Analyst
Bayside SolutionsTracy, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Research Associate III - Computational Biomedicine
CEDARS-SINAIModesto, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Customer Support Analyst
Pratt IndustriesStockton, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Operations Analyst
TradeJobsWorkForce95823 Sacramento, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Financial Analyst
Lawrence Livermore National LaboratoryLivermore, CA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Hiring : Part-Time Research Participants (Pay up to $790 / wk)
MaxionStockton, CA, United Statesserp_jobs.job_card.full_time +2
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationElk Grove, CA, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Financial Analyst
Clearance JobsLivermore, CA, USserp_jobs.job_card.full_time
IT Information Analyst
Sunrise SystemsStockton, California, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Become a Luxury Brand Evaluator in Santa Monica, CA - Apply Now
CXGBrentwood, CA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Freelance Luxury Brand Evaluator Automotive Project - East Bay & NorCal Valley
CXGLivermore, CA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Business Analyst (Tracy)
Bayside SolutionsTracy, CA, United Statesserp_jobs.job_card.full_time
Audio Visual Engineer (Future Opportunity) Job at Age Solutions in Tracy
MediabistroTracy, CA, United Statesserp_jobs.job_card.full_time