AI Agent Evaluation Analyst
VirtualVocationsGrand Rapids, Michigan, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Grand Rapids, Michigan, United States
Job_description.internal_linking.related_jobs
At SpartanNash, we deliver the ingredients for a better life through customer-focused innovation.We do this for our supply chain customers and U.
In fact, we see a day when each will say, "I can't l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
MatchPoint Solutions is a fast-growing, young, energetic global IT-Engineering services company with clients across the US.
We provide technology solutions to various clients like Uber, Robinhood, N...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Our growing company is seeking to hire a.Byron Center Michigan location.Founded in 1945, MEC is a manufacturer that provides a broad range of Metal Fabrication, Tube Bending, Machining, Welding, Co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Pilot CBP Air Interdiction Agent.Air and Marine Operations (AMO), a component of U.Customs and Border Protection (CBP), offers skilled Pilots interested in law enforcement an opportunity to work wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Reporting to the Director of Clinical Informatics for Analytics & Interfaces, the Clinical Informatics Data Analyst is responsible for the development, design, and maintenance of critical business ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
We are seeking a detail-oriented and highly knowledgeable Compliance Engineer with expertise in UL (Underwriters Laboratories) and ETL (Electrical Testing Laboratories) certification processes.The ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Get the Recognition Youve Earned.Build Your Future with NorthStar.Join NorthStar Anesthesia as we continue our exciting nationwide expansion! Were seeking passionate CRNAs to help deliver excellenc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Are you ready to launch your sales career as an SDR Prospector at a company with a great culture and where your hustle is rewarded? We're looking for a high-energy, go-getter to join our fast-growi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Job Title : Application System Analyst.Duration : 09 Months On W2 Contract.Client's laptop will be provided.Certified Grand Central and Prelude analyst to assist with strategic projects in 2025.Respo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
TravelNurseSource is working with Host Healthcare to find a qualified Telemetry RN in Allegan, Michigan, 49010!.Host Healthcare is an award-winning travel healthcare company with an immediate openi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Are you ready to launch your sales career as an SDR - Prospector at a company with a great culture and where your hustle is rewarded? We're looking for a high-energy, go-getter to join ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Join our distributed team as a Remote AI Task Reviewer and help improve AI systems by completing short, style online tasks.
This is an easy-to-learn role with full training and ongoing support.No pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Are you ready to launch your career in compensation with a role that blends data analysis, global impact, and continuous learning?.
Do you enjoy working in Excel, solving problems independently, and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Ethos Risk Services is continuing to expand our team of.Experienced Licensed Investigators.Ethos Risk is one of the largest and most respected fraud investigations businesses in the US.Join us in u...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Air and Marine Operations (AMO), a component of U.Customs and Border Protection (CBP) offers those with Merchant Mariner Credentials the exceptional opportunity of a career in law enforcement worki...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Analyst, Category
SpartanNashByron Center, MI, USserp_jobs.job_card.full_time
IT Analyst
Match Point SolutionsGrand Rapids, MI, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
SIOP Data Analyst
Mayville Engineering Company, Inc.Byron Center, MI, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Air Interdiction Agent
U.S. Customs and Border ProtectionRavenna, MI, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationGrand Rapids, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Clinical Informatics Analyst (BI Engineer / SQL Programming) - REMOTE
Molina HealthcareGrand Rapids, MI, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Compliance Engineer - UL
DekkoGrand Rapids, MI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
CRNA - Anesthesiology job available in Fremont, Michigan
NorthStar AnesthesiaFremont, MI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationWyoming, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
SDR Prospector
Applied InnovationGrand Rapids, MI, USserp_jobs.job_card.full_time
EPIC Grand Central and Prelude analyst
Sunrise SystemsGrand Rapids, Michigan, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationWyoming, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationKentwood, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Travel Nurse RN - Telemetry - $1,683 to $1,832 per week in Allegan, MI
TravelNurseSourceAllegan, MI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationKentwood, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
SDR – Prospector
Applied InnovationGrand Rapids, MI, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote AI Task Reviewer – Flexible Hours, No Experience Needed
RLDGHopkins, Michigan, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Compensation Analyst
SteelcaseGrand Rapids, MI, United Statesserp_jobs.job_card.full_time
Investigator
Ethos Risk ServicesGrand Rapids, MI, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Marine Interdiction Agent
U.S. Customs and Border ProtectionLowell, MI, United Statesserp_jobs.job_card.full_time