Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsLansing, Michigan, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Lansing, Michigan, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Senior Quality Analyst

Senior Quality Analyst

Hope NetworkLansing, MI, US
serp_jobs.job_card.full_time
At Hope Network, over 2,800 compassionate professionals serve individuals across 280+ locations statewideeach playing a vital role in creating powerful comebacks. Whether through hands-on care or es...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Business Analyst 5

Business Analyst 5

Sunrise SystemsLansing, Michigan, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Location : Lansing, MI (Hybrid).Duration : 12 months of contract can be extended if desired.Seeking Software Business Analyst (BA) to help maintain a web application supporting the Client, Office of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
IAM Helpdesk Analyst X2 Openings

IAM Helpdesk Analyst X2 Openings

TEKsystemsLansing, MI, United States
serp_jobs.job_card.full_time
In either an Identity & Access Mgmt.Role or combination of Helpdesk with IAM responsibilities.ServiceNow • ITSM / Ticketing + Triaging IAM Support Tickets related to user & network access (managing gr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
Remote Brand Research Contributor (Hiring Immediately)

Remote Brand Research Contributor (Hiring Immediately)

Earn HausEast Lansing, Michigan, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time +2
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
META is hiring : UX Researcher, Qualitative in Lansing

META is hiring : UX Researcher, Qualitative in Lansing

MediabistroLansing, MI, United States
serp_jobs.job_card.full_time
Our UX Research team is designing for the broad spectrum of human needs, which requires us to understand the behaviors of the people behind them. Our researchers tackle some of the most complex chal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
i-team Data Analytics Manager, Lansing (Innovation Teams, Lansing)

i-team Data Analytics Manager, Lansing (Innovation Teams, Lansing)

Johns Hopkins UniversityLansing, MI, United States
serp_jobs.job_card.full_time
The Bloomberg Center for Public Innovation at Johns Hopkins University (the Center) seeks an.Data Analytics Manager, Lansing. Lansing Innovation Team ("i-team").Innovation Teams unlock creativity fr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Business Analyst 5

Business Analyst 5

Global Information TechnologyLansing, MI, USA
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Job Location : Lansing, MI (Hybrid).As-Is and To-Be process flows or equivalent business / IT process flows.Waterfall and Agile methodology. Epics, Features, and User Stories.Microsoft office, includin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Largeton Group is hiring : UI- UX Analyst in Lansing

Largeton Group is hiring : UI- UX Analyst in Lansing

MediabistroLansing, MI, United States
serp_jobs.job_card.full_time
Responsible for establishing and executing the overall application look, feel, and user interface design for IT solutions. Collaborates with Business Analysts and Technical Leads to deliver solution...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationEast Lansing, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Freelance Luxury Brand Evaluator - Southeast & Central Michigan - Apply Now

Freelance Luxury Brand Evaluator - Southeast & Central Michigan - Apply Now

CXGOkemos, MI, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Transcript Evaluator - Owosso, MI

Transcript Evaluator - Owosso, MI

Baker CollegeOwosso, MI, United States
serp_jobs.job_card.full_time
Owosso, Michigan, United States.Discover the opportunity to join Baker College, honored as one of the 2024 Best and Brightest Workplaces in West Michigan, Metro Detroit and Nationally!.Join the Off...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Business Analyst - Mobile

Business Analyst - Mobile

ServiceMasterLansing, MI, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
ServiceMaster employs empowered and engaged teams, delivering growth in an ever-evolving world.Our goal is to double in size over the next few years, which means ambition and risk-taking are part o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationLansing, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationEast Lansing, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Business Analyst 4

Business Analyst 4

Sunrise SystemsLansing, Michigan, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Job Title : Business Analyst 4, Client Agency Services Job ID : 24-04843 Location : Lansing, MI (Hybrid) Duration : 12 months with possibility of extension. Clear and concise communication skills requir...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Work at Home Data Entry Agent - Part Time

Work at Home Data Entry Agent - Part Time

UsaSurveyJobBoardLansing, Michigan, United States, 48906
serp_jobs.filters.remote
serp_jobs.job_card.part_time
Work at Home Data Entry Agent - Part Time.Earn at Home by Taking Polls - Data Entry Clerk - Customer Service Rep - Work at Home & Part Time. We offer you the opportunity to.At this job, you will be ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
User Experience Analyst

User Experience Analyst

MediabistroLansing, MI, United States
serp_jobs.job_card.full_time
A career at Auto-Owners is challenging and rewarding.Our group of caring associates create financial security by helping individuals and businesses make a new start when a loss occurs.Job Descripti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationLansing, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationLansing, Michigan
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Content Manager Job at ASM Research, An Accenture Federal Services Company in La

Content Manager Job at ASM Research, An Accenture Federal Services Company in La

MediabistroLansing, MI, United States
serp_jobs.job_card.full_time
Responsible for managing a team of Content Research Analysts that creates new content, performs content data entry, designs content, oversees processing of daily escalations, research requests, spe...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days