AI Agent Evaluation Analyst
VirtualVocationsDetroit, Michigan, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Detroit, Michigan, United States
Job_description.internal_linking.related_jobs A company is looking for a Principal AI Sustaining Engineer for its AI Center of Excellence, working remotely.Key Responsibilities Represent expertise in AI and Machine Learning solutions to supp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
If you’re passionate about making a difference and want to turn that passion into a fulfilling career, we want to hear from you.
A Sales Representative plays a crucial role in driving business...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Join our distributed team as a Remote AI Task Reviewer and help improve AI systems by completing short, style online tasks.
This is an easy-to-learn role with full training and ongoing support.No pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment that puts you in control? This position offers you the flexibility to set your own sc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Description Medical Device Sales - Paid Internship Looking for a rewarding and lucrative career in the medical sales industry? Our paid Internship may be the right path for you! Here are just some ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Content Editor to join their SEO team in a remote, full-time capacity.Key Responsibilities Proofread and fact-check AI-assisted content for accuracy, clarity, and c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment that puts you in control? This position offers you the flexibility to set your own sc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Senior AI Solutions Consultant.Range applies to US candidates only) + Benefits / Variable Comp / Equity - Range may vary based on experience.
Vision, Medical, Life, Dental, 401K.A Senior AI Solutions Co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Sustaining Engineer Principal
VirtualVocationsWarren, Michigan, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationDearborn Heights, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Evaluation Analyst
VirtualVocationsDetroit, Michigan, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Generative AI Specialist
VirtualVocationsWarren, Michigan, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierWarren, MI, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationSterling Heights, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationDearborn Heights, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Sales Representative
Altig / AO Globe LifeAmherstburg, Ontarioserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Task Reviewer – Flexible Hours, No Experience Needed
RLDGGrosse Ile, Michigan, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Media Search Analyst - Entry Level, Remote - TELUS Digital AI Data Solutions
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Medical Device Sales – Paid Internship
Medical Sales CollegeGrosse Ile, Michigan, USserp_jobs.job_card.internship
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Content Editor
VirtualVocationsDetroit, Michigan, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Adoption Solutions Architect
VirtualVocationsDetroit, Michigan, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Media Search Analyst - Entry Level, Remote
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Search Analyst
VirtualVocationsDetroit, Michigan, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsDetroit, Michigan, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior AI Solutions Consultant
OneStream SoftwareBirmingham, MI, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationNovi, Michiganserp_jobs.filters.remote
serp_jobs.job_card.full_time +1