AI Evaluation Analyst
VirtualVocationsWarren, Michigan, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Warren, Michigan, United States
Job_description.internal_linking.related_jobs
Title : Software Deployment Analyst.Location : Warren, MI or Pontiac, MI (onsite 5x per week).Visa : Must be US Citizen or Green Card Holder.
NO C2C or 3RD PARTIES - W2 ONLY • • • • • •.MUST have solid test...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment that puts you in control? This position offers you the flexibility to set your own sc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Help shape the mathematical core of next-generation intelligent systems — from strategic vision to edge execution.Remote / Hybrid / On-site (flexible based on candidate profile).Full-Time / Contrac...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Have you ever wanted to have your retail experiences heard by the large corporations? ISC-CX may be able to give you that voice! We are looking for Retail Service Evaluators for a large ongoing pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Help shape the mathematical core of next-generation intelligent systems — from strategic vision to edge execution.Remote / Hybrid / On-site (flexible based on candidate profile).Full-Time / Contrac...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment that puts you in control? This position offers you the flexibility to set your own sc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment that puts you in control? This position offers you the flexibility to set your own sc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
The Data Validation Analyst position is a role within Loan Closing and is responsible for reviewing data contained in the loan approval document to confirm integrity of data entered in bank systems...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Are you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Software Deployment Analyst
TEK Staffing Solutions Inc.Warren, MI, USserp_jobs.job_card.temporary
- serp_jobs.job_card.promoted
Online Data Analyst | Part-time French Speaker - TELUS Digital AI Data Solutions
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Online Data Analyst | Part-time in Canada - TELUS Digital AI Data Solutions
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Media Search Analyst - Entry Level, Remote - windsor
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
English Speakers - Online Data Analyst (Freelance, Part-time)
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
: Lead Applied Mathematician – AI Algorithm Development for Defense Vision Systems - VisionWave Holdings
VisionWave Holdingswindsor, on, caserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Retail Evaluator
ISC-CXOldcastle, Ontario, Canadaserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
French Speakers Online Data Analyst (WFH, Freelance) - TELUS Digital AI Data Solutions
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
: Lead Applied Mathematician – AI Algorithm Development for Defense Vision Systems
VisionWave Holdingswindsor, on, caserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Media Search Analyst - Entry Level, Remote - TELUS Digital AI Data Solutions
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Online Data Analyst - Entry Level, Remote (French Speaker)
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Online Data Analyst - Entry Level, Remote (French Speaker) - windsor
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Remote French Speakers (Online Data Analyst)
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Media Search Analyst - Entry Level, Remote
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
WFH English Speakers (Online Data Analyst) - TELUS Digital AI Data Solutions
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Remote French Speakers (Online Data Analyst) - TELUS Digital AI Data Solutions
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Online Data Analyst | Part-time French Speaker
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Online Data Analyst - Entry Level, Remote (French Speaker) - TELUS Digital AI Data Solutions
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Data Validation Analyst
ComericaNovi, MI, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
French Speakers Online Data Analyst (WFH, Freelance)
TELUS Digital AI Data Solutionswindsor, on, caserp_jobs.filters.remote
serp_jobs.job_card.part_time