AI Agent Evaluation Analyst
VirtualVocationsAppleton, Wisconsin, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Appleton, Wisconsin, United States
Job_description.internal_linking.related_jobs
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
AlliedTravelCareers is working with Host Healthcare to find a qualified CT Tech in Pewaukee, Wisconsin, 53072!.Host Healthcare is an award-winning travel healthcare company with an immediate openin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 AlliedTravelCareers is working with Fusion Medical Staffing to find a qualified CT Tech in Elkhorn, Wisconsin, 53121!.Facility in Elkhorn, Wisconsin.
Fusion Medical Staffing is seeking a skilled CT ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days AlliedTravelCareers is working with LRS Healthcare to find a qualified CT Tech in Boscobel, Wisconsin, 53805!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits packag...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days AlliedTravelCareers is working with Medical Solutions to find a qualified CT Tech in Milwaukee, Wisconsin, 53211!.A facility in Milwaukee, WI is seeking its next amazing CT Technologist (Computed T...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days AlliedTravelCareers is working with Host Healthcare to find a qualified CT Tech in Portage, Wisconsin, 53901!.Host Healthcare is an award-winning travel healthcare company with an immediate opening...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 AlliedTravelCareers is working with Host Healthcare to find a qualified CT Tech in Boscobel, Wisconsin, 53805!.Host Healthcare is an award-winning travel healthcare company with an immediate openin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Competitive pay and benefits, including Day 1 Health & Wellness Benefits, Employee Stock Purchase Plan, 401K Employer Matching, Education Assistance, Paid Time Off, and much more.Growth opportuniti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days AlliedTravelCareers is working with LRS Healthcare to find a qualified CT Tech in Wausau, Wisconsin, 54401!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits package,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 AlliedTravelCareers is working with Host Healthcare to find a qualified CT Tech in Milwaukee, Wisconsin, 53215!.Host Healthcare is an award-winning travel healthcare company with an immediate openi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierGreen Bay, WI, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationGreen Bay, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer
Data AnnotationOshkosh, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
English Writing and Content Reviewing Expertise Sought for AI Training
OutlierGreen Bay, WI, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,643 to $2,833 per week in Pewaukee, WI
AlliedTravelCareersGreen Bay, Wisconsin, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,437 to $2,801 per week in Elkhorn, WI
AlliedTravelCareersGreen Bay, Wisconsin, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,356 to $2,612 per week in Boscobel, WI
AlliedTravelCareersGreen Bay, Wisconsin, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,295 per week in Milwaukee, WI
AlliedTravelCareersGreen Bay, Wisconsin, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
English Writing Editor - Part Time Work From Home
OutlierGreen Bay, WI, United Statesserp_jobs.filters.remote
serp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,958 to $3,148 per week in Portage, WI
AlliedTravelCareersGreen Bay, Wisconsin, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,447 to $2,626 per week in Boscobel, WI
AlliedTravelCareersGreen Bay, Wisconsin, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationGreen Bay, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationOshkosh, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Buyer - Procurement Specialist - Purchasing Agent
Performance FoodserviceShawano, WI, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,693 to $2,985 per week in Wausau, WI
AlliedTravelCareersGreen Bay, Wisconsin, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2,958 to $3,148 per week in Milwaukee, WI
AlliedTravelCareersGreen Bay, Wisconsin, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationGreen Bay, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationGreen Bay, Wisconsinserp_jobs.filters.remote
serp_jobs.job_card.full_time +1