AI Agent Evaluation Analyst
VirtualVocationsTallahassee, Florida, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Tallahassee, Florida, United States
Job_description.internal_linking.related_jobs
Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
General Characteristics Maintains a strong understanding of the enterprise’s IT systems and architectures.Assists in the analysis of the requirements for the enterprise and applying emerging ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
Online Product Evaluation Specialist (Hiring Immediately)
Product Review JobsMONTICELLO, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationTallahassee, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Online Consumer Product Evaluator (Hiring Immediately)
Product Review JobsTALLAHASSEE, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Product Evaluation Specialist (Hiring Immediately)
Product Review JobsTALLAHASSEE, FL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Freelance Market Research Participant (Hiring Immediately)
Product Review JobsTALLAHASSEE, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Freelance Consumer Insights Evaluator (Hiring Immediately)
Product Review JobsPANACEA, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Online Market Research Associate (Hiring Immediately)
Product Review JobsTALLAHASSEE, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationTallahassee, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationTallahassee, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Online Consumer Products Evaluator (Hiring Immediately)
Product Review JobsQUINCY, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Virtual Consumer Product Evaluator (Hiring Immediately)
Product Review JobsTALLAHASSEE, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Independent Product Evaluation Specialist (Hiring Immediately)
Product Review JobsTALLAHASSEE, FL, United Statesserp_jobs.job_card.full_time
Technology Research Analyst
Connective Business SolutionTallahassee, FL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Freelance Consumer Insights Evaluator (Hiring Immediately) (Panacea)
Product Review JobsPanacea, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Independent Product Evaluator (Hiring Immediately)
Product Review JobsTALLAHASSEE, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationTallahassee, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Virtual Product Evaluation Specialist (Hiring Immediately)
Product Review JobsSOPCHOPPY, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Product Evaluation Specialist (Hiring Immediately)
Product Review JobsTALLAHASSEE, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationTallahassee, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Freelance Consumer Product Evaluator (Hiring Immediately)
Product Review JobsMONTICELLO, FL, United Statesserp_jobs.job_card.full_time