AI Agent Evaluation Analyst
VirtualVocationsTampa, Florida, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Tampa, Florida, United States
Job_description.internal_linking.related_jobs
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Equal Employment Opportunity / M / F / disability / protected veteran status.All-Source Intelligence Analyst.EKS Group, LLC is an Equal Opportunity Employer (EEO).
All positions require successful completio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!.
As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Become a Luxury Brand Evaluator in San Juan, PR - Apply Now.Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationPinellas Park, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Remote Market Research Analyst (Hiring Immediately) (Anna Maria)
Product Review JobsAnna Maria, FL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Tampa
MediabistroTampa, FL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Market Research Analyst (Hiring Immediately)
Product Review JobsANNA MARIA, FL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationClearwater, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Online Market Research Evaluator (Hiring Immediately)
Product Review JobsWIMAUMA, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Market Research Product Evaluator (Hiring Immediately) (Lakeland)
Product Review JobsLakeland, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Online Market Research Evaluator (Hiring Immediately) (Wimauma)
Product Review JobsWimauma, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Online Market Research Analyst (Hiring Immediately) (Plant City)
Product Review JobsPlant City, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationSt. Petersburg, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
All-Source Intelligence Analyst
EKS GroupTampa, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Online Product Evaluation Associate (Hiring Immediately) (St Petersburg)
Product Review JobsSt Petersburg, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationSt. Petersburg, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Market Research Product Evaluator (Hiring Immediately)
Product Review JobsLAKELAND, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationPinellas Park, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
Hireio, Inc. is hiring : AI Communication Quality & Culture Evaluator in Tampa
MediabistroTampa, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Online Market Research Analyst (Hiring Immediately)
Product Review JobsPLANT CITY, FL, United Statesserp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator Automotive Project - Gulf Coast (SW & Tampa Bay
CXGTampa, FL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
CXG is hiring : Become a Luxury Brand Evaluator in San Juan, PR- Apply Now in Tam
MediabistroTampa, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Consumer Insights Evaluator (Hiring Immediately)
Product Review JobsAPOLLO BEACH, FL, United Statesserp_jobs.job_card.full_time