AI Agent Evaluation Analyst
VirtualVocationsClearwater, Florida, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Clearwater, Florida, United States
Job_description.internal_linking.related_jobs
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Zelis is modernizing the healthcare financial experience across payers, providers, and healthcare consumers.We serve more than 750 payers, including the top five national health plans, regional hea...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
AI Engineer, Applications Development.White & Case is an elite global law firm serving leading companies, financial institutions and governments worldwide.
Our long history as an international firm ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Leidos Is Hiring : Senior Level Targeting Analyst / Team Lead - Shape Strategy, Influence Outcomes.Are you ready to make a global impact from behind the scenes? Leidos is looking for a.Combatant Comm...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
If you are interested in applying for this job, please make sure you meet the following requirements as listed below.At USAA, our mission is to empower our members to achieve financial security thr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!.
As a Luxury Brand Evaluator, you will step into the worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join Our Elite Team as an All-Source Intelligence Analyst!.At Leidos, we believe that every intelligence report, every analytical insight, and every strategic brief can make a difference in shaping...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Senior AI Engineer, Applications Integrations.White & Case is an elite global law firm serving leading companies, financial institutions and governments worldwide.
Our long history as an internation...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Zelis is modernizing the healthcare financial experience across payers, providers, and healthcare consumers.We serve more than 750 payers, including the top five national health plans, regional hea...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Become a Luxury Brand Evaluator in San Juan, PR - Apply Now.Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Equal Employment Opportunity / M / F / disability / protected veteran status.All-Source Intelligence Analyst.EKS Group, LLC is an Equal Opportunity Employer (EEO).
All positions require successful completio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationPinellas Park, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Salesforce Tech Lead - Data & AI
Zelis Healthcare, LLCSt. Petersburg, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Engineer, Applications Development
White & Case LLPTampa, FL, United Statesserp_jobs.job_card.full_time
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Tampa
MediabistroTampa, FL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Team Lead / Sr Targeting Analyst
Leidos IncTampa, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationClearwater, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Principal Data Engineer - Identity Fraud Solutions (TAMPA)
UsaaTampa, FL, USserp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator Automotive Project - Gulf Coast (SW & Tampa Bay
CXGClearwater, FL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Firstsource Solutions Ltd is hiring : Visual Data Evaluator in Tampa
MediabistroTampa, FL, United Statesserp_jobs.job_card.full_time
Become a Luxury Brand Evaluator in Tampa, FL- Apply Now
CXGClearwater, FL, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
English Writing and Content Reviewing Expertise Sought for AI Training
OutlierSt. Petersburg, FL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
All Source Intelligence Analyst
Leidos IncTampa, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior AI Engineer, Applications Integrations
White & Case LLPTampa, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationClearwater, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierSt. Petersburg, FL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Director - Analytics & AI Enablement
Zelis Healthcare, LLCSt. Petersburg, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in Tampa
MediabistroTampa, FL, United Statesserp_jobs.job_card.full_time
Hireio, Inc. is hiring : AI Communication Quality & Culture Evaluator in Tampa
MediabistroTampa, FL, United Statesserp_jobs.job_card.full_time
CXG is hiring : Become a Luxury Brand Evaluator in San Juan, PR- Apply Now in Tam
MediabistroTampa, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
All-Source Intelligence Analyst
EKS GroupTampa, FL, United Statesserp_jobs.job_card.full_time