AI Evaluation Analyst
VirtualVocationsPompano Beach, Florida, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Pompano Beach, Florida, United States
Job_description.internal_linking.related_jobs A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Data Analyst 2 to work remotely.Key Responsibilities Assist in designing and implementing analytics platform components using Microsoft Azure, Databricks, and PowerBI ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Quality Vendor Economics Analyst III.Key Responsibilities Assess financial opportunities related to new and existing Quality vendor contracts Document vendor processes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Director of Applied AI.Key Responsibilities Lead the strategy and execution of applied AI initiatives across the organization Develop training programs to enhance AI f...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Business Data Analyst II.Key Responsibilities Analyze complex business problems using data to provide insights for decision-makers Deliver tailored insights focusing o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
Generative AI Specialist
VirtualVocationsPompano Beach, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Analyst 2
VirtualVocationsBoca Raton, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationMiramar, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Search Analyst
VirtualVocationsDavie, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Quality Vendor Economics Analyst
VirtualVocationsDavie, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Adoption Solutions Architect
VirtualVocationsTamarac, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Agent Evaluation Analyst
VirtualVocationsHialeah, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Independent Product Evaluation Analyst (Hiring Immediately)
Product Review JobsBOCA RATON, FL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Director of Applied AI
VirtualVocationsDavie, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationBoca Raton, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationWellington, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer
Data AnnotationWellington, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Product Analyst
VirtualVocationsBoca Raton, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Trainer
VirtualVocationsHialeah, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationDelray Beach, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Business Data Analyst
VirtualVocationsHollywood, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierHialeah, FL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationTamarac, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1