Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsHialeah, Florida, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Hialeah, Florida, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Trainer

AI Trainer

VirtualVocationsDavie, Florida, United States
serp_jobs.job_card.full_time
A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationSunrise, Florida
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote AI Writing Evaluator

Remote AI Writing Evaluator

OutlierFort Lauderdale, FL, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Consumer Research Analyst (Hiring Immediately)

Remote Consumer Research Analyst (Hiring Immediately)

Product Review JobsMIAMI, FL, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Independent Product Evaluation Analyst (Hiring Immediately)

Independent Product Evaluation Analyst (Hiring Immediately)

Product Review JobsBOCA RATON, FL, United States
serp_jobs.job_card.full_time
Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Search Analyst

Search Analyst

VirtualVocationsHollywood, Florida, United States
serp_jobs.job_card.full_time
A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsFort Lauderdale, Florida, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Miami

AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Miami

MediabistroMiami, FL, United States
serp_jobs.job_card.full_time
Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging. Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Miami

Mercor is hiring : Audio Evaluation Expert - Fully Remote in Miami

MediabistroMiami, FL, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Market Intelligence Analyst

Market Intelligence Analyst

ONE Sotheby's International RealtyMiami, FL, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Market Intelligence & Research Analyst.South Florida luxury residential market, with a particular focus on condominium development and sales. This role requires an extensive understanding of the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationSunrise, Florida
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsHollywood, Florida, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in Miami

ICONMA is hiring : AI Multimedia Generation Product Evaluator in Miami

MediabistroMiami, FL, United States
serp_jobs.job_card.full_time
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location. The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationCoral Springs, Florida
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationMiami Beach, Florida
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Product Analyst

Product Analyst

VirtualVocationsHialeah, Florida, United States
serp_jobs.job_card.full_time
A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Visual Data Evaluator Job at Firstsource Solutions Ltd in Miami

Visual Data Evaluator Job at Firstsource Solutions Ltd in Miami

MediabistroMiami, FL, United States
serp_jobs.job_card.full_time
Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationMiami Beach, Florida
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Foundational AI Researcher

Foundational AI Researcher

AldeaMiami, FL, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Aldea is a multi-modal foundational AI company changing the scaling laws of AI.We believe that today’s models and model architectures present significant bottlenecks to the transformation of softwa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationWeston, Florida
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30