AI Evaluation Analyst
VirtualVocationsFort Myers, Florida, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Fort Myers, Florida, United States
Job_description.internal_linking.related_jobs A company is looking for an AI Content Editor to join their SEO team in a remote, full-time capacity.Key Responsibilities Proofread and fact-check AI-assisted content for accuracy, clarity, and c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Business Data Analyst II.Key Responsibilities Analyze complex business problems using data to provide insights for decision-makers Deliver tailored insights focusing o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Senior Conversion Rate Optimization (CRO) Analyst to drive optimization initiatives and enhance user experience across digital properties.
Key Responsibilities Own key c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Business Insights Analyst (remote / work from home).Key Responsibilities Collaborate with project team members and business units to achieve strategic goals Evaluate and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an Advanced Analytics Expert to collaborate with teams and utilize advanced analytics for data-driven decision-making.
Key Responsibilities Builds advanced analytics solut...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a MEDITECH Analyst - Advanced Clinicals.Key Responsibilities Support the installation, configuration, and optimization of MEDITECH Advanced Clinicals modules Collaborate...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Staff AI & ML Engineer to build and own end-to-end applications across the business.Key Responsibilities Build technical solutions using appropriate frameworks and data...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Data Analyst to support its growth and drive insights through data analytics.Key Responsibilities Own the end-to-end analytics process from data collection to visualiza...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Architect to design and implement advanced AI solutions for clients.Key Responsibilities Design end-to-end AI architectures, including data pipelines and model depl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI / ML Engineer (REMOTE).Key Responsibilities Develop, train, evaluate, and deploy machine learning models focused on computer vision and predictive analytics Optimize...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Principal Data Analyst.Key Responsibilities Oversee data aggregation, transformation, and validation workflows for accuracy and consistency Lead calculation, review, a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Content Editor
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer
Data AnnotationNorth Port, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Business Data Analyst
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Senior CRO Analyst
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Business Insights Analyst
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Advanced Analytics Expert
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Licensed MEDITECH Analyst
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Staff AI & ML Engineer
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer
Data AnnotationBonita Springs, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationNorth Port, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Remote Finance Advisor - AI Trainer
Data AnnotationCape Coral, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Product Analyst
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Analyst
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Architect
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI / ML Engineer
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Principal Data Analyst
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Prototype Specialist
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Generative AI Specialist
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationBonita Springs, Floridaserp_jobs.filters.remote
serp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Adoption Solutions Architect
VirtualVocationsFort Myers, Florida, United Statesserp_jobs.job_card.full_time