AI Evaluation Analyst
VirtualVocationsHuntsville, Alabama, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Huntsville, Alabama, United States
Job_description.internal_linking.related_jobs A company is looking for a Generative AI Scientist.Key Responsibilities Deliver solutions to identify payment integrity issues and improve healthcare quality Develop exploratory data analysis ap...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Data Engineer (Gen AI).Key Responsibilities Install and test Looker and Looker Studio extensions or API plugins Identify and deprecate unused Looker dashboards Enhanc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an ETL Data Architect to design and develop enterprise-wide application systems.Key Responsibilities Collaborate with business partners and teams to identify technical an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day A company is looking for an AI Tool SME.Key Responsibilities : Lead tool onboarding and training Ensure compliance with AI governance Support cross-functional adoption and education Required Qu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day A company is looking for a Senior Big Data Engineer to join their team.Key Responsibilities Support the transition from a monolithic application to loosely coupled microservices Ensure data is c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Data Operations Associate-Client Ads.Key Responsibilities Maintain, audit, and improve advertiser and catalog data to support business growth Collaborate with Sales, C...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Senior Consultant AI.Key Responsibilities Utilize Azure AI Services to build and optimize OpenAI solutions Develop and manage data ingestion and transformation pipelin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Tech Lead with AI & Data expertise (Remote, LATAM).Key Responsibilities Lead the technical effort for the Delivery Team, ensuring clarity and confidence with clients an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an Epic Cogito BID.Key Responsibilities Gather reporting requirements and design reports for healthcare organizations Conduct testing and validation of reports and provi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day A company is looking for an AI Implementation Specialist for Automated Portfolio Analysis and Reporting.Key Responsibilities Develop a GUI-based prototype for AI-powered document analysis and vis...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for a Deep Learning Software Engineer, Inference and Model Optimization - New College Grad 2025.Key Responsibilities Train, develop, and deploy generative AI models using the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for an Advanced Analytics Expert to collaborate with teams and utilize advanced analytics for data-driven decision-making.
Key Responsibilities Builds advanced analytics solut...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day A company is looking for a Junior Machine Learning Engineer to support the design, development, and deployment of machine learning models.
Key Responsibilities Support the end-to-end lifecycle of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 A company is looking for an IT Data Quality Senior Engineer to ensure data quality and compliance across various projects.
Key Responsibilities Automate and optimize data validations, implement bu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day A company is looking for an AI Solutions Specialist to drive business innovation through artificial intelligence.Key Responsibilities Analyze complex datasets to uncover trends and actionable ins...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours A company is looking for a Senior Business Intelligence Developer - Product & Platform Innovation.Key Responsibilities Collaborate with cross-functional teams to drive data enablement and support...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Generative AI Scientist
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Data Engineer with GCP Certification
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
ETL Data Architect
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Tools Subject Matter Expert
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Agent Evaluation Analyst
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Big Data Engineer
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Data Operations Associate
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Senior AI Consultant
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Tech Lead for AI & Data
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Epic Cogito Reporting Advisor
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Prototype Specialist
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
AI Implementation Specialist
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Deep Learning Software Engineer
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Advanced Analytics Expert
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Junior Machine Learning Engineer
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Data Quality Senior Engineer
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
AI Solutions Specialist
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Business Intelligence Developer
VirtualVocationsHuntsville, Alabama, United Statesserp_jobs.job_card.full_time