Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsMinneapolis, Minnesota, United States
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Minneapolis, Minnesota, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
AI Software Engineer

AI Software Engineer

MedicaMinnetonka, MN, United States
serp_jobs.job_card.full_time
Medica is a nonprofit health plan with more than a million members that serves communities in Minnesota, Nebraska, Wisconsin, Missouri, and beyond. We deliver personalized health care experiences an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Solutions Specialist

AI Solutions Specialist

VirtualVocationsSaint Paul, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for an AI Solutions Specialist to drive business innovation through artificial intelligence.Key Responsibilities Analyze complex datasets to uncover trends and actionable ins...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Epic Certified BI Developer

Epic Certified BI Developer

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for an IT Data Solutions Developer Associate.Key Responsibilities Analyze, develop, and improve BI solutions to meet business needs Collaborate with operations teams to desi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Data Engineer

Data Engineer

Associated Bank - CorpMinneapolis, MN, United States
serp_jobs.job_card.full_time
At Associated Bank we strive to create an inclusive culture where different perspectives are valued and recognized as strengths critical to our success. If you thrive in an environment where your gr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Deep Learning Software Engineer

Deep Learning Software Engineer

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for a Deep Learning Software Engineer, Inference and Model Optimization - New College Grad 2025.Key Responsibilities Train, develop, and deploy generative AI models using the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Generative AI Scientist

Generative AI Scientist

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for a Generative AI Scientist.Key Responsibilities Deliver solutions to identify payment integrity issues and improve healthcare quality Develop exploratory data analysis ap...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Data Engineer with GCP Certification

Data Engineer with GCP Certification

VirtualVocationsSaint Paul, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for a Data Engineer (Gen AI).Key Responsibilities Install and test Looker and Looker Studio extensions or API plugins Identify and deprecate unused Looker dashboards Enhanc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsSaint Paul, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
Senior Business Intelligence Developer

Senior Business Intelligence Developer

VirtualVocationsSaint Paul, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for a Senior Business Intelligence Developer - Product & Platform Innovation.Key Responsibilities Collaborate with cross-functional teams to drive data enablement and support...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Principal, Data & AI Architect

Principal, Data & AI Architect

EntegrisChaska, MN, United States
serp_jobs.job_card.full_time
Principal, Data & AI Architect.Here at Entegris, we use advanced science to enable technologies that transform the world, and we are seeking employees who have the drive to continue that mission.We...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
EDI Solutions Analyst - Remote

EDI Solutions Analyst - Remote

UnitedHealth GroupEden Prairie, MN, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Senior AI Consultant

Senior AI Consultant

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for a Senior Consultant AI.Key Responsibilities Utilize Azure AI Services to build and optimize OpenAI solutions Develop and manage data ingestion and transformation pipelin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Data Engineer Senior

Data Engineer Senior

Associated Bank - CorpMinneapolis, MN, United States
serp_jobs.job_card.full_time
At Associated Bank we strive to create an inclusive culture where different perspectives are valued and recognized as strengths critical to our success. If you thrive in an environment where your gr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior Big Data Engineer

Senior Big Data Engineer

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for a Senior Big Data Engineer to join their team.Key Responsibilities Support the transition from a monolithic application to loosely coupled microservices Ensure data is c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Junior Machine Learning Engineer

Junior Machine Learning Engineer

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for a Junior Machine Learning Engineer to support the design, development, and deployment of machine learning models. Key Responsibilities Support the end-to-end lifecycle of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Advanced Analytics Expert

Advanced Analytics Expert

VirtualVocationsSaint Paul, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for an Advanced Analytics Expert to collaborate with teams and utilize advanced analytics for data-driven decision-making. Key Responsibilities Builds advanced analytics solut...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
AI Implementation Specialist

AI Implementation Specialist

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for an AI Implementation Specialist for Automated Portfolio Analysis and Reporting.Key Responsibilities Develop a GUI-based prototype for AI-powered document analysis and vis...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Data Architect

Data Architect

MedicaMinnetonka, MN, United States
serp_jobs.job_card.full_time
Medica is a nonprofit health plan with more than a million members that serves communities in Minnesota, Nebraska, Wisconsin, Missouri, and beyond. We deliver personalized health care experiences an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
ETL Data Architect

ETL Data Architect

VirtualVocationsMinneapolis, Minnesota, United States
serp_jobs.job_card.full_time
A company is looking for an ETL Data Architect to design and develop enterprise-wide application systems.Key Responsibilities Collaborate with business partners and teams to identify technical an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day