Staff Product Manager, AI

A company is looking for a Staff Product Manager, AI Evaluations.

Key Responsibilities

Define and drive the roadmap for the AI Evaluation Framework, focusing on quantitative metrics and human-in-the-loop systems

Collaborate with ML, data, and research teams to build evaluation pipelines measuring model accuracy and helpfulness

Translate business and product goals into measurable AI performance objectives

Required Qualifications

10+ years of product management experience, preferably in AI / ML systems or data platforms

Experience defining and shipping metrics-driven AI products or frameworks

Strong understanding of model evaluation concepts such as precision / recall and user feedback loops

Experience with cross-functional collaboration across ML, data, design, and research teams

Ability to balance experimentation speed with rigor and reproducibility