Machine Learning Engineering Manager

A company is looking for a Machine Learning Engineering Manager - LLM Serving & Infrastructure.

Key Responsibilities

Lead a high-performing engineering team to develop and deploy a high-scale, low-latency LLM Serving Infrastructure

Drive the implementation of a unified serving layer for multiple LLM models and inference types

Establish and monitor the serving infrastructure's performance, cost, and reliability

Required Qualifications

5+ years of experience in software or machine learning engineering, with 2+ years in a management role

Expertise in building and governing high-quality ML systems and datasets

Deep technical background in large-scale Machine Learning / MLOps infrastructure

Proven ability to manage complex projects with multiple partners

Experience integrating evaluation and testing into CI / CD pipelines