The SRE role at Luma AI sits with the Infrastructure and Research teams and is responsible for our GPU clusters. Luma runs on '000s of H100 GPUs across multiple providers and clusters for Training, Data Processing, and Inference.
We need a highly skilled SRE to ensure those clusters are healthy and to build the monitoring and management tools we need to make full use of them.
Successful candidates will want to get extremely in the weeds solving performance and maintenance problems in our clusters.
Responsibilities
- Collaborate with researchers and engineers to specify the availability, performance, correctness, and efficiency requirements of the current and future versions of our GPU infrastructure.
- Work with multiple GPU cloud providers to scale up, scale down, maintain and monitor our 000's GPUs in many clusters.
- Design and implement solutions to ensure the scalability of our infrastructure to meet rapidly increasing demands.
- Implement and manage monitoring systems to proactively identify issues and anomalies in our production environment.
- Implement fault-tolerant and resilient design patterns to minimize service disruptions.
- Build and maintain automation tools to streamline repetitive tasks and improve system reliability.
- Participate in an on-call rotation to respond to critical incidents and ensure 24 / 7 system availability alongside other infrastructure developers.
- Develop and maintain service level objectives (SLOs) and service level indicators (SLIs) to measure and ensure system reliability.
Experience
- Proven work experience 10+ yrs as a reliability engineer, production engineer, infrastructure software engineer or a similar role in a fast-paced, rapidly scaling company.
- Strong proficiency in GPU cloud infrastructure, including the underlying concepts of scheduling, scaling, cloud storage, networking, and security.
- Proficiency in programming / scripting languages.
- Experience with containerization technologies and container orchestration platforms like Kubernetes or equivalent.
- Knowledge of IaC tools such as Terraform or CloudFormation or equivalent.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills.
- Experience with observability tools; examples include DataDog, Prometheus, Grafana, Splunk, and ELK stack or similar.
- Knowledge of security best practices in cloud environments.
- Good to have experience as an SRE within the AI / ML space is strongly preferred.
$200,000 - $250,000 a year
In addition to cash base pay, you'll also receive a sizable grant of Luma's equity.
The pay range for this position is $200000-250000 / yr for Bay Area. Base pay offered will vary depending on job-related knowledge, skills, candidate location, and experience.
Your application is reviewed by real people.
J-18808-Ljbffr
Staff Software Engineer / Video Streaming
Well-funded IoT Startup is looking for a Staff Software Engineer!. Well-funded IoT Startup is looking for a Staff Software Engineer to lead their growing team. Proven experience in building enterprise software products end-to-end. Passionate about video security and innovative video products, with a...
Staff Software Engineer, Embedded Systems/Firmware, Android
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projec...
Staff Infrastructure Software Engineer, Networking and Automation
The Software Platform Infrastructure team works closely with other software engineering teams throughout the company to ensure that Robotics operating system and software delivery is reliable, scalable, and efficient. Staff Infrastructure Software Engineer, Networking and Automation. Do you thrive i...
Staff Software Engineer, Cloud Kubernetes
Senior Backend Software Engineer (Python (Golang a plus))Hybrid: 2 days in office/week in Sunnyvale, CA. As a Senior Software Engineer, every day you will determine how we integrate firewall management security frameworks into our existing ecosystem using Go / Golang. Our Engineering team has establ...
Staff Software Engineer, Machine Learning Performance
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projec...
Senior/Staff Software Engineer, Remote Supervision
We are seeking passionate and skilled senior/staff software engineering candidates who want to work in a fast-paced and execution oriented team. Experience writing unit tests, using software project management software (Jira, Confluence, etc. Contribute to all technical aspects of the development, i...
Staff Software Engineer, Database Efficiency and Performance
Master's degree or PhD in Computer Engineering, Electrical Engineering, or Computer Science. Experience with software engineering, system architecture, computer architecture, databases, data analytics, or performance optimization. Google Cloud's software engineers develop the next-generation technol...
Staff Site Reliability Engineer
Lead Site Reliability engineering effort to improve anomaly detection, platform stability and resilience using modern best practice. Deliver tools/software to improve the reliability, scalability and operability of services. Collaborate with engineering teams to analyze and provide inputs in archite...
Staff Software Engineer FullStack
Years of Professional Software Engineering Experience, including at least 3 years of experience with senior engineering roles, ideally within an early-stage startup setting. Collaborate closely with product, design, and the rest of the engineering team to drive product-led growth through engineering...
Staff Software Engineer
We are currently seeking a Staff Software Engineer to join our team. As a Staff Software Engineer, you will:. Develop and maintain security software components on current and future Fortiswitch platforms. Implement security software features of high quality and on schedule. ...