We are looking for people with strong Backend Data Engineering capabilities to build highly efficient, resilient systems & pipelines for large-scale data processing.
You’ll be part of Luma’s applied research team and work directly on mission critical work-streams utilizing thousands of GPUs.
All the relevant skills, qualifications and experience that a successful applicant will need are listed in the following description.
Responsibilities
- Design, build and automate infrastructure for processing data across multiple clusters of thousands of GPUs.
- Work with researchers to identify and implement technical data requirements, and optimize distributed loading for model training.
- Work cross-functionally for diverse backend engineering needs.
- Design & build performant infrastructure to manage and leverage large-scale datasets for our model training.
Experience
- Requirement of 10+ years of engineering, including 2+ years of work experience in petabyte-level data processing.
- Very strong generalist python coding.
- Experience engineering large-scale systems that process and serve petabytes of data.
- Deep understanding of Kubernetes, SLURM, Ray and other cluster orchestration systems.
- Experience working with visual data.
- Experience working closely with ML is a strong plus.
- Please note this role is not meant for recent grads.
$200,000 - $300,000 a year The pay range for this position in California is $200,000 - $300,000yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience.
We also offer competitive equity packages in the form of stock options and a comprehensive benefits plan.
All your applications are reviewed by real people.
J-18808-Ljbffr
Software Engineer (UI - Solutions), Ai & Data Platforms
Would you like to work in a fast paced environment where your technical abilities will be challenged on a day to day basis? If so, Apple's AI & Data Platform (AiDP) team is seeking a Software Engineer to work on building and scaling best in class data and reporting apps presenting metrics & performa...
Senior Software Engineer- Data infrastructure
We are looking for people with strong Backend Data Engineering capabilities to build highly efficient, resilient systems & pipelines for large-scale data processing. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and expla...
Sr. Systems Development Engineer (AWS Generative AI & ML Servers), AWS HW Engineering
Do you want to build the backbone of Generative AI cloud at AWS? Do you want to build the future of the cloud for AI training and inference? Want to do industry leading work delivering continuous price performance improvements in the cloud for AI model training for multi billion variable LLMs? Come ...
Full-Stack Engineer with ML/AI Experience
Develop and maintain APIs for system integration and data exchange. We are seeking a Full-Stack Engineer with a solid foundation in software development and an interest in machine learning and artificial intelligence. Work with cloud services and storage solutions to manage data and application infr...
Senior Principal Engineer, AI/ML Software Compiler
BS in Computer/Electrical Engineering or Computer Science with 25+ years of working experience in silicon development or MS in Computer/Electrical Engineering or Computer Science with 23+ years of relevant working experience or PhD and 20+ years of relevant working experience preferred. To achieve t...
Principal Software Engineer, Detect
Collaborate with cross-functional teams, including AI researchers, product managers, and frontend/backend engineers to deliver high-quality software solutions. Resemble AI is at the forefront of voice AI technology, pioneering the field of Custom Voices. At Resemble AI, we are committed to pushing t...
Sr Principal Software Engineer (L4/L7 Data Plane)
Collaboration and teamwork are at the foundation of our culture and we need engineers who can communicate and work well with others towards achieving a common goal. Experience with developing data plane software using C/C++ and Golang. Enjoys working with different teams with strong collaboration an...
Principal Engineer, Performance Analysis - AI Applications and Services
Principal Engineer, Performance Analysis - AI Applications and Services. We are seeking a highly motivated performance engineer to join our AI Applications organization to work on distributed cloud native accelerated video analytics applications. As a performance engineer, you will work with the App...
Principal AI/ML Engineer, Security AI
Bachelor's degree with 15+ years (or) Master's degree with 12+ years (or) PhD with 8+ years of experience in software engineering to include serving in the capacity of Director/CTO/Chief/Principal Engineer position for AI/ML solutions. The Cisco Security AI team delivers AI products and platform for...
Software Engineer (BI Tools Platform), Ai & Data Platforms
Developing and maintaining these BI tools are core part of our daily job. Administer Tableau platform, perform platform engineering, release management, reliability engineering, infrastructure planning, health checks and alerting. Would you like to work in a fast-paced environment where your technic...