Search jobs > Boston, MA > Staff machine learning

Senior/Staff Machine Learning Engineer - Foundation Models

Zoox
Boston, MA
Full-time

The Prediction & Behavior ML team is responsible for developing machine-learned models that understand the full scene around our vehicle and forecast the behavior for other agents, our own vehicle’s actions, and for offline applications.

To solve these problems we develop deep learning algorithms that can learn behaviors from data and apply them on-vehicle to influence our vehicle’s driving behavior and offline to provide learned models to autonomy simulation and validation.

Given the tight integration of behavior forecasting and motion planning, our team necessarily works very closely with the Planner team in the advancement of our overall vehicle behavior.

The Prediction & Behavior ML team also works closely with our Perception, Simulation, and Systems Engineering teams on many cross-team initiatives.

The Behavior Foundation Model team is responsible for building GPT (Generative Pre-Trained) for autonomous driving and ecosystems for prediction and planning for autonomous driving and offline applications.

We're looking for experts in this field to come work with us in building these models and applying them to downstream tasks across the company.

Responsibilities

  • You will build the foundation models for on-vehicle and offline applications
  • You will push the boundaries of machine learning in the autonomous driving industry by developing state-of-the-art techniques in self-supervised learning, semi-supervised learning, multi-task learning, and generative models
  • You will leverage our large-scale machine learning infrastructure to discover new solutions
  • You will develop new algorithms to model the future behavior of all other agents in the world
  • You will develop new algorithms to model the future behavior of our own vehicle’s future actions, both in predicting our driving trajectories and estimating their quality in relation to our goals of safety, progress, and comfort
  • You will develop new algorithms to apply generative deep learning to simulation to improve the realism of our offline validation systems
  • You will engineer software that runs on-vehicle to efficiently execute our algorithms in real time
  • You will develop metrics and tools to analyze errors and understand improvements of our systems
  • You will collaborate with engineers on Perception, Prediction, Planning, Simulation, and Systems Engineering to solve the overall Autonomous Driving problem in complex urban environments

Qualifications

  • BS, MS, or PhD degree in Computer Science or a related field
  • Fluency with PyTorch, TensorFlow, or JAX
  • Experience with training and deploying Deep Learning models
  • Experience with production Machine Learning pipelines : dataset creation, training frameworks, metrics pipelines
  • Fluency in Python and a basic understanding of C++
  • Extensive experience with programming and algorithm design
  • Strong mathematics skills

Bonus Qualifications

  • Experience in training of large and complex models
  • Experience with LLMs
  • Conference or Journal publications in Machine Learning or Robotics
  • Prior experience with Prediction and / or Autonomous Vehicles or Robotics in general

Compensation There are three major components to compensation for this position : salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights.

The salary will range from $210,000 to $303,000. A sign-on bonus may be part of a compensation package. Compensation will vary based on geographic location, job-related knowledge, skills, and experience.

Zoox also offers a comprehensive package of benefits including paid time off ( sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.

About Zoox Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market.

Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments.

We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.

Accommodations If you need an accommodation to participate in the application or interview process please reach out to or your assigned recruiter.

25 days ago
Related jobs
Promoted
Flagship Ventures
Cambridge, Massachusetts

This position is ideal for someone with broad expertise in machine learning, deep learning, and computational sciences who is looking to join a very dynamic and innovative environment and pioneer the next frontier of innovation, application, and human-computer interactions enabled by generative mode...

Promoted
Lumafield
Boston, Massachusetts

As a Senior Machine Learning Engineer you will build the algorithms and models which solve our customers' toughest problems. Successful techniques will include analytic, computer/machine vision, and machine learning approaches. Guide the machine learning strategy internally and set Lumafield up for ...

Promoted
Capital One
Boston, Massachusetts

Center 1 (19052), United States of America, McLean, VirginiaSenior Manager, Technical Program Manager - Machine LearningAre you interested in leading programs that deliver on critical business goals and build large scale products & platforms?At Capital One, we believe that Machine Learning (ML) repr...

Promoted
Apple, Inc.
Boston, Massachusetts

Your responsibilities will include: * Develop machine learning models and systems to optimize the Power, Performance, Area, and Robustness (PPAR) of mixed-signal IPs. Strong understanding of a wide range of machine learning algorithms, including logistic regression, deep neural networks, and reinfor...

Promoted
Ethereum Technologies LLC
Boston, Massachusetts

The Machine Learning Engineer will work closely with data scientists, product managers and backend engineers to gather requirements, understand performance characteristics, and identify usage patterns to deliver solutions that bring our model-driven products to market faster while also being robust ...

Promoted
Recooty
Woburn, Massachusetts

Partner with our clients to build end-to-end Data Consumption Platforms leveraging your unique Business and Technical skills to perform exploratory data analysis, build and validate models, and deploy models into established pipelines. This requires hands-on experience/projects involving real-world ...

Promoted
Chewy
Boston, Massachusetts

Do you want to build a model that impacts the company's bottom line? Do you want to see how your ideas, pipelines, architecture, and experiments affect top-level decision-makers? If so, the Chewy Marketing & Science team is hiring! We use the best machine learning techniques to simplify product ...

MITRE
Bedford, Massachusetts

Familiarity with advanced data science techniques and methods supervised and unsupervised machine learning, deep learning, reinforcement learning) is a plus. Minimum of 5 years of experience with a bachelor’s degree; or 3 years and a Master’s degree; or a PhD with relevant hands-on experience using ...

Capital One
Cambridge, Massachusetts

Build machine learning models through all phases of development, from design through training, evaluation and validation, and partner with engineering teams to improve operationalization in scalable and resilient production systems that serve 50+ million customers. ...

MIT Lincoln Laboratory
Lexington, Massachusetts

The Integrated Missile Defense Technology Group is seeking a highly motivated individual to join in an outstanding and interdisciplinary team of mathematicians, scientists, and engineers in solving challenging and critically important missile defense problems through simulation, modeling, algorithm ...