ResponsibilitiesFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join UsCreation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible.
Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity;
to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together.
That's how we drive impact - for ourselves, our company, and the users we serve. Join us. The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company.
We also drive substantial impact on core businesses of the company. Currently, we are looking for Machine Learning Engineer - Model Serving Infrastructure to join our team to support and advance that mission.
Responsibilities : - Responsible for the design and implementation of distributed inference infrastructure for feeds, ads and search ranking models.
- Responsible for building monitoring / managing tools to oversee the reliability and scalability of online inference servers- Responsible for triaging system inefficiency and bottlenecks and improving system performance- Responsible for building tools to analyze bottlenecks and sources of instability and then design and implement solutions- Responsible for collaboration with product teams and providing general solutions to meet their requirements Job requirements- Proficient in C / C++ / CUDA, and have solid programming skills.
- Familiar with deep learning serving frameworks (TensorFlow Serving / TorchScript).- Experience in GPU performance optimization- Ability to work independently and complete projects from beginning to end and in a timely manner.
- Good communication and teamwork skills to clearly communicate technical concepts with other teammates.Qualifications- Experience contributing to an open sourced machine learning framework (tensorflow / jax / pytorch / torchscript / mxnet / tensorrt).
- Experience in developing and deploying large-scale systems.- Strong background in one of the following fields : Hardware-Software Co-Design, High Performance Computing, ML Hardware Acceleration (, GPU / RDMA) or ML for Systems.
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives.
Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life.
To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach.
We are passionate about this and hope you are too. ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws.
If you need assistance or a reasonable accommodation,
Machine Learning Tools Engineer
A company is looking for a Machine Learning Tools Engineer with at least 5 years of industry experience. Computer Science or a related field or equivalent experience5+ years of experience in building automation tools for Machine Learning applicationsFluency in ES6 JavaScript and Python3+ years of ex...
Machine Learning Engineer
We’re searching for an ML engineer excited about solving complex engineering challenges within a small, high-impact team based in San Francisco. If you’re passionate about working on advanced distributed systems, machine learning, and resource optimization, this could be a great opportunity. Experie...
Senior Machine Learning Engineer
A company is looking for a Senior Machine Learning Engineer, Applied Machine Learning. Key Responsibilities:Architect, build, and optimize ML systems for real-world applicationsDesign and implement scalable training pipelines for ML modelsFine-tune large language models to enhance performance and re...
Machine Learning Engineer Graduate (On-Device AI) - 2025 Start (PhD)
Deep knowledge in machine learning optimizations such as quantization, pruning, knowledge distillation, Neural Architecture Search (NAS), and optimizations for large models. Leveraging our proprietary AI engine, we streamline the creation, integration, testing, and deployment of AI-driven features. ...
Machine learning Engineer
Work closely with engineers to build, test, deploy and troubleshoot machine learning / algorithm based software. MACHINE LEARNING TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). MACHINE LEARNING TECHNOLOGIES LLC will not make any p...
Senior Machine Learning Engineer - Smart Test
Development of machine learning systems, including key computing development, task scheduling, and machine learning system management and operation. Online serving of machine learning models. As a senior ML Engineer in our Developer Infrastructure team, you will conduct R&D and push the boundari...
Machine Learning Engineer, Tech Lead - Engineering Efficiency and AI Code Assistant
As a Machine Learning Engineer (MLE) specializing in code large language models, you will be responsible for developing, enhancing, and applying AI-powered models designed specifically for code-related tasks. Experience with machine learning frameworks and libraries (e. Quality Technology Team focus...
Senior Machine Learning Engineer, Recommendation - TikTok eCommerce
We are a group of applied machine learning engineers and data scientists that focus on E-commerce recommendations. We are interested and excited in applying large scale machine learning to solve various real-world problems in E-commerce. Click Through Rate and Conversion Rate prediction) , including...
Machine Learning Engineer, Shop Ads - USDS
Apply state-of-the-art machine learning techniques to optimize advertisers' marketing strategies. The teams within USDS that deliver on this commitment daily span across Trust & Safety, Security & Privacy, Engineering, User & Product Ops, Corporate Functions and more. Familiarity with at...
Machine Learning Engineer Graduate (On-Device AI) - 2025 Start (PhD)
Deep knowledge in machine learning optimizations such as quantization, pruning, knowledge distillation, Neural Architecture Search (NAS), and optimizations for large models. Leveraging our proprietary AI engine, we streamline the creation, integration, testing, and deployment of AI-driven features. ...