ResponsibilitiesFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join UsCreation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible.
Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity;
to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together.
That's how we drive impact - for ourselves, our company, and the users we serve. Join us. The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company.
We also drive substantial impact on core businesses of the company. Currently, we are looking for Machine Learning Engineer - Model Serving Infrastructure to join our team to support and advance that mission.
Responsibilities : - Responsible for the design and implementation of distributed inference infrastructure for feeds, ads and search ranking models.
- Responsible for building monitoring / managing tools to oversee the reliability and scalability of online inference servers- Responsible for triaging system inefficiency and bottlenecks and improving system performance- Responsible for building tools to analyze bottlenecks and sources of instability and then design and implement solutions- Responsible for collaboration with product teams and providing general solutions to meet their requirements Job requirements- Proficient in C / C++ / CUDA, and have solid programming skills.
- Familiar with deep learning serving frameworks (TensorFlow Serving / TorchScript).- Experience in GPU performance optimization- Ability to work independently and complete projects from beginning to end and in a timely manner.
- Good communication and teamwork skills to clearly communicate technical concepts with other teammates.Qualifications- Experience contributing to an open sourced machine learning framework (tensorflow / jax / pytorch / torchscript / mxnet / tensorrt).
- Experience in developing and deploying large-scale systems.- Strong background in one of the following fields : Hardware-Software Co-Design, High Performance Computing, ML Hardware Acceleration (, GPU / RDMA) or ML for Systems.
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives.
Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life.
To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach.
We are passionate about this and hope you are too. ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws.
If you need assistance or a reasonable accommodation,
Staff Software Engineer, Machine Learning Infrastructure, Google Cloud
Master’s degree or PhD in Engineering, Computer Science, or a related technical field. Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh i...
Sr. Staff Machine Learning Engineer, Ads Ranking
In this role, you will be responsible for developing and executing a vision for the evolution of the machine learning technology stack for the conversion modeling team. You will work on tackling new challenges such as user sequence modeling, embedding features, model quantization, utility alignment,...
Machine Learning Software Engineer
Experience in deploying models. ...
Machine Learning Engineer, TikTok Core Feed Recommendation - User Growth
Minimum of 1 year of experience in one or more of the areas: recommender systems, machine learning, deep learning, pattern recognition, data mining, computer vision, NLP, content understanding or multimodal machine learning. Work cross-functionally with product managers, data scientists, and product...
Software Engineer III, Machine Learning, BigQuery
As a Software Engineer with Machine Learning (ML), you will support new and existing projects in the areas of Generative AI in BigQuery, with a focus on building evaluation frameworks for new ML capabilities. You will have the opportunity to work across domains of machine learning platforms and algo...
Machine Learning Engineer Graduate (Data-Search-TikTok.US - San Jose) - 2025 Start (BS/MS)
Experience in one or more of the following areas: NLP, Ranking, Ads, search engine, recommender system, distributed system, and machine learning. On the TikTok Search Team, you will have the opportunity to develop and apply cutting edge machine learning technologies in real-time large-scale systems,...
Senior Software Engineer, Machine Learning, Google Cloud Networking
ML/AI algorithms and tools, deep learning or natural language processing. Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all...
Machine Learning Engineer - Computer Vision
We are looking for excellent machine learning engineers who can take initiatives, design and develop advanced machine learning solutions, and deploy them directly to TikTok's global platform. Our Trust and Safety engineering team is fast growing and responsible for building machine learning models a...
Software Engineer III, Machine Learning, Google Cloud Platforms
We're proud to be our engineers' engineers and love voiding warranties by taking things apart so we can rebuild them. TensorFlow), artificial intelligence, deep learning and/or natural language processing. Proficiency in code and system health, diagnosis and resolution, and software test engineering...
Sr. Software Engineer, Machine Learning
Apply state-of-the-art machine learning techniques, including deep learning, reinforcement learning, causal inference, and optimization, to enhance our foundational recommendation models. Collaborate with other machine learning engineers, backend software engineers, and product managers to integrate...