Senior Data Engineer (Multiple Positions)

ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join UsCreation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible.

Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity;

to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together.

That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the TeamOur team plays a crucial role in ensuring the company’s success.

We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems - you’ll be part of a team that’s developing new solutions to new challenges.

It’s working fast, at scale, and we’re making a difference. We are looking for talents to join us on this exciting journey! Responsibilities- Build a Data Warehouse that can cater to batch and streaming data and Data Products that provide useful information to build efficient data metrics and dashboards which will be used to make smarter business decisions to support business growth.

• Design and build data transformations efficiently and reliably for different purposes ( reporting, growth analysis, multi-dimensional analysis).
• Design and implement reliable, scalable, robust, and extensible big data systems that support core products and business.
• Recommend different ways to constantly improve data reliability and quality.- Establish solid design and best engineering practice for engineers as well as non-technical people.
• Deploy application changes to cloud environment, configure data attributes, schedule batch jobs, manage computing resources, and setup monitoring tools and alerts.
• Mentor junior and intern Data Engineers.QualificationsQualificationsMust have a Master's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 2 years of related work experience;

OR a Bachelor's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 5 years of post-bachelor's, progressive related work experience.

• Of the required experience, must have 2 years of experience in each of the following : - Performing data analysis, design, and development of highly efficient, reliable, and scalable ETL applications using SQL, C#, and Python;
• Transforming big data using Spark and M / R (map reduce) for data insights, reporting, and analytics, and transferring data to Hadoop Distributed File System (HDFS) using Sqoop;
• Building data pipelines and implementing partitioning and bucketing in hive to organize and query data, and performing query tuning to improve the speed of daily user analytics and reports;
• Performing code changes and reviews using Git version control and performing workflow management using JIRA; and- Automating system maintenance and deployment tasks by creating and scheduling cron jobs using Shell script.

Type : Full time, 40 hours / weekLocation : San Jose, CASalary Range : $210662 - $355000 per year To