What you'll do :
- Develop Data Pipelines using Scala / Java and Spark EMR to move data into our consolidated data lake or data warehouse (Snowflake)
- Consolidate / join datasets to create easily consumable, performant, and consistent information
- Look for ways to improve processes and take initiative to implement them
- Evaluate new technology and advise on our data lake ecosystem
- Collaborate with cross-functional teams to design and implement impactful solutions to department and business problems
- Creates and maintains documentation for business end users and other data analysts.
- Determine where in our infrastructure we should house our data based on the use case and data model.
What you'll bring :
- Degree (Masters preferred) in Computer Science, Information Systems, Data Science, or related field and 4+ years of experience in data engineering, or an equivalent combination of education and experience.
- Expert and Hands-On development in distributed computing environment using Hadoop, Scala / Java, Spark and Apache Airflow
- SQL knowledge and understanding
- Experience architecting solutions in collaboration with engineering development and data analysts team.
- Experience working with third party APIs for data collection
- Self-motivated; able to work independently to complete tasks and collaborate with others to identify and implement solutions.
- Expertise and Hand-On working knowledge of AWS
- Experience with Git / Github or other version control systems
- Familiarity with Snowflake or DataBricks a plus.
LI-SK
LI-Hybrid
Actual compensation offered will be based on factors such as the candidate’s work location, qualifications, skills, experience and / or training.
Your recruiter can share more information about the specific salary range for your desired work location during the hiring process.
We want our employees and their families to thrive.
In addition to comprehensive benefits we offer holistic mind, body and lifestyle programs designed for overall well-being.
Full Stack Senior Software Engineer II, Machine Learning Foundations
The Machine Learning Foundations team builds and supports the essential tools and frameworks for every machine learning engineer at Cruise. Our goal is to greatly accelerate the development cycle of machine learning models across the whole company, empowering machine learning engineers to focus on i...
Software Software Engineer II, Search API
Mentor other software engineers to develop all aspects of their engineering skill sets. We are looking for an innovative and curious Senior Software Engineer to join our Search API team and help us improve the quality of our geocoding search engine. As a Senior Software Engineer on the Search API te...
Senior Software Engineer II, CRAFT - Test Platform
Raise the bar on engineering excellence by producing best in class of code, documentation, testing, and monitoring. Your ideas, feedback, key decisions, and technical designs will be shared with other senior engineers, partners, and the company's leadership. ...
Embedded Software Engineer II
Design, develop, and test software for new products and maintain software for existing products. Bachelor's degree in Computer Science/Engineering, or Electrical Engineering. Work with product managers, UI designers, and other engineers to define requirements and user interfaces. Ensure the software...
Software Engineer II, Backend - Time Products
We’re looking for a Software Engineer II, Backend to join the Time Products team. Writing and reviewing code goes without saying, but at Rippling, engineers do a lot more than just engineering. Lead and practice engineering excellence practice. Experience in backend product engineering . ...
Software Engineer, Android II
The Android team responsible for building Hulu is seeking an experienced Software Engineer with a passion for mobile applications to join our team. Nurture a highly collaborative, world-class team of software engineers. Bachelor’s degree in Computer Science, Information Systems, Software Engineering...
Backend Software Engineer II, Benefits
We build software that automates the tedium of managing insurance offerings and submitting enrollments. Design and develop high-quality product software, drive the architectural decision and full life cycle of product delivery. Coordinate cross team collaborations, incorporate customer feedback into...
(usa) Software Engineer Ii
Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area. Option 2: 3 years' experience in software engineering or related area. Design, build, and maintain high performant APIs and software services for our 1P and 3P ...
Software Engineer II, IOS/Android
In doing so, they contribute to a series of cross-functional services and technologies, including Quality Engineering, Data Analytics, Software Development, Broadcast Infrastructure, and Networking & Security. Engineering Services designs, builds, and sustains technology that powers DE&E Technology’...
Software Engineer II
Software Engineers are at the heart of that innovation and magic, building platforms, services, tools and infrastructure for an unmatched collection of content and brands such as Disney+, Hulu, ESPN, and ABC. As a Software Engineer you will focus on building experiences for our core streaming produc...