Job Description
The Data Engineer will focus on building data pipelines to support our data ingesting, cleansing, enriching, and presentation efforts in support of our flagship SaaS applications.
Responsibilities
- Build data pipelines to support our data ingesting, cleansing, enriching, and presentation efforts in support of our flagship SaaS applications
- Collaborate with our data warehouse, platform, and product teams to build scalable, performant data pipelines.
- Create and extend data models based on changing source data and business requirements.
- Maintain and optimize existing pipelines.
- Automate testing, build, and deployment of data pipelines.
- Participate in code reviews.
- Investigate and diagnose root cause for data warehouse operational issues.
- Function as a technical resource for team members and internal users.
Desired Experience and Skills :
- 2+ years of experience with Python, common packages, and tools.
- Ability to write solid unit tests.
- Familiarity with object-oriented concepts and TDD.
- 3+ years relational database experience and advanced SQL writing and optimization skills.
- Experience with revision control (git), code reviews, iterative / incremental development processes.
- Experience with batch and streaming ETL / ELT.
- Experience with Snowflake (or similar cloud database) and cloud warehouse data modeling.
- Experience / familiarity with AWS services (serverless, S3, SNS, SQS).
- Strong troubleshooting and analytical skills.
- Comfortable working with bash / zsh and shell scripting.
Additional Experience and Skills
- Experience with CI / CD tools (Jenkins, Docker) and build / deploy automation.
- Experience with Airflow pipeline development and AWS MWAA.
- Experience with AWS Analytics services.
- Familiarity with DataDog, Sentry, Prometheus.
Behavioural Competencies :
- Planning and Organization : Able to establish and execute a course of action to accomplish specific short- and long-term goals, to plan appropriate allocation of resources and time, and to approach all responsibilities in an organized manner.
- Driven to Achieve. Able to manage self to drive performance by balancing efforts across the team to exceed targets.
- Initiative : Actively influence events to achieve goals. Acts beyond what is called for; generates and / or recognizes imaginative, creative solutions.
- Adaptability / Flexibility : Able to be effective in many situations and to develop and accept new methods of doing things.
Able to react quickly and to successfully implement changes as needed.
Curiosity : Inquisitive with a thirst for knowledge and desire to learn about the market and all aspects of the business
This position does not provide sponsorship. All applicants should either be US Citizens or Permanent Residents eligible to work in the US without immigration restrictions.
LI-CC1
LI-Remote
30+ days ago