Lead Data DevOps Engineer with AWS and Databricks experience

Description

We are seeking a remote Lead Data DevOps Engineer with AWS and Databricks experience to join our team. As a Lead Data DevOps Engineer, you will play a key role in summarizing the results and providing valuable insights.

Additionally, your responsibilities will extend to supporting with engineering capabilities the rollout and adoption of the chosen data quality tool.

Responsibilities

• Collaborate with different teams to facilitate technically the proof of concept phase for the data quality tool, ensuring effective implementation and addressing engineering challenges
• Lead the deployment and configuration of the data quality and data observability tool within our central data platform, ensuring optimal performance and integrating the data quality tool seamlessly with existing systems, databases, and data pipelines
• Customize the tool as necessary and support the migration efforts, transitioning from existing data quality implementations to the new central solution
• Maintain and further develop platform solutions and software that enable the Zalando data engineering community to use data quality and data observability easily, efficiently, safely and in a compliant way
• Provide support, consultation, and subject matter expertise to the clients data engineering community and create documentation on the setup of the data quality tooling in the data platform for future reference and training purposes

Requirements

• 5+ years of relevant professional experience
• At least 1 year of relevant leadership experience
• Hands-on experience in cloud technologies (preferably AWS)
• Experience with container / orchestration tools (Kubernetes, Docker), and provisioning infrastructure resources as code (preferably CloudFormation or Terraform)
• Strong experience with Databricks
• Engineering craftsmanship in software development processes, focusing on testing, continuous integration / continuous delivery (CI / CD), monitoring, and documentation
• B2+ English level proficiency

Nice to have

• Experience with data quality tooling in a big data and distributed data processing environment
• Experience in integrating, operating, and building systems as part of a data platform
• Understanding of distributed data platform architecture and technologies
• Server side programming skills in Python, Golang, Java, or other JVM languages
• SQL knowledge

We offer

• We gather like-minded people : Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Relocation within our 50+ offices
• We provide growth opportunities : Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, OReilly, Cloud Guru Language classes in English and Polish for foreigners
• We cover it all : Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events
• Please, note : The set of bonuses might vary based on the role you apply for specifics will be discussed with our recruiter during the general interview We will reach out to selected candidates exclusively
30+ days ago