Lead Software Engineer- Data Platform

Job Summary :

We are looking for a Lead Software Engineer to help us grow the data platform. You will be embedded on the Orchestration team that runs workflow scheduling applications and data ingestion infrastructure that helps power the analytics, operations, and data science behind our flagship streaming applications - Disney+, Hulu, ESPN+, and Star+.

You’ll help further the technology that hundreds of data and software engineers, data scientists, and analysts use every day.

You'll get to understand the challenges of facilitating a high-quality, flawless media streaming experience across mobile, connected devices, and web, all while using the latest technologies available from AWS and beyond.

If you're interested in working in a highly collaborative team environment like this, please get in touch - we'd love to hear from you!

Responsibilities and Duties of the Role :

• Lead within a cross-functional team of engineers to build software for a large-scale data processing ecosystem supporting real-time and batch data that underpins all analytic and operational data flows
• Build tools and services to support data discovery, lineage, resiliency, and privacy compliance across the data platform
• Design and develop CICD processes for infrastructure components that ensure high availability and agility
• Drive software engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation
• Provide mentorship and guidance for team members; evangelize the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption

Required Education, Experience / Skills / Training :

Basic Qualifications

• 7+ years of relevant professional experience
• Fluent in Python and Scala (or other JVM-based languages).
• Deep experience deploying and running cloud-based data solutions (preferably AWS) and infrastructure-as-code frameworks like Terraform.
• Ability to dive deep into any technical component as well as understand and drive the overall systems architecture.
• You care deeply about craftsmanship in your software and can work backwards from the customer experience.
• You have excellent written and verbal communication skills.

Preferred Qualifications

• Expertise with workflow scheduler tools such as Airflow.
• Experience maintaining real time data infrastructure such as Kinesis or Kafka.
• Familiarity with big data technologies such as Spark, Snowflake, Databricks, or EMR.
• Experience on a platform team, building tools for other engineers.

Required Education

• Bachelor’s degree in computer science or related field
• Master’s Degree a plus

The hiring range for this position in New York, NY and Seattle, WA is $156,300 to $209,600 per year, in Los Angeles, CA and Bristol, CT is $149,300 to $200,200 per year, in San Francisco, CA is $163,500 to $219,200 per year.

The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors.

A bonus and / or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and / or other benefits, dependent on the level and position offered.