Talent.com
Principal Data Engineer
Principal Data EngineerDeputy • Sydney Florida, United States, 33527
Principal Data Engineer

Principal Data Engineer

Deputy • Sydney Florida, United States, 33527
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Principal Data Engineer

Deputy is a global SaaS remote-first workforce management company with hubs in Sydney, Melbourne, San Francisco and London, plus team members working remotely across the United States. Our platform serves over 1.5 million workers and 375,000 workplaces across 100+ countries. We are backed by top global investors and recently achieved Unicorn status.

At Deputy, were improving the world of work, one shift at a time, for 80% of the worlds workforce : hourly workers. These are the dedicated employees who keep our world running from baristas to nurses, cleaners to delivery drivers, florists to factory workers. Despite their vital role in society, most workplace technology has focused on those workers who sit behind a desk, but at Deputy, we transform the frontline. When businesses use Deputy, their workplaces thrive the business is more profitable, compliant, and productive, while the workers are more engaged and happier at work.

If youre passionate about creating solutions that put people first and helping businesses and their teams thrive, join us at Deputy and make an impact where it matters most!

The Role

At Deputy, our mission is to simplify shift work and create thriving workplaces. Data is at the heart of how we achieve this, powering everything from product innovation to exceptional customer experiences. We are looking for a Principal Data Engineer to be the technical cornerstone of our data team, leading the charge in building a scalable and reliable data platform that will support our next phase of growth.

This is a foundational, strategic role. You will have the autonomy to shape our data architecture, champion engineering best practices, and set the technical vision for how we use data across the company. This role is a perfect blend of hands-on technical leadership and strategic influence, where you will not only build powerful data systems but also mentor a talented team and partner with leaders across the business.

Responsibilities

Architect and Evolve Our Core Data Platform You will own the technical vision and roadmap for our data platform, steering its evolution on our modern cloud stack and ensuring it meets the demands of a rapidly scaling business.

  • Own the Architecture : Design, implement, and refine a robust data lakehouse architecture (e.g., Medallion) using Databricks and Delta Lake to ensure data reliability and performance.
  • Build Scalable Ingestion Frameworks : Develop and maintain resilient, reusable patterns for ingesting data from a diverse set of sources, including our systems, transactional databases, event streams, and third-party SaaS APIs.
  • Define Data Modelling Standards : Lead the implementation of our core data modelling principles (e.g., Kimball dimensional modelling) to produce curated, intuitive datasets for business intelligence and product analytics.
  • Implement Robust Governance : Use tools like Unity Catalog to establish a comprehensive data governance framework, covering data lineage, fine-grained access controls, and a user-friendly data catalogue.
  • Manage Platform Performance and Cost : Develop and implement strategies for monitoring, optimising, and forecasting our Databricks and cloud expenditure, ensuring the platform is both powerful and cost-effective.

Champion Engineering Excellence and Best Practice You will be the driving force for maturing our data operations, embedding a culture of quality, automation, and reliability into everything we do.

  • Automate Everything with CI / CD : Implement and advocate for automated CI / CD pipelines (e.g., using GitHub Actions) for all data assets, including dbt models, infrastructure changes, and Databricks jobs.
  • Embed Git-Based Workflows : Champion a Git-first culture for all data transformation code, establishing clear processes for branching, code reviews, and version control.
  • Embed Automated Data Quality : Implement comprehensive, automated data quality testing at every stage of our pipelines using tools like dbt test, ensuring data is accurate and trustworthy.
  • Introduce Data Observability : Establish thorough monitoring, logging, and alerting for all data pipelines to proactively detect, diagnose, and resolve issues before they impact the business
  • Be a Strategic Partner Across the Business You will connect the technical capabilities of the data platform to Deputy's strategic objectives, acting as a key advisor to stakeholders across the organisation.

  • Translate Business Needs into Technical Solutions : Collaborate directly with leaders in Product, Engineering, Sales, finance and Customer Success to understand their challenges and design data solutions that enhance our product, improve customer outcomes, and drive business strategy.
  • Guide Data Best Practices : Advise analysts, data scientists, and other stakeholders on how to best leverage the data platform for impactful analysis and data-driven decision-making.
  • Act as the Technical Authority : Serve as the go-to expert on our data architecture, running workshops and design sessions to align technical direction with business needs
  • Lead, Mentor, and Elevate Our Data Team As a technical member of the team, you will be instrumental in upskilling your colleagues and shaping the future of the data function at Deputy.

  • Mentor and Coach : Actively mentor data analysts and engineers through pair programming, constructive code reviews, and technical guidance to grow their skills in Python, SQL, and data modelling.
  • Foster a Community of Practice : Lead initiatives like a 'data guild' to encourage knowledge sharing, explore new technologies, and collaboratively solve complex problems
  • Shape the Team's Future : Partner with data leadership to define career progression pathways for data engineering and take a leading role in interviewing and hiring new team members.
  • Skills & Experience

  • Mastery of data architecture principles, data modelling frameworks (e.g., dimensional modelling), and a strong understanding of data governance and security best practices.
  • A strong software engineering mindset, with significant experience implementing CI / CD for data, Git-based workflows, and automated data quality testing.
  • Exceptional communication and stakeholder management skills, with a proven ability to translate complex technical concepts for non-technical audiences and influence business decisions.
  • A genuine passion for leadership and mentorship, with a track record of elevating the technical skills of those around you.
  • Tech Stack :
  • Dbt
  • Databricks, Unity Catalog
  • Terraform
  • AWS : Redshift, Dynamo db, API gateway, Cloud Watch, Lambda, Streaming with Kenisis / Firehose, Glue, Bedrock
  • Stitch & Fivetran
  • Languages required include advanced SQL, python
  • Employee Perks

  • Enjoy a flexible remote-first work policy (with a work-from-home stipend to set you up for success!)
  • Own A piece of Deputy via our Employee Share Ownership Plan (ESOP)
  • Take paid parental leave to support you and your family
  • Stay protected with Group Salary Continuance Insurance
  • Access support through our Employee Assistance Program
  • Enjoy additional leave days including study assistance, celebration days and volunteering
  • Join our global working groups focused on collaboration, belonging and connection
  • Get creative at our annual Hackathons
  • Take advantage of our novated leasing for electric vehicles, internet reimbursement and more!
  • Deputy believes in equal opportunity and that inclusiveness and diversity promotes innovation. Our global team members are from a variety of cultures. And we welcome different perspective and skills.

    #LI-Hybrid

    PI063462f7251d-30511-38831683

    serp_jobs.job_alerts.create_a_job

    Principal Data Engineer • Sydney Florida, United States, 33527

    Job_description.internal_linking.related_jobs
    Principal AI Engineer

    Principal AI Engineer

    VirtualVocations • Saint Petersburg, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal AI Engineer.Key Responsibilities Design and develop advanced AI solutions using large language models (LLMs) and agent frameworks Architect and implement LLM...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocations • Largo, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Software Engineer, Data.Key Responsibilities Design, implement, and maintain scalable data ingestion pipelines Design, implement, and maintain scalable APIs for extern...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocations • Largo, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Databricks Data Engineer

    Databricks Data Engineer

    VirtualVocations • Saint Petersburg, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Databricks Data Engineer to join their data engineering and analytics team.Key Responsibilities Design and develop scalable data pipelines using Apache Spark on Databri...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Principal Cloud Engineer

    Principal Cloud Engineer

    VirtualVocations • Lakeland, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Cloud Platform Engineer to manage cloud infrastructure and automate deployment processes. Key Responsibilities Lead projects and teams of cloud engineers to bu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    VirtualVocations • Largo, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Portfolio Data Engineer

    Senior Portfolio Data Engineer

    VirtualVocations • Lakeland, Florida, United States
    serp_jobs.job_card.full_time
    Portfolio Data Engineer to join their Data Engineering team.Key Responsibilities Write code and design pipeline architecture for data ingestion and analysis Build and enhance pipelines to improv...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Principal Software Engineer

    Principal Software Engineer

    VirtualVocations • Saint Petersburg, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Software Engineer for their Data Ingest Platform.Key Responsibilities Lead the technical vision and architecture of the Data Ingest Platform Build tools and ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Contact Government Services, LLC • Tampa, FL, US
    serp_jobs.job_card.full_time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Data Engineer I

    Data Engineer I

    Green Courte Residential Holdings LLC • Clearwater, FL, US
    serp_jobs.job_card.full_time
    The Data Engineer I will provide key strategic and technical support to each of Green Courte Residential Holdings (GCRH), its managed companies, and be a key player in enhancing GCRH’s and GC...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocations • Saint Petersburg, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Staff Data Engineer to design and maintain data systems that drive analytics and product innovation. Key Responsibilities Lead the design, development, and maintenance o...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Principal Data Engineer

    Principal Data Engineer

    Worth AI • Tampa, FL, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Worth AI, a leader in the computer software industry, is looking for a talented and experienced.At Worth AI, we are on a mission to revolutionize decision-making with the power of artificial intell...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Saint Petersburg, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer to lead the development and operationalization of data pipelines for improved health outcomes. Key Responsibilities Lead the design and implementation...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    VirtualVocations • Largo, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer I to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management procedu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Largo, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Cloud Data Engineer to design and implement data pipeline services for Azure cloud-based data solutions. Key Responsibilities Maintain and operate legacy ETL processes a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    VirtualVocations • Saint Petersburg, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Platform Engineer.Key Responsibilities Expand and maintain the data platform in collaboration with other engineers and data scientists Improve product tele...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Silverthorne Advisory Group LLC • Tampa, FL, US
    serp_jobs.job_card.full_time
    Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an.As a Data Engineer, you will play a. Advana data infrastructure and.Your expertise in ETL, Databricks, ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Principal Data Scientist

    Principal Data Scientist

    VirtualVocations • Saint Petersburg, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Data Scientist to join their Rentals Machine Learning team.Key Responsibilities Collaborate with cross-functional stakeholders to analyze model-driven listing...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted