Search jobs > Atlanta, GA > Principal data engineer

Principal Data Engineer

Hiscox
USA, Atlanta
$140K-$165K a year
Full-time

Job Type : Permanent

Permanent

Build a brilliant future with Hiscox

Position : Principal Data Engineer

Reporting to : Director of Data Engineering

Location : Atlanta, New York, or Chicago

  • We are looking for a skilled Data Engineer who is a mentor and thought leader. You will have indepth knowledge and experience in;
  • cloud data lake house; Databricks (preferred) or Snowflake; cloud-native solutions knowledge; SQL or Python; modern DevOps approach;

have written data code AND also the CI / CD pipelines.

The team

The US data engineering chapter is a professional practice of data and data quality engineers. We build technology solutions designed to ensure our stakeholders have trusted information to make effective decisions.

We form part of the wider US Data function . We are a broad, cross-functional team seeking to transform how our Hiscox USA business uses data to inform everything we do.

The role

You will be a senior member of our US Data Engineering chapter. We are on an exciting journey modernizing our data technologies and ways-of-working to make use of best in-class technologies and truly agile practices.

While you will not have formal line management responsibilities, as a principal you will be expected to lead, mentor others, and deputize for the director of data engineering when required.

You will be influential in shaping our chapter for the future, driving change, and ensuring we remain current with best practices in this fast-moving field.

You will also continue to contribute as a hands-on engineer. You will have the knowledge, best earned through extensive experience, to truly inhabit this principal role in an ambitious team.

What you’ll be doing :

  • Working with business stakeholders and our delivery team to understand high value business problems that can be solved through the application of data processing and analytical systems.
  • Developing, expanding, and evolving our data lake house and ELT pipelines.
  • Working to design, build and support a transformational Databricks cloud data platform for the business.
  • Being a core and professional member of our data engineering practice
  • Understand business requirements and help refine development tasks and estimate their complexity.
  • Research, evaluate and adopt new technologies with a right tool for the job mentality.
  • Focus on both speed of delivery and quality, with suitable pragmatism ensuring your solutions are always appropriate and not too complex or over-engineered.
  • Quick progression of projects from proof-of-concept to post-production stage.
  • Communication and presentation of ideas to colleagues in all parts of the wider data team.
  • Participating in code reviews for data engineering practice and as a principal ensuring that all engineers conduct such reviews to a high standard.
  • Act as a servant leader in our practice ensuring team members have what they need to complete work, influencing them to follow best practice and reinforcing a culture where everyone can contribute their very best.
  • Helping set the future direction for our chapter as we adopt more advanced approaches third party data, AI / ML techniques.

Essential Skills

  • Tried and tested experience. You will have built data platforms, made mistakes, learned from them, and brought those learnings to your next implementation.
  • Driving practice excellence. Our engineering team will be spread across many agile squads. You will be influential in ensuring that wherever our engineers are working, they are adhering to our practice standards of excellence in all that we do.
  • Hands-on experience working with modern cloud data lake house technologies e.g. Databricks (preferred) or Snowflake. You must understand how cloud-native solutions must be built differently from traditional ones.
  • Excellent knowledge of and proven experience with our core languages for data engineering SQL or Python.
  • Experience working using a modern DevOps approach. You should not just have written data code but also the CI / CD pipelines necessary to test and deploy that code in a professional environment.
  • A robust understanding of core data engineering topics ETL vs ELT, structured and unstructured data, data quality and data governance.
  • Ability to contribute to all aspects of a solution design, infrastructure, development, testing and maintenance.
  • The ability to design and advocate for technical solutions to business problems.
  • Experience collaborating with technical and non-technical team members in agile Scrum ceremonies roadmap planning, feature workshops, backlog elaboration, code review.
  • Track record of taking initiative and delivering projects end-to-end; clear evidence of being self-driven and motivated
  • Immense curiosity, high energy, and desire to go the extra mile to make a difference.

Our Technology

We operate in a diverse technical landscape and are looking for flexible engineers who can adapt to and use many different tools.

We would not expect any engineer to be familiar with the entire tech stack no engineer can. Instead, we seek people with a good understanding of data structures and algorithms and the ability to apply this knowledge in learning new tools.

We are building a modern cloud data platform to realise the full value of our data. It will be based on Databricks and use dbt for transformation.

We will surface data for use by analysts working primarily in PowerBI.

We take a DevOps approach and strive for continuous integration / continuous deployment. We use Azure Pipelines to deploy our code.

We deploy infrastructure the same way using Terraform and Docker.

We still have a legacy data landscape involving both MS SQL Server and Oracle databases. We use SSIS for ETL. We will decommission this landscape over time and our engineers will be involved in determining how these workloads can be moved to our new platform.

Our technology landscape is not complete. Our engineering teams will be able and required to help us build out our technology stack to fill gaps and embrace new opportunities.

What we offer

  • Competitive salary and bonus (based on personal & company performance)
  • 401(k) with competitive company matching
  • Comprehensive health insurance, vision, dental and FSA plans (medical, limited purpose, and dependent care)
  • Company paid group term life, short- term disability and long-term disability coverage
  • 24 Paid time off days, plus 2 Hiscox Days, 10 paid holidays, and ability to purchase 5 PTO days
  • Paid parental leave
  • 4 week paid sabbatical after every 5 years of service
  • Financial Adoption Assistance and Medical Travel Reimbursement Programs
  • Annual reimbursement up to $600 for health club membership or fees associated with any fitness program
  • Company paid subscription to Headspace to support employees’ mental health and wellbeing
  • Recipient of 2021 Cigna’s Well-Being Award for having a best-in-class health and wellness program
  • Dynamic, creative and values-driven culture
  • Modern and open office spaces, complimentary drinks
  • Spirit of volunteerism, social responsibility and community involvement, including matching charitable donations for qualifying non-profits via our sister non-profit company, the Hiscox USA Foundation

Salary Range - $140,000 - $165,000

LI-AS1

Work with amazing people and be part of a unique culture

30+ days ago
Related jobs
Promoted
VirtualVocations
Norcross, Georgia

A company is looking for a Principal Data and Integration Engineer in Remote, USA. Key Responsibilities:Define strategic IT objectives and lead subordinates towards the strategic visionAct as the primary focal point for software development tasks, providing updates and monitoring projectsAssist with...

Promoted
Trustpoint.One
Atlanta, Georgia

My client sits within the automated logistics and supply chain space and they are looking for help in building self-service enterprise-scale data platforms! They are looking for someone with the following experience:. What is your experience with data platforms? What were your individual responsibil...

Promoted
VirtualVocations
Norcross, Georgia

A company is looking for a Principal Data and Software Engineer. ...

Hiscox
Atlanta, Georgia

A robust understanding of core data engineering topics – ETL vs ELT, structured and unstructured data, data quality and data governance. Participating in code reviews for data engineering practice and as a principal ensuring that all engineers conduct such reviews to a high standard. While you will ...

KION Group
Atlanta, Georgia

Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions. Solid experience implementing data lineage, data quality and data observability for big data workflows. We are seeking a dynamic and highly skilled Principal Dat...

KY Innovation
Atlanta, Georgia

Senior Principal Software Engineer - Data Science - Secureworks. They must have strong experience using a variety of data analysis methods and data science libraries to build and implement new models. Assess the effectiveness and accuracy of new data sources and data gathering techniques. Research a...

DICE
Atlanta, Georgia

A pioneer in the video streaming space is looking to build out their engineering department after closing a new round of funding. You will be responsible for building scalable video streaming/data streaming platforms used by their clients. Experience with Data Streaming/Video Streaming. ...

Home Depot
GEORGIA, US
Remote

You'll have a chance to influence work on ETL pipelines, data engineering, analytics, BI, ML models that power our various marketing efforts, among others, while collaborating with other leaders in marketing, retail media and data engineering areas. Principal Engineer would focus on the system archi...

Excelon Solutions
Atlanta, Georgia

Solid experience with architectingand implementing metadata management including data catalogues datalineage data quality and data observability for big dataworkflows. Collaborate with data scientistsanalysts and cross functional teams to design data models databaseschemas and data storage solutions...

Intuit
Atlanta, Georgia

Demonstrated ability to communicate and collaborate at all levels - from front line engineers and non-technical stakeholders, to senior leaders in engineering or at the executive level. Advocate for the highest standards for engineering design, implementation, and testing. Partner with engineering l...