Search jobs > Schaumburg, IL > Senior engineer data

*Senior Enterprise Data Engineer

Zurich Insurance Company
Schaumburg, IL, US
Full-time

Zurich (Schaumburg, IL) seeks a Senior Enterprise Data Engineer to be responsible for enabling data-driven decision-making through improved data flows and enhancing the suite of data and analytic tools and capabilities.

  • Specific duties include : transform and curate raw data into analysis-ready datasets; partner with Data Scientists to optimize and harden code and queries;
  • support, enhance, and upgrade the analytic tools and environment; provide day-to-day troubleshooting and technology support for the data science environment;
  • develop data solutions that meet the business needs; evaluate data source tables and files; determine needed configurations for CDI pipeline notebooks and runbooks;
  • design / develop pipeline processes; coordinate with SIT team for QA review and create deployment plan; design / develop new curation processes;
  • perform deep-dive review of business requirements; determine proper technology / configurations / formats to use to optimize processing and adherence to Big Data Ecosystem standards and principles;
  • coordinate development activities / timelines; enhance the balancing routines for critical premium and claim data sources;

identify opportunities and pursue enhancement of existing curations; and collaborate with team to share ideas / recommendations and refine solutions.

Option to work remotely is available.

Position requires a Bachelor’s degree, or foreign equivalent, in Computer Science, Information Systems Security, or a closely related field of study, plus 6 years of experience in the job offered, or as a Software Developer, Financial and Admin Business Analyst, or similar position responsible for enabling data-driven decision-making.

Must have 6 years of experience working in Enterprise Data Engineering. Must also have 5 years of experience working with programming languages including Scala, Python, Spark SQL, and Shell.

  • Additionally, must have 3 years of experience with each of the following : working with data ingestion and data curation and cloud based computer platforms including databricks and HDInsights;
  • resolving issues in the Azure data lake platform from data ingestion till data enablement for user reporting; designing and building Azure data pipelines through configuration driven development methods;

working with ETL technologies; and working with SQL and stored procedure.

As a condition of employment at Zurich, employees must adhere to any COVID-related health and safety protocols in place at that time ().

30+ days ago
Related jobs
Zurich Insurance Company
Schaumburg, Illinois

Specific duties include: transform and curate raw data into analysis-ready datasets; partner with Data Scientists to optimize and harden code and queries; support, enhance, and upgrade the analytic tools and environment; provide day-to-day troubleshooting and technology support for the data science ...

SS&C Technologies
IL, US

Senior Data Protection Engineer provides implementation, maintenance, and support services for enterprise data protection. Senior Data Protection Engineer. Senior Data Protection Engineers are responsible for end-to-end maintenance assessing, assessing change impact, identifying, and resolving issue...

GoHealth
Illinois

As a Senior Software Engineer at GoHealth, you will play a key role in the development and enhancement of our Customer 360 platform and Delta Tables datalake in Databricks. Additionally, you will implement and maintain data validation and monitoring systems to uphold data quality and troubleshoot an...

Wolters Kluwer United States Inc.
Remote, IL, USA
Remote

Senior Data Architect (Principal Enterprise Architect) - Remote R0038318. Principal Enterprise Architect) to collaborate with different divisions and create a coalition/task force to reverse engineer products and look for inefficiencies. Principal Enterprise Architect), you will partner with several...

Motion Recruitment
Rolling Meadows, Illinois

The ideal candidate will have a strong background in data engineering, with experience in building and maintaining robust data pipelines, implementing data warehousing solutions, and ensuring data quality and reliability. We are looking for a skilled Data Engineer with expertise in utilizing various...

MMD Services
Elmhurst, Illinois

As the Senior Data Engineering Lead you will act as a pivotal contributor, steering the data management infrastructure and catering to the dynamic data requirements of our client’s organization. The successful candidate will work closely with the Manager of Data Engineering and spearhead data manage...

Motion Recruitment
Itasca, Illinois

As a Data Engineer specializing in fraud detection services, you will play a pivotal role in our technology team, focusing on building robust data pipelines and scalable infrastructure within a Hadoop environment. You will work closely with data scientists, software engineers, and analysts to ensure...

US012 Marsh & McLennan Agency LLC
Schaumburg, Illinois

As a Senior Data Engineer on the MMA National IT Data and Analytics Team, we will count on you to develop and maintain scalable data pipelines, enhance data models, and provide subject matter expertise in data acquisition and consumption pipelines on Azure, Databricks and Confluent. In-depth underst...

Motion Recruitment
Rolling Meadows, Illinois

The ideal candidate will have a strong background in data engineering, with experience in building and maintaining robust data pipelines, implementing data warehousing solutions, and ensuring data quality and reliability. We are looking for a skilled Data Engineer with expertise in utilizing various...

Arctic Wolf
Remote, Illinois
Remote

Senior Sales Engineer - Enterprise CDW. The Senior Sales Engineer is the technical backbone of the sales organization. And we appreciate that—by protecting people’s and organizations’ sensitive data and seeking to end cyber risk— we get to work in an industry that is fundamental to the greater good....