Zurich (Schaumburg, IL) seeks a Senior Enterprise Data Engineer to be responsible for enabling data-driven decision-making through improved data flows and enhancing the suite of data and analytic tools and capabilities.
- Specific duties include : transform and curate raw data into analysis-ready datasets; partner with Data Scientists to optimize and harden code and queries;
- support, enhance, and upgrade the analytic tools and environment; provide day-to-day troubleshooting and technology support for the data science environment;
- develop data solutions that meet the business needs; evaluate data source tables and files; determine needed configurations for CDI pipeline notebooks and runbooks;
- design / develop pipeline processes; coordinate with SIT team for QA review and create deployment plan; design / develop new curation processes;
- perform deep-dive review of business requirements; determine proper technology / configurations / formats to use to optimize processing and adherence to Big Data Ecosystem standards and principles;
- coordinate development activities / timelines; enhance the balancing routines for critical premium and claim data sources;
identify opportunities and pursue enhancement of existing curations; and collaborate with team to share ideas / recommendations and refine solutions.
Option to work remotely is available.
Position requires a Bachelor’s degree, or foreign equivalent, in Computer Science, Information Systems Security, or a closely related field of study, plus 6 years of experience in the job offered, or as a Software Developer, Financial and Admin Business Analyst, or similar position responsible for enabling data-driven decision-making.
Must have 6 years of experience working in Enterprise Data Engineering. Must also have 5 years of experience working with programming languages including Scala, Python, Spark SQL, and Shell.
- Additionally, must have 3 years of experience with each of the following : working with data ingestion and data curation and cloud based computer platforms including databricks and HDInsights;
- resolving issues in the Azure data lake platform from data ingestion till data enablement for user reporting; designing and building Azure data pipelines through configuration driven development methods;
working with ETL technologies; and working with SQL and stored procedure.
As a condition of employment at Zurich, employees must adhere to any COVID-related health and safety protocols in place at that time ().