Zurich (Schaumburg, IL) seeks a Senior Enterprise Data Engineer to be responsible for enabling data-driven decision-making through improved data flows and enhancing the suite of data and analytic tools and capabilities.
- Specific duties include : transform and curate raw data into analysis-ready datasets; partner with Data Scientists to optimize and harden code and queries;
- support, enhance, and upgrade the analytic tools and environment; provide day-to-day troubleshooting and technology support for the data science environment;
- develop data solutions that meet the business needs; evaluate data source tables and files; determine needed configurations for CDI pipeline notebooks and runbooks;
- design / develop pipeline processes; coordinate with SIT team for QA review and create deployment plan; design / develop new curation processes;
- perform deep-dive review of business requirements; determine proper technology / configurations / formats to use to optimize processing and adherence to Big Data Ecosystem standards and principles;
- coordinate development activities / timelines; enhance the balancing routines for critical premium and claim data sources;
identify opportunities and pursue enhancement of existing curations; and collaborate with team to share ideas / recommendations and refine solutions.
Option to work remotely is available.
Position requires a Bachelor’s degree, or foreign equivalent, in Computer Science, Information Systems Security, or a closely related field of study, plus 6 years of experience in the job offered, or as a Software Developer, Financial and Admin Business Analyst, or similar position responsible for enabling data-driven decision-making.
Must have 6 years of experience working in Enterprise Data Engineering. Must also have 5 years of experience working with programming languages including Scala, Python, Spark SQL, and Shell.
- Additionally, must have 3 years of experience with each of the following : working with data ingestion and data curation and cloud based computer platforms including databricks and HDInsights;
- resolving issues in the Azure data lake platform from data ingestion till data enablement for user reporting; designing and building Azure data pipelines through configuration driven development methods;
working with ETL technologies; and working with SQL and stored procedure.
As a condition of employment at Zurich, employees must adhere to any COVID-related health and safety protocols in place at that time ().
Senior Data Engineer, Card Tech
Senior Data Engineer, Card Tech. As a Capital One Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing ...
Senior Data Engineer
The ideal candidate will collaborate with a team to identify new and novel approaches to apply engineering solutions to improve quality and speed of work within a data warehouse while leveraging big data solutions, integrations and self-service tooling. Data observability – Data testing – CI/CD – Co...
Senior/Lead Data Engineer
We are seeking a seasoned Data Engineer to lead the design, development, and implementation of data, BI, and analytic solutions. Hands-on experience with large-scale data projects and enterprise data warehouse systems, preferably in cloud environments. This role involves business process analysis, d...
Cloud Data Engineer Senior Consultant
Net, C#, Qlik, Power BI, Machine Learning, Azure Data Factory, RedShift, UiPath, Cloud, RPA, AWS, Redshift, Kinesis, QuickSight, SageMaker, S3, Databricks, AWS Lake Formation, Snowflake, Python, Qlik, Athena, Data Pipeline, Glue, Star Schema, Data Modeling, SQL, SSIS, SSAS, SSRS, PySpark, Microsoft ...
Senior Big Data Engineer
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...
Senior Data Engineer
As a Data Engineer specializing in fraud detection services, you will play a pivotal role in our technology team, focusing on building robust data pipelines and scalable infrastructure within a Hadoop environment. You will work closely with data scientists, software engineers, and analysts to ensure...
Senior Software Engineer - Cloud Data Governance and Catalog (CDGC, CDQ, CDI, EDC, Axon)
As a Senior Software Engineer on/in Data Management & Governance Platform you will partner with product owners, tech leads, designers, engineers and delivery professionals to improve Platform and Innovation services. Experience on working with Cloud Data Governance Catalog (CDGC), Cloud Data Int...
Senior Java Data Engineer
As a Data Engineer specializing in fraud detection services, you will play a pivotal role in our technology team, focusing on using Java to build robust data pipelines and scalable infrastructure within a Hadoop environment. You will work closely with data scientists, software engineers, and analyst...
Senior Data Engineer
As a Senior Data Engineer, your job will play a pivotal role in designing, building and maintain complex data processing systems. As a Senior Data Engineer with us you will contribute to cutting-edge solutions in Payment Fraud and Account Protection using technology such as Hadoop, Spark, Kafka, Doc...
Senior Data Engineer / Snowflake
The ideal candidate will have a strong background in data engineering, with experience in building and maintaining robust data pipelines, implementing data warehousing solutions, and ensuring data quality and reliability. We are looking for a skilled Data Engineer with expertise in utilizing various...