Talent.com
Sr Data Engineer

Sr Data Engineer

PopularRosemont, IL, United States
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.job_card.part_time
job_description.job_card.job_description

Job Type

Full Time Regular Opportunity

General Description

As a Senior Data Engineer, you'll hold a pivotal senior position within the Data Engineering function of Enterprise Data & Analytics division. In this critical role, you will orchestrate engineering activities across AWS, Informatica IDMC, and Snowflake platforms, ensuring robust and scalable data solutions that drive our data ecosystem forward. You'll lead a talented team of engineers and consultants, mentoring them to foster innovation and excellence while promoting best practices. Collaborating with multiple pillars across the division, you will align engineering efforts with organizational goals. This role will lay the modern foundation of the engineering unit, creating a strong data infrastructure, enabling advanced analytics and data-driven decision-making. By leveraging cloud-native technologies and data integration frameworks, you'll transform how we ingest, process, and deliver data assets across the enterprise. The ideal candidate brings deep technical knowledge alongside the leadership acumen to influence cross-functional teams and executives, positioning our data engineering capabilities as a competitive advantage in the financial services landscape. You will collaborate with multifaceted teams of specialists spread across various locations to offer a broad spectrum of data and analytics solutions. You will address complicated challenges and propel advancement within the Enterprise Data & Analytics function

Essential Duties and Responsibilities

  • Design and implement comprehensive AWS data pipeline leveraging S3 data lake architecture, Glue ETL workflows, and serverless data processing solutions using Lambda and Step Functions for event-driven architecture.
  • Establish robust security, monitoring, and automation through implementation of IAM roles and policies for secure access controls, CloudWatch monitoring and alerting for pipeline health and performance metrics.
  • Build and optimize Snowflake data pipelines utilizing Streams and Tasks for incremental processing, Snowpipe for continuous data loading, and stored procedures for complex transformations.
  • Configure and maintain Snowflake security features including role-based access control, Dynamic Data Masking, Row Access Policies, query optimization to manage compute costs effectively.
  • Develop and maintain IDMC Cloud Data Integration mappings and workflows for complex data transformation requirements, utilizing appropriate transformation types (Router, Joiner, Aggregator, Lookup) and implementing parameterization for reusable and flexible pipeline components.
  • Develop automated data validation frameworks between Informatica IDMC and Snowflake to ensure data integrity
  • Have a solid understanding of delivery methodology (SDLC) and lead teams in the implementation of the solution according to the design / architecture.
  • Implement Informatica PowerCenter to Informatica IDMC migration strategies for legacy data integration workflows
  • Lead cross-functional engineering teams through agile methodologies, sprint planning, and delivery management
  • Participate as active agile team members to help drive feature refinement, user story completion, code review, etc.
  • Collaborate with Data governance team and Implement data governance frameworks ensuring compliance with banking regulations (GDPR, CCPA, PCI-DSS).
  • Establish CI / CD practices for data engineering assets using tools like GitHub Actions, Jenkins, and AWS Code Pipeline.
  • Optimize data platform performance through query tuning, compute resource management, and architectural enhancements.
  • Develop data quality monitoring solutions that provide visibility into data completeness, accuracy, and timeliness.
  • Create and maintain technical documentation for engineering processes, architecture decisions, and system configurations
  • Monitor and troubleshoot production data pipelines to ensure reliability and minimize business disruption
  • Establish testing practices including unit, integration, and performance testing for data engineering solutions
  • Evaluate emerging technologies and recommend strategic adoption to enhance data engineering capabilities
  • Define and track key performance metrics for data engineering operations, identifying areas for improvement
  • Lead knowledge transfer sessions and technical training to upskill junior engineers and consultants
  • Collaborate with enterprise architecture teams to align data engineering solutions with broader technology strategies
  • Represent the data engineering pillar in cross-divisional planning sessions and strategic initiatives, advocating for necessary resources and priorities

Education

Bachelor's degree in computer science, Data Engineering, Statistics, or a related field.

Certifications / Licenses (Optional)

Cloud-based analytical services, showcasing extensive knowledge of cloud platforms for data analytics and machine learning

Experience

  • Minimum of then (10) years of experience in implementing large scale Data & Analytics platform in AWS, Azure, or Google Cloud, on-prem and Hybrid environment.
  • A minimum of seven (7) years of hands-on experience in Datawarehouse and Data Integration (ELT / ETL)
  • A minimum of five (5) years of robust experience in data engineering, data analytics, or a similar leadership role.
  • Other Qualifications

  • Demonstrated experience designing and implementing scalable data pipelines using AWS services (Glue, Lambda, Step Functions, S3, EMR)
  • Strong background and problem-solving skills with Enterprise Data warehouse, ETL / ELT development, Database Replication, metadata management and data quality.
  • Experience in delivering technical solutions in an iterative, agile environment (Scrum / Kanban)
  • Experience working with Data Lakes loading disparate data sources- Structured, semi-structured data (Flat files, XML, JSON, Parquet) and unstructured data.
  • Strong foundational leadership in Python and / or Apache Spark for processing, analyzing, and innovating in data engineering.
  • Demonstrated experience migrating on-premises ETL workloads to cloud-native solutions
  • Experience migrating traditional PowerCenter workflows to Informatica IDMC Cloud Data Integration.
  • Strategic leadership experience with a variety of databases, including Oracle, SQL Server, and MySQL, paired with advanced knowledge of SQL and PL / SQL for sophisticated data querying, manipulation, and database management.
  • Deep understanding and hands-on experience with big data platforms such as Snowflake, Redshift, Big query, Spark, or similar transformative technologies.
  • Strong data warehouse applications knowledge in preferably in financial / insurance domain is required.
  • Knowledge of real-time data integration patterns using technologies like Kafka, Kinesis, or Snowpipe
  • Track record of successful large-scale data migration projects from legacy systems to modern cloud platforms
  • Exceptional ability to interpret complex data and communicate strategic insights to both technical and non-technical stakeholders in a leadership capacity.
  • Exceptional critical thinking, problem-solving skills, and a strong vision for the analytics domain's future.
  • A strong commitment to continuous learning, development, and staying ahead of industry trends in the data analytics domain.
  • Stellar written and verbal communication skills coupled with a meticulous attention to detail and the ability to convey strategic visions and plans.
  • Demonstrated leadership abilities in a collaborative, dynamic, and fast-paced environment, managing multiple priorities with strategic acumen.
  • Demonstrated proficiency in agile-based development methodologies, championing methodologies like Scrum and Kanban for collaborative, innovative, and efficient data product development.
  • Visionary ability to manage big data, with proven hands-on leadership in managing and processing voluminous, complex datasets.
  • Foundational leadership in managing diverse data feeds, including batch, near real-time, and real-time, ensuring strategic, efficient data management and processing.
  • Region Locations

    Hybrid opportunity from Rosemont, IL or San Juan, PR

    Values

    Passion for People

    Succeed Together

    Own Every Moment

    Build the Future

    Base Salary & Benefits

    Our base salary for this position located in Rosemont, IL generally ranges between $165,000 and $175,000 annually, depending on business needs and, on your qualifications, and experience. Base salary does not include incentive compensation, commissions, or any other type of remuneration or benefits. In addition to salary, Popular's well-rounded benefits package for regular full-time and part-time employees includes a comprehensive health plan, flexible time off options, and savings and investment plans. Seasonal / temporary employees are not eligible for these benefits."

    Important : The candidate must provide evidence of academic preparation or courses related to the job posting, if necessary.

    ABOUT US

    Popular is Puerto Rico's leading financial institution and have been evolving since it was founded over a century ago. From a small bank it has developed into a large corporation that offer a wide variety of services and financial solutions to our customers, with presence in the United States, the Caribbean and Latin America.

    As employees, we are dedicated to making our customers dreams come true by offering financial solutions in each stage of their life. Our extensive trajectory demonstrates the resiliency and determination of our employees to innovate, reach for the right solutions and strongly support the communities we serve; therefore, we value their diverse skills, experiences and backgrounds.

    We reaffirm our commitment to always offer essential financial services and solutions for our customers and communities, including during emergency situations and / or natural disasters. Popular's employees are considered essential workers, whose role is critical in the continuity of these important services even under such circumstances. By applying to this position, you acknowledge that Popular may require your services during and immediately after any such events.

    If you have a disability or need more information about requesting an accommodation, please contact us at asesorialaboral@popular.com. This email inbox is monitored for such types of requests only . All information you provide will be kept confidential and will be used only to the extent required to provide needed exemptions or reasonable accommodations. Any other correspondence will not receive a response.

    Are you ready for a rewarding career?

    Popular is an Equal Opportunity Employer

    Learn more about us at www.popular.com and keep updated with our latest job postings at www.jobs.popular.com.

    Connect with us!

    LinkedIn | Facebook | Twitter | Instagram

    If you are a California resident, please click here to learn more about your privacy rights.

    serp_jobs.job_alerts.create_a_job

    Sr Data Engineer • Rosemont, IL, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    VirtualVocationsAurora, Illinois, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer to design and maintain data systems and pipelines.Key Responsibilities Design, build, and maintain ETL / ELT pipelines for data movement and processing Dev...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Staff Data Engineer

    Senior Staff Data Engineer

    VirtualVocationsNaperville, Illinois, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Staff Data Engineer - Cloud Analytics & FinOps Engineering Platform.Key Responsibilities Design and implement scalable data warehousing solutions for cost and us...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsNaperville, Illinois, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer.Key Responsibilities Design and implement scalable data architecture and solutions for analytics and reporting Build and maintain ETL / ELT pipeline...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Spectraforce TechnologiesAbbott Park, IL, United States
    serp_jobs.job_card.full_time
    Location : Chicago, IL (Remote).We're launching a focused 3-month initiative to : .Bulk-ingest over 50,000 supplier contracts into SAP Ariba, with metadata extraction powered by OCR.Design and implem...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Double GoodChicago, IL, United States
    serp_jobs.job_card.full_time
    Double Good's mission is to create joy.We create joy with our delectable and award-winning popcorn.We create joy with our easy-to-use fundraising platform that raises a meaningful amount of money f...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Argonaut Management Services, IncChicago, IL, United States
    serp_jobs.job_card.full_time
    Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Integration Engineer

    Senior Data Integration Engineer

    VirtualVocationsNaperville, Illinois, United States
    serp_jobs.job_card.full_time
    Key Responsibilities Integrate and maintain interoperability solutions for clinical and scheduling data from EHR systems Provide operational support during new client integrations and document b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead AI Data Engineer

    Lead AI Data Engineer

    VirtualVocationsAurora, Illinois, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead AI and Data Solution Engineer (LLMs, MCP).Key Responsibilities Lead the design, development, and deployment of enterprise-scale data and AI solutions Architect an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsNaperville, Illinois, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Data Engineer to join their innovative team.Key Responsibilities Define and manage the end-to-end data architecture and set standards for data schemas and mod...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Azure Data Engineer

    Azure Data Engineer

    VirtualVocationsAurora, Illinois, United States
    serp_jobs.job_card.full_time
    A company is looking for an Azure Data Engineer to lead the administration, integration, and technical optimization of Microsoft Purview. Key Responsibilities Serve as the technical owner and admi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    VirtualVocationsNaperville, Illinois, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Azure Data Engineer.Key Responsibilities Designs and develops data solutions using Microsoft Azure technologies to meet business needs Manages IT controls and pro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Sr. Data Engineer

    Sr. Data Engineer

    EcolabNaperville, IL, United States
    serp_jobs.job_card.full_time
    Paul, MN or Naperville, IL to join the Analytics and Digital Solutions Team within Ecolab Digital in support of Global Supply Chain. If you're a passionate professional seeking growth and a rewardin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Sr Data Engineer

    Sr Data Engineer

    Banco Popular Puerto RicoDes Plaines, IL, United States
    serp_jobs.job_card.full_time +1
    As a Senior Data Engineer, you'll hold a pivotal senior position within the Data Engineering function of Enterprise Data & Analytics division. In this critical role, you will orchestrate engineering...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocationsNaperville, Illinois, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Platform Engineer, Data Capture.Key Responsibilities Expand developer tools for capturing business events and operational data into the Lakehouse Enhance self-ser...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior SAP BW Data Engineer

    Senior SAP BW Data Engineer

    VirtualVocationsNaperville, Illinois, United States
    serp_jobs.job_card.full_time
    Key Responsibilities Implement updates to SAP BW extractors, transformations, info packages, and process chains Develop modern data solutions using Azure Synapse Workflows, Data Pipelines, and S...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    Old National BankChicago, IL, United States
    serp_jobs.job_card.full_time
    US-MN-Lake Elmo | US-IN-Evansville | US-IL-Chicago | US-IN-Indianapolis | US-MN-Saint Paul | US-MN-St Louis Park.Old National Bank has been serving clients and communities since 1834.With over $70 ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Sr. Data Engineer

    Sr. Data Engineer

    Vivid SeatsChicago, IL, US
    serp_jobs.job_card.full_time
    Founded in 2001, Vivid Seats (NASDAQ : SEAT) is a leading online ticket marketplace committed to becoming the ultimate partner for connecting fans to the live events, artists, and teams they love.We...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_less
    • serp_jobs.job_card.promoted
    Sr Data Engineer

    Sr Data Engineer

    McDonald's CorporationChicago, IL, United States
    serp_jobs.job_card.full_time
    McDonald's growth strategy, Accelerating the Arches, encompasses all aspects of our business as the leading global omni-channel restaurant brand. As the consumer landscape shifts we are using our co...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day