Search jobs > Chicago, IL > Lead data engineer

Lead Data Engineer

Epsilon
Chicago, IL
Full-time

Job Description

Position Overview

As a Lead Software Engineer, you will be at the forefront of designing, developing, and maintaining scalable, cloud-based software solutions.

You will provide technical mentorship and hands-on expertise, driving the successful delivery of high-quality software projects.

In this role, you will work closely with cross-functional teams, manage key components of production infrastructure, and contribute to advancing our engineering practices in a dynamic environment.

Key Responsibilities :

Technical Expertise : Design, develop, and maintain scalable, cloud-based software solutions across both frontend and backend components.

Participate actively in design reviews, code reviews, and technical discussions to enforce high standards and best practices.

Lead the development of new cloud-based product offerings and enhancements, ensuring solutions are robust, efficient, and maintainable.

Project Involvement : Collaborate with project managers and cross-functional teams to define project requirements, timelines, and deliverables.

Contribute to all phases of the software development lifecycle (SDLC), from initial planning and task prioritization to execution and delivery.

Ensure technical and functional aspects of projects align with business objectives and client requirements.

Infrastructure & Operations : Support the implementation and optimization of production infrastructure, focusing on reliability, scalability, and security.

Collaborate with technology vendors to troubleshoot software issues and integrate enhancements.Implement and advocate for best practices in building automated, security-compliant solutions.

Mentorship & Collaboration : Act as a technical mentor to junior engineers, providing guidance on best practices, code quality, and project execution.

Foster a collaborative environment, sharing knowledge and promoting a culture of continuous improvement and innovation.

Qualifications :

  • Education : Bachelor’s degree in computer science, Information Systems, or a related discipline.
  • Experience : 10+ years of experience in software engineering, focusing on cloud-based solutions and big data technologies.

Proven experience in designing and developing large-scale applications in hybrid, distributed, and cloud environments.Strong background in relational databases, big data tools (Hadoop, Spark, Hive), and cloud services (AWS, Azure).

Experience with CI / CD systems, DevOps practices, and infrastructure automation tools (e.g., Ansible, Terraform).Proficiency in programming languages like Python and scripting languages.

Skills : Strong knowledge of software engineering methodologies, including functional programming, object-oriented design, and design patterns.

Ability to manage and optimize big data pipelines, architectures, and datasets.Excellent organizational, time management, and communication skills.

Capable of effectively communicating with both technical and non-technical stakeholders.

Work Environment :

  • A dynamic, fast-paced environment focused on collaboration and continuous improvement.
  • Opportunities to work with cutting-edge technologies and contribute to innovative cloud-based solutions.
  • 30+ days ago
Related jobs
Promoted
Capital One
Chicago, Illinois

Lead Data Engineer (Python, Spark, AWS). As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Illinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data Engineer. Utilize programming languages like Java, Scala...

Promoted
Capital One
Melrose Park, Illinois

Center 1 (19052), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a ...

Promoted
Capital One
Chicago, Illinois

As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Data Engineer. Illinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data Engineer. Utilize pro...

Promoted
Capital One
Chicago, Illinois

West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Python, Spark, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capit...

Promoted
Capital One
Chicago, Illinois

Lead Data Engineer (python, Spark, Big Data, AWS). As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Illinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data Engineer. Utilize programming languages like J...

Promoted
Capital One
Broadview, Illinois

This is a team of skilled data engineers that build robust data pipelines, ensuring data integrity accuracy and accessibility for all stakeholders. West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Spark, Scala, SQL)Do you love building and pioneering in the tech...

Promoted
Promote Project
Chicago, Illinois

Overall 5+ years of experience in Data Engineering. Azure platform and Azure SQL database. Azure Data Factory (ADF) and Azure Functions. Good knowledge and experience with Spark, Databricks and PySpark. ...

Promoted
Zoro
Chicago, Illinois

Collaborates closely with other Technical Leads and Staff Data Engineers to align the team with the technical vision for the Data Engineering department, ensuring the team meets its objectives and delivers high-quality work. As a Senior Data Engineer II - Technical Lead at Zoro, you will lead medium...

Ryan Specialty Group
Chicago, Illinois

Provide technical leadership in data architecture and engineering, collaborating with solution stakeholders to align data solutions with business objectives. We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. Explore and implement new technologies and practi...

Motion Recruitment
Chicago, Illinois

As a Lead Data Engineer, you will play a pivotal role in creating, designing, and deploying ETL and ELT flows for consuming data from disparate sources of 3rd party data. Your responsibilities will also include building tooling to monitor data pipelines, performing troubleshooting and debugging to i...