Search jobs > Chicago, IL > Lead data engineer

Lead Data Engineer

Epsilon
Chicago, IL
Full-time

Job Description

Position Overview

As a Lead Software Engineer, you will be at the forefront of designing, developing, and maintaining scalable, cloud-based software solutions.

You will provide technical mentorship and hands-on expertise, driving the successful delivery of high-quality software projects.

In this role, you will work closely with cross-functional teams, manage key components of production infrastructure, and contribute to advancing our engineering practices in a dynamic environment.

Key Responsibilities :

Technical Expertise : Design, develop, and maintain scalable, cloud-based software solutions across both frontend and backend components.

Participate actively in design reviews, code reviews, and technical discussions to enforce high standards and best practices.

Lead the development of new cloud-based product offerings and enhancements, ensuring solutions are robust, efficient, and maintainable.

Project Involvement : Collaborate with project managers and cross-functional teams to define project requirements, timelines, and deliverables.

Contribute to all phases of the software development lifecycle (SDLC), from initial planning and task prioritization to execution and delivery.

Ensure technical and functional aspects of projects align with business objectives and client requirements.

Infrastructure & Operations : Support the implementation and optimization of production infrastructure, focusing on reliability, scalability, and security.

Collaborate with technology vendors to troubleshoot software issues and integrate enhancements.Implement and advocate for best practices in building automated, security-compliant solutions.

Mentorship & Collaboration : Act as a technical mentor to junior engineers, providing guidance on best practices, code quality, and project execution.

Foster a collaborative environment, sharing knowledge and promoting a culture of continuous improvement and innovation.

Qualifications :

  • Education : Bachelor’s degree in computer science, Information Systems, or a related discipline.
  • Experience : 10+ years of experience in software engineering, focusing on cloud-based solutions and big data technologies.

Proven experience in designing and developing large-scale applications in hybrid, distributed, and cloud environments.Strong background in relational databases, big data tools (Hadoop, Spark, Hive), and cloud services (AWS, Azure).

Experience with CI / CD systems, DevOps practices, and infrastructure automation tools (e.g., Ansible, Terraform).Proficiency in programming languages like Python and scripting languages.

Skills : Strong knowledge of software engineering methodologies, including functional programming, object-oriented design, and design patterns.

Ability to manage and optimize big data pipelines, architectures, and datasets.Excellent organizational, time management, and communication skills.

Capable of effectively communicating with both technical and non-technical stakeholders.

Work Environment :

  • A dynamic, fast-paced environment focused on collaboration and continuous improvement.
  • Opportunities to work with cutting-edge technologies and contribute to innovative cloud-based solutions.
  • 30+ days ago
Related jobs
Promoted
Capital One
Chicago, Illinois

Lead Data Engineer - Card Tech. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Illinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data Engineer. Utilize programming languages like Java, Scala, Python ...

Promoted
Capital One
Chicago, Illinois

West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Python, AWS, Kafka)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capit...

Capital One
Chicago, Illinois

What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Uti...

Promoted
Capital One
Oak Lawn, Illinois

New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Data EngineerIllinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data EngineerCandidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered t...

Capital One
Oak Lawn, Illinois

New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Data EngineerIllinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data EngineerCandidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered t...

Promoted
Capital One
Harwood Heights, Illinois

New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Data EngineerIllinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data EngineerCandidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered t...

Capital One
Chicago, Illinois

New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Data EngineerIllinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data EngineerCandidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered t...

Capital One
Chicago, Illinois

As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Data Engineer. Illinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data Engineer. Utilize pro...

Capital One
Riverside, Illinois

This is a team of skilled data engineers that build robust data pipelines, ensuring data integrity accuracy and accessibility for all stakeholders. West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Spark, Scala, SQL)Do you love building and pioneering in the tech...

Epsilon
Chicago, Illinois

As a Lead Software Engineer, you will be at the forefront of designing, developing, and maintaining scalable, cloud-based software solutions. Strong background in relational databases, big data tools (Hadoop, Spark, Hive), and cloud services (AWS, Azure). Ability to manage and optimize big data pipe...