Search jobs > Chicago, IL > Lead data engineer

Lead Data Engineer

Epsilon
Chicago, IL, US
Full-time

Job Description

Position Overview

As a Lead Software Engineer, you will be at the forefront of designing, developing, and maintaining scalable, cloud-based software solutions.

You will provide technical mentorship and hands-on expertise, driving the successful delivery of high-quality software projects.

In this role, you will work closely with cross-functional teams, manage key components of production infrastructure, and contribute to advancing our engineering practices in a dynamic environment.

Key Responsibilities :

Technical Expertise : Design, develop, and maintain scalable, cloud-based software solutions across both frontend and backend components.

Participate actively in design reviews, code reviews, and technical discussions to enforce high standards and best practices.

Lead the development of new cloud-based product offerings and enhancements, ensuring solutions are robust, efficient, and maintainable.

Project Involvement : Collaborate with project managers and cross-functional teams to define project requirements, timelines, and deliverables.

Contribute to all phases of the software development lifecycle (SDLC), from initial planning and task prioritization to execution and delivery.

Ensure technical and functional aspects of projects align with business objectives and client requirements.

Infrastructure & Operations : Support the implementation and optimization of production infrastructure, focusing on reliability, scalability, and security.

Collaborate with technology vendors to troubleshoot software issues and integrate enhancements.Implement and advocate for best practices in building automated, security-compliant solutions.

Mentorship & Collaboration : Act as a technical mentor to junior engineers, providing guidance on best practices, code quality, and project execution.

Foster a collaborative environment, sharing knowledge and promoting a culture of continuous improvement and innovation.

Qualifications :

  • Education : Bachelor’s degree in computer science, Information Systems, or a related discipline.
  • Experience : 10+ years of experience in software engineering, focusing on cloud-based solutions and big data technologies.

Proven experience in designing and developing large-scale applications in hybrid, distributed, and cloud environments.Strong background in relational databases, big data tools (Hadoop, Spark, Hive), and cloud services (AWS, Azure).

Experience with CI / CD systems, DevOps practices, and infrastructure automation tools (e.g., Ansible, Terraform).Proficiency in programming languages like Python and scripting languages.

Skills : Strong knowledge of software engineering methodologies, including functional programming, object-oriented design, and design patterns.

Ability to manage and optimize big data pipelines, architectures, and datasets.Excellent organizational, time management, and communication skills.

Capable of effectively communicating with both technical and non-technical stakeholders.

Work Environment :

  • A dynamic, fast-paced environment focused on collaboration and continuous improvement.
  • Opportunities to work with cutting-edge technologies and contribute to innovative cloud-based solutions.
  • 30+ days ago
Related jobs
Promoted
VirtualVocations
Chicago, Illinois

A company is looking for a Senior Lead Software Engineer, Data to provide technical guidance and oversight for platform data components. ...

Promoted
Photon
Chicago, Illinois

Experience building and optimizing ‘big datadata pipelines, architectures, and data sets. Build processes supporting data transformation, data structures, metadata management, dependency, and workload management. Advanced working SQL knowledge and experience working with relational databases, quer...

Promoted
CCC Intelligent Solutions
Chicago, Illinois

CCC Intelligent Solutions, Inc seeks Lead Data Engineers for various & unanticipated worksites throughout the U. Masters in Computer Science/Computer Engineering/related field + 3 years experience OR Bachelors in Computer Science/Computer Engineering/related field + 5 years experience required. ...

Enova Financial
Chicago, Illinois

The Data Engineering, Warehouse, and Operations Team crafts sustainable data strategies and delivers impactful solutions across the organization. Work as a “full stack” Data Engineer, contributing to each phase of the SDLC, building a new pipeline between two data sources or working with the busines...

Northern Trust Corporation
Chicago, Illinois

Individual will specialize in data platforms, handling the design, implementation, and maintenance of data storage and processing solutions to ensure efficient data flow and accessibility, often collaborating with data engineers and analysts to support data-driven decision-making across an organizat...

Ryan Specialty Group
Chicago, Illinois

Provide technical leadership in data architecture and engineering, collaborating with solution stakeholders to align data solutions with business objectives. We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. Explore and implement new technologies and practi...

Ryan Specialty Group
Chicago, Illinois

Provide technical leadership in data architecture and engineering, collaborating with solution stakeholders to align data solutions with business objectives. We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. Explore and implement new technologies and practi...

Capital One
Chicago, Illinois

West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transform...

Epsilon
Chicago, Illinois

As a Lead Software Engineer, you will be at the forefront of designing, developing, and maintaining scalable, cloud-based software solutions. Strong background in relational databases, big data tools (Hadoop, Spark, Hive), and cloud services (AWS, Azure). Ability to manage and optimize big data pipe...

Epsilon
Chicago, Illinois

As a Lead Software Engineer, you will be at the forefront of designing, developing, and maintaining scalable, cloud-based software solutions. Strong background in relational databases, big data tools (Hadoop, Spark, Hive), and cloud services (AWS, Azure). Ability to manage and optimize big data pipe...