Lead Data Engineer

Epsilon
Wakefield, MA, US
Full-time

Job Description

Position Overview

As a Lead Software Engineer, you will be at the forefront of designing, developing, and maintaining scalable, cloud-based software solutions.

You will provide technical mentorship and hands-on expertise, driving the successful delivery of high-quality software projects.

In this role, you will work closely with cross-functional teams, manage key components of production infrastructure, and contribute to advancing our engineering practices in a dynamic environment.

Key Responsibilities :

Technical Expertise : Design, develop, and maintain scalable, cloud-based software solutions across both frontend and backend components.

Participate actively in design reviews, code reviews, and technical discussions to enforce high standards and best practices.

Lead the development of new cloud-based product offerings and enhancements, ensuring solutions are robust, efficient, and maintainable.

Project Involvement : Collaborate with project managers and cross-functional teams to define project requirements, timelines, and deliverables.

Contribute to all phases of the software development lifecycle (SDLC), from initial planning and task prioritization to execution and delivery.

Ensure technical and functional aspects of projects align with business objectives and client requirements.

Infrastructure & Operations : Support the implementation and optimization of production infrastructure, focusing on reliability, scalability, and security.

Collaborate with technology vendors to troubleshoot software issues and integrate enhancements.Implement and advocate for best practices in building automated, security-compliant solutions.

Mentorship & Collaboration : Act as a technical mentor to junior engineers, providing guidance on best practices, code quality, and project execution.

Foster a collaborative environment, sharing knowledge and promoting a culture of continuous improvement and innovation.

Qualifications :

  • Education : Bachelor’s degree in computer science, Information Systems, or a related discipline.
  • Experience : 10+ years of experience in software engineering, focusing on cloud-based solutions and big data technologies.

Proven experience in designing and developing large-scale applications in hybrid, distributed, and cloud environments.Strong background in relational databases, big data tools (Hadoop, Spark, Hive), and cloud services (AWS, Azure).

Experience with CI / CD systems, DevOps practices, and infrastructure automation tools (e.g., Ansible, Terraform).Proficiency in programming languages like Python and scripting languages.

Skills : Strong knowledge of software engineering methodologies, including functional programming, object-oriented design, and design patterns.

Ability to manage and optimize big data pipelines, architectures, and datasets.Excellent organizational, time management, and communication skills.

Capable of effectively communicating with both technical and non-technical stakeholders.

Work Environment :

  • A dynamic, fast-paced environment focused on collaboration and continuous improvement.
  • Opportunities to work with cutting-edge technologies and contribute to innovative cloud-based solutions.
  • 30+ days ago
Related jobs
Promoted
Motional
Boston, Massachusetts

The Data Insight Team is focused on developing tools for large-scale data analysis to identify issues in the stack and compare autonomous performance with human performance. You will have leadership opportunities to build tools for large-scale data analysis while working directly with consumers, for...

Promoted
Klaviyo Inc.
Boston, Massachusetts

At Klaviyo, we love tackling tough engineering problems and look for engineers who specialize in certain areas but are passionate about building, owning & scaling features end to end from scratch and breaking through any obstacle or technical challenge in their way. The DataLake and View Integra...

Promoted
Zelis
Boston, Massachusetts

Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards. Lead, Mentor and develop offshore Data Engineers in adopting best practices and deliver data products. Anticipate, identify, and ...

Promoted
Voda Cleaning & Restoration of St. Louis
Boston, Massachusetts

The Lead Data Engineer will be instrumental in the digital and analytical transformation at BCBSMA by designing and implementing scalable data integration solutions. This role involves building highly available data platforms that process various forms of data, with a strong focus on a cloud-first s...

The Resource Technology Partners
Boston, Massachusetts

You’ll be instrumental in crafting unique approaches to solving difficult problems, contribute in the continuous improvement of our engineering practices, helping to build out data models, outlining public APIs, and open 3rd-party SDKs. Senior Software Engineer - Greenfield Development (Full-time). ...

Next Step Systems – Recruiters for Information Technology Jobs Top IT Recruiting Firm
Boston, Massachusetts
Remote

Keywords: Boston MA Jobs, Lead SQL Data Engineer, C#, Python, ETL, RESTful, SOAP, OOP, Data Structures, Algorithms, Cloud, AWS, Remote, Work From Home, Software Engineer, Programming, Programmer Analyst, Massachusetts Recruiters, IT Jobs, Massachusetts Recruiting. Lead SQL Data Engineer with ETL Exp...

The Resource Technology Partners
Boston, Massachusetts

They're in a very exciting period of growth and I'm helping them find a Lead Cloud Engineer (AWS) for their growing engineering team. This is a lead role so it’s important to be results driven with excellent analytical and problem-solving abilities, and excel at time management. ...

Capital One
Cambridge, Massachusetts

West Creek 3 (12073), United States of America, Richmond, VirginiaLead Data Engineer. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transforma...

The Resource Technology Partners
Boston, Massachusetts

You’ll be instrumental in crafting unique approaches to solving difficult problems, contribute in the continuous improvement of our engineering practices, helping to build out data models, outlining public APIs, and open 3rd-party SDKs. Senior Software Engineer - Greenfield Development (Full-time). ...

Epsilon
Wakefield, Massachusetts

As a Lead Software Engineer, you will be at the forefront of designing, developing, and maintaining scalable, cloud-based software solutions. Strong background in relational databases, big data tools (Hadoop, Spark, Hive), and cloud services (AWS, Azure). Ability to manage and optimize big data pipe...