Senior Data Engineer

Wavicle Data Solutions, LLC seeks a Senior Data Engineer in Oak Brook, IL.

WHAT YOU WILL GET TO DO

• Responsible for designing and building optimized data pipelines, in an on-prem or cloud environment for the purpose of driving analytic insights.
• Create the conceptual, logical, and physical data models.
• Develop and implement end-to-end data pipelines and data integration solutions using cloud platforms such as AWS or GCP.
• Architect end-to-end data solutions ensuring integration across cloud platforms (AWS, GCP) with optimized ETL pipelines.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of sources like Hadoop, Spark, or AWS Lambda.
• Lead solution design and development of web-based data applications, providing technical direction on the front-end frameworks such as React.js, Vue.js, and SmartGWT to build interactive interfaces that support analytics and data exploration.
• Design, develop, test, deploy, maintain and improve data integration pipeline.
• Implement and manage CI / CD pipelines using Jenkins or GitHub Actions to automate the development, testing, and deployment of data engineering solutions.
• Guide the adoption of development best practices including version control (GIT), CI / CD pipelines, automated testing, and performance tuning.
• Develop pipeline objects using Apache Spark / PySpark / Python or Scala.
• Develop and maintain RESTful APIs and backend services to support data processing workflows and integration between data pipelines and user-facing systems.
• Lead and / or mentor a small team of Data Engineers.
• Communicate effectively with client leadership and business stakeholders.
• Participate in proposal and / or SOW development.

WHAT YOU BRING TO THE TEAM

BENEFITS

PI516ff79e2bce-30511-38695894