Senior Data Engineer

Job Description

We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.

Key Responsibilities :

• Model Development : Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks.
• Cloud Infrastructure : Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience.
• ETL Pipeline Development : Create, manage, and optimize ETL pipelines using PySpark for large-scale data processing.
• CI / CD Implementation : Build and maintain CI / CD pipelines for deploying and maintaining cloud-based applications.
• Data Analysis : Perform detailed data analysis and deliver actionable insights to stakeholders.
• Collaboration : Work closely with cross-functional teams to understand requirements, present solutions, and ensure alignment with business goals.
• Agile Methodology : Operate effectively in agile or hybrid agile environments, delivering high-quality results within tight deadlines.
• Framework Development : Enhance and expand existing frameworks and capabilities to support evolving business needs.
• Documentation and Communication : Create clear documentation and present technical solutions to both technical and non-technical audiences.

Requirements

Domain Expertise :

Technical Skills :

Soft Skills :

Preferred Qualifications :

Benefits