Must Have : Certification : Required – Microsoft Certified : Azure Data Engineer Associate (or higher), Azure Data Factory,
Job Summary :
We are seeking a highly skilled Data Engineer with strong expertise in Azure Data Factory , Azure Databricks , Oracle , and PostgreSQL . The ideal candidate will design and implement robust data pipelines, optimize data flows, and contribute to our cloud data platform initiatives using the Microsoft Azure ecosystem.
Key Responsibilities :
- Design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks (Spark-based) .
- Ingest, transform, and orchestrate data from various sources including Oracle and PostgreSQL databases.
- Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver clean, reliable data.
- Optimize performance of data workflows, especially within Azure environments.
- Implement data quality checks, lineage tracking, and monitoring processes.
- Follow and contribute to data governance, security, and compliance policies.
- Participate in code reviews, documentation, and continuous improvement initiatives.
Required Skills & Experience :
Strong hands-on experience with Azure Data Factory and Azure Databricks (PySpark / Scala preferred).Solid working knowledge of Oracle and PostgreSQL databases, including writing efficient SQL queries.Proficient in building ETL / ELT workflows and data orchestration on Azure.Experience with Azure storage solutions (Blob Storage, ADLS Gen2).Strong understanding of data modeling, warehousing concepts, and performance optimization.Familiarity with CI / CD pipelines in Azure DevOps is a plus.Excellent problem-solving skills and ability to work independently or in a team.