A company is looking for a Databricks Data Engineer to join their data engineering and analytics team.
Key Responsibilities
Design and develop scalable data pipelines using Apache Spark on Databricks
Implement and maintain ETL / ELT workflows for both structured and unstructured data
Optimize Spark jobs for performance, scalability, and cost-efficiency
Required Qualifications
8+ years of experience in data engineering, including ETL / ELT development
5+ years of experience designing and optimizing data pipelines on Apache Spark / Databricks
Proven experience with Azure Data Factory and Azure Data Lake
Expertise in Python, R, and SQL for data processing and analysis
Hands-on experience with CI / CD automation and DevOps tools
Data Engineer • Bronx, New York, United States