Azure Databricks Engineer

for first 1-2 week cnadidate needs to work onsite in Chicago, IL and then it will be remote (client wont pay for any expenses for this)

Job Description : Azure Databricks Engineer

Job Title : Azure Databricks Engineer

Location : Chicago, IL and then Remote

Qualifications :

Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.

5+ years of experience in data engineering, with at least 3 years focused on Azure data platforms.

Strong expertise in Azure Databricks, Apache Spark, and Delta Lake.

Proficiency in programming languages such as Python, Scala, or PySpark.

Hands-on experience with Azure Data Lake Storage Gen2 (ADLS Gen2).

Solid understanding of relational and NoSQL databases, data warehousing concepts, and data modeling.

Experience with other Azure data services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Event Hubs).

Familiarity with version control systems (e.g., Git).

Experience with CI / CD pipelines for data solutions (e.g., Azure DevOps).

Excellent problem-solving skills, analytical thinking, and attention to detail.

Strong communication and interpersonal skills, with the ability to collaborate effectively with technical and non-technical stakeholders.

Preferred Qualifications :

Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert).

Experience with real-time data streaming technologies (e.g., Kafka, Azure Event Hubs / Stream Analytics).

Knowledge of data governance, data security, and compliance best practices in a cloud environment.

Familiarity with machine learning workflows and MLOps within Databricks.

Experience with Databricks Workflows or similar orchestration tools.

If you are interested or have any references please share resume at mukul@brightmindsol.com.