We are seeking a Senior QA Engineer / SDET with strong experience in data lake validation, Databricks automation, and reporting tool testing. The role focuses heavily on data validation, functional testing of Databricks transformations, and automation of data quality checks on enterprise-scale data pipelines.
Requirements :
- Hands-on experience with Databricks test automation, Spark, Python, and Azure
- Strong background in data lake validation and transformations
- Experience with automation frameworks, functional testing, and CI / CD integration
- Knowledge of Kusto (ADX), SQL, and Parquet / Delta formats
- UI automation experience is a plus
- Experience in financial transaction / payment validations preferred
- Excellent senior-level communication and strategy skills
Key Responsibilities :
Own test strategy, implementation, and automation for batch / streaming pipelines on Databricks, ADX, and cloud data lakesBuild automated tests and quality gates for ingestion, transformation, and output validationIntegrate test automation into CI / CD pipelinesPartner with data engineers, platform, and analytics teamsAutomate functional validation of Databricks transformationsCreate and execute use cases for payments and transactionsValidate data logs, reporting outputs, and PowerBI dashboardsSupport legacy test scripts while driving modernizationTop 3 Skills : Databricks Automation, Data Lake Validation, Azure / Python