Design and implement scalable data architectures using Databricks and cloud-based platforms.
Develop and maintain data models, databases, and ETL pipelines.
Integrate legacy systems including MS Access into modern data platforms.
Collaborate with software engineers to build data-driven applications using .NET technologies.
Ensure data quality, governance, and security across all systems.
Work closely with business stakeholders to understand data requirements and translate them into technical solutions.
Optimize performance of data systems and troubleshoot issues as they arise.
Document data architecture standards, processes, and best practices.
Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch and real-time data integration frameworks using Databricks.
Experience in Databricks cluster optimization and workflow management to ensure cost-effective and high-performance processing.
Sound knowledge of data modelling, data governance, data quality management, and data modernization processes.
Develop architecture blueprints and technical design documentation for data solutions.
Provide technical leadership and guidance on cloud architecture best practices, ensuring scalable and secure solutions.