Our client is currently seeking a Databricks Platform Engineer
This role is hybrid and can sit in Denver, CO or Minneapolis, MN
Responsibilities :
- Configure, deploy and maintain Databricks clusters and workspaces.
- Use Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources.
- Ensure consistency and repeatability by treating infrastructure as code, monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
- Implement and manage access controls and security policies to protect sensitive data.
- Manage platform feature and software releases and updates.
- Provide technical support to Databricks users, including troubleshooting and issue resolution.
- Conduct training sessions to educate users on platform best practices and capabilities.
- Optimize cluster configurations for performance and cost-effectiveness.
- Monitor and manage auto-scaling to ensure resources are allocated efficiently.
- Implement and enforce security policies, access controls, and encryption mechanisms.
- Stay up-to-date with security best practices and compliance requirements.
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
- Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
- Monitor and manage platform costs, including optimizing resource utilization to control expenses.
- Maintain detailed documentation of configurations, procedures, and best practices.
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions.
Qualifications :
- Bachelor's degree in a relevant field (computer science, data engineering,
- 7+ years of related professional experience.
- 3 years’ experience with Databricks Lakehouse Platform Architecture on AWS
- Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI / CD pipelines, MLOps Proficiency in AWS cloud platforms
- Experience in Utility and Energy related business is a plus.
Databricks Platform Engineer
Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes. Databricks Lakehouse Platform Architecture on AWS . Configure, deploy and maintain Databricks clusters and workspaces. Use Terraform to provision and deploy Databricks clusters, workspac...
AWS Cloud Engineer | Remote US
Strong experience with AWS, Azure, or GCP platform capabilities and services (Cloud Architect, Cloud DevOps Engineer, or Cloud Security Engineer). Become a member of a highly-collaborative engineering team offering a unique blend of engineering solutions. Serve as the cloud SME to clients within des...
Senior Data Analyst (Measurement and Standards)
Improve and recommend data collection, cleaning, and quality control specifications and data sampling techniques. Work with other data scientists and analysts to develop best practices for analytics teams. As the Senior Data Instrumentation, Measurement and Standards, Performance Analytics you will ...
AWS Cloud Engineer
A company is looking for a Cloud Engineer for a remote position in the United States. ...
Data Scientist AI Engineer
Are you prepared to work with a strong software engineering team that is dedicated to disrupting the status quo? Are you looking for a challenge that will leave you feeling fulfilled? If yes, our AI Software Engineer role is perfect for you!. This role is roughly 80% software engineering and 20% dat...
Senior Data Engineer
Proven success in communication with database users, software engineers and senior management to collect requirements, discuss data modeling decisions and define data engineering strategies. Partner with data scientists, software engineers and cross-functional stakeholders (Marketing, Operations, Fi...
Senior Data Engineer
Whether it is creating and managing visualizations in our reporting platform for our customers to utilize on the front-end, engineering ETLs regarding numerous data sources feeding our dashboards and databases on the back-end, or supporting our operational teams with custom data processes, you will ...
Machine Learning Engineer
Our client, Skinio (), a rapidly expanding AI-based technology firm focused on early detection skin cancer solutions, seeks a talented Machine Learning Engineer to join their close-knit team (this is a remote role, but the candidate needs to be in the Denver area). If you have proven experience in m...
DevOps Engineer - REMOTE
As a Senior DevOps Engineer, you will be responsible for automating and optimizing development and operations processes. Guide and mentor a team of DevOps engineers. Enhance Terraform and PowerShell code, and Azure DevOps pipelines. Improve IT DevOps efficiency through automation and documentation. ...
Senior DevOps Engineer (LOCAL CANDIDATES ONLY)
The DevOps Engineer must have a solid understanding of data center deployments, and some background in deploying and engineering applications on Kubernetes. Our Fortune 500 Media Client is seeking a Senior DevOps Engineer for a long term contract opportunity. The Senior DevOps Engineer will help aut...