Job description
HireArt is helping an on-demand, autonomous ride-hailing company hire an experienced Databricks Administrator to manage and maintain company data stack tools.
We are looking for a Databricks Administrator who will be responsible for administering and maintaining different workspaces on Databricks running on AWS.
Responsibilities :
- Run Databricks at a workspace and account level.
- Set up and advise on architecture and scaling for the Databricks environment, including administering, configuring and installing libraries.
- Collaborate with data scientists, analysts, and other stakeholders to understand and deliver data solutions.
- Troubleshoot end user and platform-level issues.
- Document and maintain Databricks best practices and standards.
- Manage / monitor the following : Tenants, including workspace creation, user management, cloud resources, and account usage.
Cluster and jobs, policies, templates, and pools configuration options.Auto-scaling to ensure resources are allocated efficiently.
Workspace users and groups, including single sign-on, provisioning, and access control to workspace storage accounts across a large user base.
Requirements
- 5+ years of experience working as Databricks administrator / architect
- Strong fluency with Python or Java
- Advanced understanding of SQL to extract data from the databases
- Must have hands-on experience with the following : Serving as the Databricks account owner, including security and privacy setup, marketplace plugins and integration with other toolsUnity Catalog migration, workspaces and audit logsAmazon Web Services (AWS) accounts and high-level usage monitoringHadoop and EMR administration
Preferred Qualifications :
- Experience optimizing usage for performance, including monitoring cluster health checks and cost
- Experience with Looker / LookML
Benefits :
- Pre-tax commuter benefits
- Employer (HireArt) Subsidized healthcare benefits
- Flexible Spending Account for healthcare-related costs
- HireArt covers all costs for short and long term disability and life insurance
- 401k package
Commitment : This is a full-time, 6-month, ongoing contract position staffed via HireArt. This role is hybrid requiring at least 3 days onsite.
It will be available to candidates who are local to the Foster City, CA area.
HireArt values diversity and is an Equal Opportunity Employer. We are interested in every qualified candidate who is eligible to work in the United States.
Unfortunately, we are not able to sponsor visas or employ corp-to-corp.Company description