Search jobs > San Francisco, CA > Data engineer

Data Engineer

Databricks
San Francisco, CA, United States
$106.6K-$188.6K a year
Full-time

GAQ223R68

Location : San Francisco, CA or Mountain View, CA

At Databricks Information Technology, we are a product led organization transforming the way data is sourced, designed and used to help us scale seamlessly in face of incredible growth.

You will influence decision-making for business teams through data, analytics, and business intelligence. You will guide the business in identifying data needs and delivering mechanisms for acquiring and reporting such information and addressing the actual needs.

You will gather and maintain best practices that can be adopted across the business. You will be considered the go-to expert for the business for data analysis, reporting, data warehousing, and business intelligence.

You will also be responsible for the daily operations inclusive of troubleshooting and job monitoring. You will be a part of the growing IT Data team reporting to the Sr.

Director, Data Analytics & Integration.

The impact you will have :

Design / Strategy : You will design and support the business's database and table schemas for new and existing data sources for the data warehouse.

Creates and supports the ETL in order to facilitate the accommodation of data into the warehouse. In this capacity, the Data Engineer designs and develops systems for the maintenance of the business's data warehouse, ETL processes, and business intelligence.

Collaboration : You will be collaborative - working closely with analysts, data scientists, and other data consumers within the business in an attempt to gather and deliver high quality data for business-cases.

The Data Engineer also works closely with other disciplines / departments and teams across the business in coming up with simple, functional, and elegant solutions that balance data needs across the business

Analytics : You will play an analytical role in quickly and thoroughly analyzing business requirements and subsequently translating the emanating results into good technical data designs.

In this capacity, the Data Engineer establishes the documentation of the data solutions, develops, and maintains technical specification documentation for all reports and processes.

What we look for :

  • 2+ years of related experience with a Bachelor's or Master's degree in Computer Science, Statistics, Information Systems or another quantitative field.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Knowledge of data modeling and design of schemas for read and write performance.
  • Advanced working knowledge and experience working with relational databases, query authoring as well as working familiarity with a variety of databases.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Knowledge of message queuing, stream processing, API based extraction and highly scalable 'big data' data stores.
  • Experience supporting and working with cross-functional teams
  • Experience with Python and SQL
  • Experience with building data pipelines from business applications like Salesforce, Marketo, NetSuite, Workday etc.
  • Knowledge of Databricks Platform
  • Knowledge of AI / ML / Data Science
  • Knowledge of BI Tools like Tableau, Looker etc

Benefits

  • Comprehensive health coverage including medical, dental, and vision
  • 401(k) Plan
  • Equity awards
  • Flexible time off
  • Paid parental leave
  • Family Planning
  • Gym reimbursement
  • Annual personal development fund
  • Employee Assistance Program (EAP)
  • Mental wellness resources

Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents base salary range for non-commissionable roles or on-target earnings for commissionable roles.

Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location.

Based on the factors above, Databricks utilizes the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above.

For more information regarding which range your location is in visit our page here.

Zone 1 Pay Range

$106,600-$188,600 USD

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide - including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI.

Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.

To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards.

Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.

S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

27 days ago
Related jobs
Promoted
UC San Diego
Oakland, California

Under general supervision, participate with project scientists and engineers in the preparation, maintenance, testing, debugging and deployment of scientific datasets, visualizations and other data products in support of physical oceanographic research. Computer Science, Data Science, Ocean Engineer...

Promoted
Acceler8 Talent
San Francisco, California

Relevant Keywords: Large Language Models, Machine Learning, Python, Deep Learning, Software Development, Kubernetes, Scalable Systems, AI, Data Quality, Data Acquisition, Web Crawling, Data Parsing, Data Ingestion, Large-scale Data Management, Spark, DataFlow. About the Role, MTS, Back End Data Engi...

Promoted
Capital One
San Francisco, California

New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Data Engineer San Francisco, California (Hybrid On-Site): $213,400 - $243,500 for Lead Data Engineer. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you...

Promoted
Eos
San Francisco, California

As a Senior Data Engineer, you will lead data engineering initiatives and build end-to-end scalable, stable, and secure analytical solutions. You are passionate about working with huge datasets and have experience with the organization and curation of data for analytics. You are experienced in build...

Promoted
Saxon Global
San Francisco, California

Collaborate with engineers, business managers, and data scientists from different business areas globally to understand complex data needs and provide key data insights in meaningful ways. Solve challenging data integration problems for complicated and diverse data sets, utilizing and coding optimal...

Altos Labs
San Francisco, California

The Altos Labs Scientific Computing & Data group consists of software, data, and machine learning engineers implementing scalable data engineering solutions enabling Altos Labs' scientific mission. We are currently hiring a Senior Staff Data Engineer (curation) to lead the data curation and operatio...

Spyglass Partners, LLC
San Francisco, California

Experience with Databricks or other unified data platform is a plus!. Deep understanding of SQL and NoSQL databases and tuning. Experience with Spark, Hadoop, Flink, or other Apache data tools is a plus!. ...

Go Car Insurance
San Francisco, California

It is built from real-time events happening globally, historical structured data, and even some things that require creativity to get into usable form (tway IDs?) To us, data eng is about infrastructure, and infrastructure is about reliability. A lot of this role is gathering data, but most importan...

BDO
San Francisco, California

Net, C#, Qlik, Power BI, Machine Learning, Azure Data Factory, RedShift, UiPath, Cloud, RPA, AWS, Redshift, Kinesis, QuickSight, SageMaker, S3, Databricks, AWS Lake Formation, Snowflake, Python, Qlik, Athena, Data Pipeline, Glue, Star Schema, Data Modeling, SQL, SSIS, SSAS, SSRS, PySpark, Microsoft ...

BHO Tech
San Francisco, California

Work closely with our engineers, data scientists and analysts to optimize our data pipelines and establish best practices for table schemas, data models and data storage. Be one of the founding members of our data team and develop our next gen data platform. Help us build a robust and scaleable foun...