Search jobs > San Francisco, CA > Software engineer data

Software Engineer – Data Engineering and Machine Learning

Rhizome Data
San Fransisco, California, United States
$130K-$170K a year
Full-time

Rhizome is seeking a Software Engineer who can scale our Data Engineering capacity and contribute to Machine Learning development at the enterprise scale.

The ideal candidate will have a strong background in data processing pipelines, DAGs, ETLs, feature extraction, and statistical analytics using Python and AWS cloud.

The ideal candidate will have deep expertise in working with GIS data, relational databases, CSVs, and Excel at the enterprise scale.

Successful candidates will also have practical experience building large scale ETL pipelines on AWS or GCP for data engineering, feature extraction, statistical analysis, and correlations.

About Rhizome

Rhizome is at the forefront of developing decision intelligence technology at the intersection of climate science and infrastructure systems.

Our team pursues this endeavor with the wisdom and steadiness of industry veterans, and the curiosity, grit, and energy of startup and technology enthusiasts.

Our climate resilience SaaS platform helps utilities, governments, and industries plan for greater resilience to climate change and extreme weather by applying AI to a vast amount of information that characterizes infrastructure assets and their vulnerability to extreme weather.

Focused on the $500B resilience investment gap in the grid today, our mandate is simple : Help electric utilities proactively adapt to climate change by integrating cutting-edge climate-asset intelligence into their existing planning workflows.

As the world experiences record-breaking climate-related impacts, especially related to grid failures, our platform identifies future extreme weather vulnerabilities on utility assets at high resolutions and empowers planners to optimize investment deployments that keep society safe during natural hazard events.

Roles and Responsibilities

  • Design, construct, and maintain data pipelines to combine large volumes of geospatial, climate + weather, and electric utility datasets.
  • Work with a cross-functional team to deliver data in support of analytic and ML pipelines.
  • Develop deep familiarity with electric utility datasets and take ownership of integration of new datasets into our existing environments.
  • Contribute to ML model development in the context of understanding future extreme weather impacts on the power grid.
  • Optimize storage and ETL pipelines.
  • Develop versioned, scalable, repeatable and reliable pipelines for utility data that is in GIS and Tabular format to Delta Lake format.
  • Scale & Automate data pipelines for statistical analysis for internal and external use-cases.
  • Standardize and scale multi-tenant data storage.
  • Exceptional ability to diagnose data issues and discrepancies.
  • Ability to modularize different stages of data ingestion and verification.
  • Ability to write algorithms for data sanity checks and classification of different data elements.
  • Ability to develop heuristics and suggestions for missing data items.
  • Ability to validate and test pipelines and write functional test to validate the pipelines.

Qualifications

  • Exceptional Python programming skills.
  • Exceptional programming skills with NumPy, SciPy, Xarrays.
  • Exceptional programming skills with frameworks like Dagster or Airflow or Prefect.
  • Exceptional programming skills with Databricks or Apache Spark or Amazon EMR or Cloudera.
  • Deep expertise in storage optimization and partitioning on RDS, Postgres, PostGIS, Delta Lake.
  • Hands on with GIS dataset and QGIS or ESRI.
  • Hands of Experience with multi-dimensional Climate or Weather data.
  • Familiarity or hands on experience with Secure Cloud Development.

We'll pay extra close attention if you have :

  • Exposure or experience with electric utility tech stacks (AMS, OMS, GIS, etc.).
  • Exposure to applied ML and Data Engineering in the context of electric utilities.

Culture and Core Values

At Rhizome, we lead with compassion and empathy, aiming to understand before we help. Our thesis as technologists is that, in order to fulfill our mission to protect society from the impacts of climate change through intentional, intelligent infrastructure planning, we need to embark on a journey of respectfully listening, learning, and then problem-solving.

This sentiment is represented through our core values :

Empathy : Understanding and relating to problems, customers, and each other, with humility.

Creativity : Exploring with curiosity and building with intention.

Aspiration : Striving for societal impact, personal fulfillment, and simply doing good work.

Tenacity : Pushing past barriers and the status quo with a sense of optimism and determination.

Service Excellence : Delivering high-quality outcomes for our customers, colleagues, and communities.

Compensation and Benefits

Rhizome offers salaries and an excellent package of benefits and stock options. Compensation is based on a variety of factors including experience, role, and location.

Salary Range : $130,000 - $170,000

Benefits : Unlimited time off, stock options, excellent health, dental, and vision, and 401k.

30+ days ago
Related jobs
Promoted
Plaid
San Francisco, California

As a software engineer on the payment risk team, you will work on tooling and infrastructure that facilitates the development of our machine learning based risk models, from data and feature pipelines to model evaluation framework. Develop tools and infrastructure for quick iteration on machine lear...

Promoted
Pinterest
San Francisco, California

The role has direct visibility across Pinterest Engineering and with Engineering and company leadership. Build develop and mature profiling and optimization capabilities at Pinterest, ensuring that Pinterest Infrastructure maximizes value and reduces inefficiencies and overhead. Collaborate across P...

Promoted
Skyrocket Ventures
CA, United States

Every day and week and month is slightly different, but it will generally be the traditional machine learning work flow of collecting data, processing it, pruning it, training models, then evaluating. Machine Learning Engineer - Mission Driven Health Startup. It has about 35 employees and 10 enginee...

Promoted
Square
San Francisco, California

Strengthen your knowledge by using and learning a diverse set of techniques spanning all aspects of machine learning, with the focus on conversational and generative AI, to solve important business and product problems. Drive end to end cross functional machine learning projects: you will build rela...

Promoted
Kilpatrick Townsend & Stockton LLP
San Francisco, California

Patent Engineering is suitable for individuals that enjoy learning about different inventions and who like to read and write. The successful candidate will be a recent graduate or scheduled to graduate in 2022 with a degree in Electrical Engineering, Computer Science, Computer Engineering, or Physic...

Promoted
Baton Trucking, Inc.
San Francisco, California

Prior to the September 2022 acquisition, Baton was a venture-backed start-up that operated a fleet of trucks and hung out at truck stops to truly understand the challenges at hand. As a Senior DevOps Engineer on the Engineering Productivity Pod, you will play a crucial role in enhancing the producti...

Promoted
Capital One
San Francisco, California

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing mach...

Promoted
Salesforce.com, Inc.
San Francisco, California

Work across the engineering organization to develop the knowledge and resolve complex technical issues and drive impactful innovation that improves application lifecycle, async handling, system availability, resiliency, and performance. Software Engineering, LMTS / Lead Software Engineer (multiple p...

Promoted
Lilt Inc.
San Francisco, California

As a Software Engineering Manager, you will identify, hire and build a world-class team of Software Engineers, Researchers, and Data Analysts to define, drive and execute on the creation of the next generation of Lilt’s data platform. Hire, develop, and lead a team of software engineers, researchers...

Dropbox
San Francisco, California
Remote

Experience with one or more of the following: natural language processing, deep learning, bayesian reasoning, recommender systems, learning to rank, speech processing, learning from semistructured data, graph learning, reinforcement or active learning, large language models, ML software systems, ret...