Search jobs > Oakland, CA > Remote > Senior data engineer

Senior Data Engineer (Remote - US)

Energy Solutions
Oakland, CA, United States
$135K-$165K a year
Remote
Full-time

Interested in joining a growing company where you will work with talented colleagues, enhance a supportive and energetic culture, and be part of the climate solution?

At Energy Solutions, we focus on the big impacts. And we believe that market-based programs can be a powerful force to deliver large-scale energy, carbon, and water-use savings.

Since 1995, we've harnessed that power to offer proven, performance-based solutions for our utility, government, and institutional customers.

We are currently seeking a Senior Data Engineer to join our Information Systems team to design, develop, and maintain data platforms that support the data needs across Energy Solutions.

In this role, the ideal candidate is a passionate and highly skilled professional with expertise in analytics tools and cloud technologies like AWS, Azure or similar technologies.

They should be proficient in programming languages such as SQL, NoSQL, and Python, capable of processing large data sets to deliver high-quality, customer-facing data solutions and insights.

This unique position is perfect for individuals with technical prowess in data field that want to have an impact on energy efficiency markets and greenhouse gas reductions through our work for major North American utilities and other clients around the country.

Energy Solutions has a remote-friendly work environment for staff located throug hout the United States. We also have offices in Oakland and Orange, California as well as Portland, Boston, New York and Chicago for those that wish to work from one of our offices.

Responsibilities include but are not limited to :

  • Build, automate, and manage near-real-time scalable data ingestion pipelines for master data management, deep-learning, and predictive analytics.
  • Build and maintain cloud native big data environments on AWS, that are highly secure, scalable, flexible, and highly performant using appropriate SQL, NoSQL and NewSQL technologies.
  • Lead data governance and data profiling efforts to ensure data quality and proper metadata documentation for data lineage.
  • Provide technical input into build / buy / partner decisions for all components of the data infrastructure.
  • Partner closely with Data Scientists, BI developers, and Product Managers to design and implement data models, database schemas, data structures, and processing logic to support various data science, analytics, machine learning, and BI initiatives.
  • Design and develop ETL (extract-transform-load) processes to validate and transform data, calculate metrics, and model features, populate data models etc.

using Spark, Python, SQL, and other technologies in the AWS.

  • Lead data governance and data profiling efforts to ensure data quality and proper metadata documentation for data lineage.
  • Lead by example, demonstrating best practices for code development and optimization, unit testing, CI / CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response to ensure data availability, data quality, and usability.
  • Define SLAs for data availability and correctness. Automate data availability and quality monitoring and respond to alerts when data delivery SLAs are not being met.
  • Communicate progress across organizations and levels from individual contributor to executive. Identify and clarify the critical few issues that need action and drive appropriate decisions and actions.

Communicate results clearly.

Minimum Qualifications :

  • Education : A bachelor's degree in computer science or information technology plus 8 years minimum of relevant experience.
  • Programming Proficiency : High proficiency in programming languages commonly used in ETL development, such as PLSQL, SQL, Python.

Ability to write efficient SQL queries, SQL store procedures, develop scripts for data transformations, and utilize programming frameworks and libraries to create / enhance ETL mappings and workflows.

AWS Services : Expertise in utilizing AWS services, including but not limited to Amazon s3, glue, data catalog, Amazon redshift, redshift spectrum and Amazon Athena.

Ability to leverage these services to build scalable, reliable, and performant data pipelines and analytics solutions.

  • Proficiency in working with relational databases such as Postgres, Oracle, MySQL, or SQL Server. Knowledge of database design, optimization techniques, and advanced querying capabilities.
  • Experience in performance tuning and optimizing database operations.
  • Familiarity with data governance frameworks and data security best practices.
  • Passion for learning new technologies, staying up to date with industry trends, and exploring innovative approaches to ETL development.

Compensation to commensurate with experience with the pay band of $135,000 - $165,000 / Annually

Compensation is commensurate with experience and includes a generous retirement package. Energy Solutions provides an excellent benefits package including medical, dental and vision insurance, other pre-tax contribution plans and an Employee Stock Ownership Plan (ESOP).

Office Locations and a Remote Workforce

Energy Solutions is a predominantly remote workforce with offices in six different locations . At this time, we are not accepting applications from the following states (Alaska, Delaware, Kentucky, Mississippi, Montana, Nebraska, North Dakota, Wyoming).

Inclusion, Diversity, Equity, Accessibility

We live out our mission day in and day out by helping our clients and communities generate clean energy solutions the world needs.

Our success is dependent on developing a team of creative thinkers, innovators, and a workforce that reflects the diversity of our world.

To that end, we're committed to hiring, promoting, and retaining a diversity of talent, and infusing inclusion, diversity, equity, and accessibility (IDEA) throughout our business.

We encourage people from underrepresented backgrounds and all walks of life to apply. Come grow with us at Energy Solutions!

Background Check Information

Information will be requested to perform the compulsory background check. A drug screen and authorization to work in the U.

S. indefinitely are preconditions of employment. Energy Solutions is an equal opportunity employer.

Reasonable Accommodations

Energy Solutions is committed to providing access and reasonable accommodation for individuals with disabilities. If you require accommodations in completing this application, interviewing, and / or completing any pre-employment testing, or otherwise participating in the employee selection process, please email [email protected] .

Privacy Notice for Job Applicants

1 day ago
Related jobs
Promoted
Scale AI, Inc.
San Francisco, California

You will also implement Scale's data warehouse, data mart, and business intelligence reporting environments, and help users transition their workflows to these systems. As a Senior Data Engineer at Scale, you will spearhead building the company's analytical and business-intelligence infrastructure. ...

Promoted
Rigetti And Company Inc
Berkeley, California
Remote

We strive to create an inclusive work environment and will not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. This is a service used by internal researchers and public customers alike, for wh...

Promoted
Twilio
Oakland, California
Remote

At Twilio, we support diversity, equity & inclusion wherever we do business. The ideal candidate enjoys solving complex, high-stakes problems, is naturally curious and always looking for ways to standardize and simplify while being inclusive of cultural or international differences. Vision &...

Gridware
San Francisco, California

The Senior Data Engineer is responsible for designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems. This role involves handling large-scale sensor data, ensuring data integrity, and enabling seamless data flow for analysis and decision-maki...

Imbue
San Francisco, California
Remote

In this role, you will work on the most important part of Imbue's system: the software infrastructure for collecting, preprocessing, generating, analyzing, and distilling the wide variety of data sources that go into both their primary pretraining data corpus, as well as the datasets for all of the ...

Cisco Meraki
San Francisco, California
Remote

Meraki’s customer base has grown by a factor of 2-3 every year, serving more than 8 billion HTTP requests per day across ten data centers! Our customers depend on our products to run their critical infrastructure of network switches (now including Cisco Catalyst in addition to the Meraki switches), ...

BDO
San Francisco, California

Designs and implements best in class data ingestion strategies, data warehouse and data mart structures, semantic layers and models, visualizations, streaming processes, API integrations, and automation (RPA) solutions for end-to-end data analytics solutions on primarily, but not limited to, cloud a...

Plato Systems
San Francisco, California

We are seeking a Senior Data Engineer with over 7 years of relevant experience to join our growing team. The ideal candidate will have a deep understanding of the design, development, and maintenance of many ETL pipelines at the same time, will be confident working with time-series data, and will ha...

Inuson International Inc. (i3)
San Francisco, California
Remote

We’re looking for an incredible senior engineer to help us build the future of blockchain scalability. We’re building software that makes it easy for the most innovative blockchain applications to launch their own ultra-performant blockchains (rollups), enabling applications to own their ecosystem, ...

GEICO
San Francisco, California

Our Senior Staff Engineer is a key member of the engineering staff working across the organization to innovate and bring the best open-source data infrastructure and practices into Geico as we embark on a greenfield project to implement a core Data Lakehouse for all Geico’s core data use-cases acros...