Search jobs > San Francisco, CA > Senior data engineer

Senior Data Engineer

WestEd
San Francisco, California, US
$102.3K-$127.9K a year
Full-time

About WestEd

All potential applicants are encouraged to scroll through and read the complete job description before applying.

As a community of over 1000 researchers, practitioners, consultants, and administrative professionals from all backgrounds and life experiences, we are committed to making a qualitative difference in the lives of youth, children, and adults.

We conduct and apply research, develop evidence-based solutions, and provide consulting services across the country in both rural and urban communities to improve equitable outcomes for individuals from infancy through adulthood.

Serving as trusted partners in the areas of education, health, and justice, our teams enhance capacity within communities and school districts to prioritize impact asking the right questions, customizing methodologies, developing relevant tools, and implementing best practices specific to a diverse range of stakeholder needs.

Furthering diversity, equity, and inclusion is core to who we are and how we work. We are committed to working with our clients to illuminate and address disparities, value and elevate diverse voices, and ensure equitable access to our resources and services.

Department Brief Description :

WestEd’s Information Technology Department is seeking a mission-driven Senior Data Engineer. Our team provides technology solutions to serve our clients and internal staff.

Our culture values communication, collaboration, accountability, and strong customer service skills. WestEd’s IT Department supports and deploys hardware, software, SaaS solutions, custom applications, data management, and network infrastructure for the agency.

The successful candidate will be a critical member of our new Data Operations team.

The Opportunity :

The Senior Data Engineer leads the implementation of complex cloud-based data platforms, databases, and data warehouses. Engineering efforts span both client-facing solutions and internal business systems.

This position requires a strong background in data engineering, data pipeline management, database administration, and data warehousing;

with previous experience implementing solutions using Microsoft Azure, Amazon Web Services, and / or Snowflake.

Responsibilities :

  • Design, develop, and maintain new data capabilities and infrastructure to enhance WestEd's data products and solutions.
  • Create new data pipelines, data integrations, and infrastructure to facilitate seamless data access within cloud environments.
  • Collaborate with technical teams and business stakeholders to understand data requirements and translate them into technical solutions.
  • Work with large datasets - ensuring data quality, accuracy, and performance.
  • Implement data transformation, integration, and validation processes to support analytical and reporting needs.
  • Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency.
  • Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security.
  • Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes.
  • Document data processes, data lineage, and technical specifications.
  • Participate in code reviews, ensuring adherence to coding standards and best practices.
  • Adhere to Agency Information Technology policies, including security, disaster recovery, backup, and escalation.
  • Travel Required : Less than 5% to WestEd headquarters or satellite offices.

What We’re Looking For :

  • Located in the United States with availability to work 8 hours per day every weekday. Work schedule can be flexible but must include the Department’s core hours of Monday - Friday 9am - 2pm PT regardless of time zone.
  • At least five (5+) years of database development, administration, and / or data architecture experience using SQL or MySQL.
  • Demonstrated expert-level coding skills with SQL and its advanced features.
  • At least three (3+) years of experience administering cloud-based data infrastructure using Microsoft Azure, Amazon Web Services, and / or Snowflake.
  • Recent experience with Fivetran, TeamDynamix iPaaS, Integrify, or other low-code data integration tools.
  • Recent experience with data transformation tools, preferably including dbt.
  • Bachelor’s degree in Information Technology, Computer Science, Engineering, or a related technical field. Equivalent additional experience in database administration or data architecture may substitute for this education requirement.
  • Willingness to participate in total time accounting, including recording and reporting of actual time spent across multiple concurrent projects in fifteen-minute increments.
  • Recent experience analyzing and implementing complex regulatory, security, privacy, policy, or contractual requirements.
  • Demonstrated professional maturity and politically adroit; combined with tact, diplomacy, common sense, sound judgment, and discretion.
  • Excellent organizational skills and the ability to handle changing priorities and multiple tasks simultaneously.
  • Strong written and verbal communication skills in the English language. Ability to communicate effectively with clients and develop a clear understanding of their business needs.
  • Reliability, a professional attitude, and a willingness to do what is required in a cooperative work setting. Must be a self-starter, independent thinker, action-oriented, and self-motivated.

Preference :

  • Equity centered with the core belief that honoring diversity and leveraging multiple perspectives makes us stronger.
  • Holds a United States government security clearance at the Tier 2 (5C) Moderate level or higher.
  • Holds an active Snowflake SnowPro Core or Advanced certification credential.
  • Holds an active Microsoft Azure Administrator, Database Administrator, Data Engineer, or similar certification credential.
  • Recent experience administering and / or developing data products using Snowflake.
  • Recent experience managing integrations with cloud-based commercial products.
  • Recent experience with statistical or business intelligence tools.
  • Recent experience working in a governmental, non-profit, or education agency.
  • Recent experience operating within an Agile Scrum, Lean Kanban, and / or Scaled Agile Framework (SAFe) systems development life cycle.
  • Recent experience with Google G-Suite, Microsoft Office 365, GitHub, and other collaborative tools.
  • Familiarity with education data standards and privacy / reporting laws.
  • Desire to learn new technologies and keep current with technological trends.

SALARY AND BENEFITS :

The full salary range for this position, WestEd level H, is $102,320 to $153,500 but WestEd does not typically hire at or near the top of the salary range.

The typical hiring range for this role is $102,320 to $127,900 and the actual offer takes into account multiple factors including but not limited to education;

experience; internal equity, and other organizational needs.

In addition to the base salary, benefits include :

  • 15% contribution toward retirement effective day 1 of employment.
  • Pre-tax Flexible Spending Accounts.
  • All health / welfare benefits are effective first of the month following hire date.
  • PTO : 3 weeks vacation (increases to 4 weeks beginning the 4th year of employment), paid holidays, and 12 days paid sick leave per year.
  • Life Insurance : value of 3x gross salary.
  • Opportunities for annual merit-based performance increases + annual incentives.
  • Professional development opportunities & mentorship program.

For more detail about our benefits, go to : WestEd Benefits

Committed to the diversity of race, ethnicities, perspectives, and opportunities, WestEd offers a variety of social and professional learning communities.

We hope you’ll consider joining us to build better schools, communities, learning pathways, and more!

Equal Opportunity Employer / Protected Veterans / Individuals with Disabilities

J-18808-Ljbffr

11 days ago
Related jobs
Promoted
Snowflake
San Mateo, California

We are investing in initiatives across multiple areas that include real-time streaming ingestion, data replication across instances, distributed data processing, disaster recovery, data governance, and compliance. AS A SENIOR SOFTWARE ENGINEER - DATA INFRASTRUCTURE, YOU WILL:. OUR IDEAL SENIOR SOFTW...

Promoted
Jobs via eFinancialCareers
San Francisco, California

As a Senior Site Reliability Engineer at Circle, you will design, build, and maintain Circle's infrastructure estate to meet the growing worldwide customer base on public cloud providers across multiple regions. Senior Site Reliability Engineer (III). Senior Site Reliability Engineer. Circle is a fi...

Promoted
Rippling
San Francisco, California

Senior Staff Software Engineer - Data Infrastructure. We’re looking for a Senior Staff Engineer to lead a number of interesting & challenging projects inside our Infrastructure Organization (which is a part of the larger Platform Eng Org). Work cross-functionally with engineering leaders across ...

Promoted
Skydio
San Mateo, California

Senior Data Engineer, Analytics. Help democratize data by contributing to data dictionary and lineage initiatives. Develop data pipeline status reporting such as data anomaly detection, cluster health, error handling, and automated alerting. Demonstrable experience in developing, deploying, and main...

Promoted
The Hill Company
San Mateo, California

As a Senior Engineer on our Analytics team within our Growth Group, you will be a key participant in helping our Data Infra team shape the future of Roblox and bring our infrastructure on prem. Develop systems and tools to allow data processing both on cloud and in Roblox Data Centers. Be a part of ...

Promoted
PostHog
San Francisco, California

Full Time] Senior Data Engineer at PostHog (United States). Performing migrations on TBs of data (in someone else's datacenter) with zero downtime!. PostHog can be deployed to the cloud, or self-hosted on existing infrastructure, removing the need to send data externally. You'll be focused on the co...

WEX Inc
San Francisco, California
Remote

Implement solutions for data integration, data management, metadata management, data processing, data security, and data quality, including technical delivery review, resolution of design issues, and the migration of the existing on-premises applications to the data platform. Bachelor in Computer Sc...

DigitalOcean
San Francisco, California

Our Team: The person filling this position will report to the manager of the Fleet Optimization Engineering team, leading the Fleet Data mission. Three diverse engineers currently support the Fleet Data mission and they are located across the US and Canada. We are looking for a highly skilled and mo...

Unreal Gigs
San Francisco, California
Remote

As a Senior Data Warehouse Engineer, you'll play a critical role in designing, building, and maintaining our data warehousing solutions. You'll work on challenging projects, from data modeling and ETL processes to performance optimization and data governance, to support the needs of our data-driven ...

Snowflake
San Mateo, California

As a Senior Software Engineer on the Polaris and Data Lake Catalog team, you’ll play a key role in building and evolving our open and interoperable data lake ecosystem. We’re at the forefront of innovation, helping customers realize the full potential of their data with our data cloud. We are now go...