Search jobs > San Francisco, CA > Part-time > Cloud data engineer

Cloud Data Engineer: O&M and Technical Support

Federal Reserve Bank of San Francisco
San Francisco, California, US
$181.6K a year
Full-time
Part-time

Company

Federal Reserve Bank of San Francisco

Please make an application promptly if you are a good match for this role due to high levels of interest.

We are the Federal Reserve Bank of San Francisco public servants with a mission to advance the nation’s monetary, financial, and payment systems to build a stronger economy for all Americans.

We are a community-engaged bank, and are committed to understanding and serving the vibrant, expansive communities of the Twelfth District.

We respect people for what they do and for who they are. We build opportunities to learn and grow. We empower our people to balance their life and work responsibilities.

That’s why we offer a flexible hybrid work model that allows you to collaborate with office colleagues on some days, and work from home on others.

Job Summary

We are looking for a Cloud Data Engineer to join the Data and Analytics Service (DAS) Team. Our team delivers a centralized data and analytics platform that provides advanced data migration and analytics solutions for our customers for data storage, data processing, data integration, data lakes, data warehousing, and data analytics.

You will work cross-functionally with Data Architects, Product Owners, Design Engineers, Developers and Business Analysts in a rapidly evolving environment, identifying solutions, building, and implementing Infrastructure as Code using our CI / CD pipeline.

You will have an opportunity to showcase your critical thinking and technical skills across many disciplines. This role will be instrumental in shaping the development and support of our product roadmaps and will advance our cloud data analytics platforms.

Essential Responsibilities

  • Understand technology vision and strategic direction of business needs.
  • Develop integrated solution in alignment with design patterns, blueprints, guidelines, and standard methodologies for products including building integrations between cloud native and 3rd party vendor products.
  • Develop and deploy Infrastructure-as-Code solutions related to data platform scalability, isolation, latency, throughput, and efficiency.
  • Identify and respond effectively to service failures and incidents to preserve the service's conformance to its Service-Level Agreement and regularly update the runbook to reduce the time necessary to mitigate an incident.
  • Work with developers to establish Service-Level Objectives and key Service-Level Indicators.
  • Establish / follow postmortem procedures and lead postmortem exercises.
  • Conduct Production Readiness Reviews to ensure services meet accepted standards of operational readiness before going live.
  • Rehydrate infrastructure on schedule.
  • Perform incident response, on-call activities, standing up ad-hoc environments and manage system activities to an error budget.
  • Automate various workflows and pipelines on data and analytics platform to empower developers with self-service capability using Terraform, Python, and OS shell scripts.
  • Develop validation and certification process through automation tools.
  • Develop multi-layered build, installation, configuration, patching, regression testing, and rollback scripts in each environment.
  • Create scripts to compare different versions of the configuration settings.
  • Provide technical onboarding support for customers on the enterprise data and analytics platform in a timely manner and within SLAs.
  • Ensure queries, questions, impediments from customers related to technical onboarding are remediated within a reasonable time and all issues are resolved.
  • Help identify customer pain points and translate them into documentation like user guides, FAQs, how to do’s, runbooks etc.
  • Provide consulting and guidance on business solution development in the data and analytics space and cloud technologies.

Qualifications

Bachelor’s degree in computer science, Management Information Systems, Computer Engineering, or related field or equivalent work experience;

advance degree preferred.

  • Experience in designing and building large-scale data solutions in an enterprise setting in both On-Prem / AWS.
  • 5+ years of experience in implementing, managing, and scaling distributed systems in a public, private, or hybrid cloud environment.
  • 3+ years of experience with full stack development, including application, API, testing, and automation experience using at least one of the following languages (Terraform, JSON, Python).
  • 3+ years of experience designing, building, and supporting data analytics solutions hosted either on-prem or in the cloud, and experience with migrating data to the cloud.
  • Ability to generate Infrastructure-as-Code in an enterprise environment using a mature Continuous Integration / Continuous Delivery pipeline.
  • Hands-on experience in Terraform, Python, and OS shell scripts including automation tools.
  • Hands-on experience in one or more languages such as Java, JavaScript.
  • Experience with AWS data related services including various compute and storage offerings.
  • Hands-on experience in providing customer support and fulfilling customer service requests for onboarding on an enterprise data platform.
  • Must be a U.S Citizen or a Green Card holder with intent to become a U.S Citizen.
  • Demonstrates mutual respect, embraces diversity, and acts with authenticity.
  • Demonstrates analytical and problem-solving skills.
  • Experience with leveraging CI / CD pipelines and GitLab is a must.
  • Must be familiar with Agile methodologies and able to work in an Agile manner.

Desired Skills

  • Advanced proficiency in cloud specific solutions related to gateways, streaming services, or file and database migration services.
  • Experience in developing product roadmap in alignment with other data products and business roadmaps.
  • Experience with RDS, NOSQL Databases, RDBMS and in-memory databases.
  • Strong background in data structures, networking, performance, and scalability.
  • Microservices experience is strongly preferred.

Compensation and Benefits

Base Salary Range : Min : $113,600 - Mid : $147,600 - Max : $181,600 (Location : San Francisco)

Final salary and offer will be determined by the applicant’s background, experience, skills, internal equity, and alignment with market data.

We offer a wonderful benefits package including Medical, Dental, Vision, Pre-tax Flexible Spending Account, Backup Childcare Program, Pre-Tax Day Care Flexible Spending Account, Paid Family Care Leave, Vacation Days, Sick Days, Paid Holidays, Pet Insurance, Matching 401(k), and Retirement / Pension.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment.

The SF Fed is an Equal Opportunity Employer.

LI-Hybrid

Full Time / Part Time : Full time

Regular / Temporary : Regular

Job Exempt (Yes / No) : Yes

Job Category : Analytical

Work Shift : First (United States of America)

The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool.

The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.

Privacy Notice

J-18808-Ljbffr

10 days ago
Related jobs
Promoted
Harnham
CA, United States

Manage and optimize data warehouses and data lakes to ensure data is accessible and reliable. LEAD DATA ENGINEER, DATA AND SYSTEMS. Collaborate with Data Science and Analytics teams to support the development of ML models. I have partnered with an innovative healthcare start-up looking for a Lead Da...

Promoted
Growatt New Energy
CA, United States

Provide technical support to local and other states field technicians and customers - system queries, technical issues, and troubleshooting via Telephone and Email;. Field test and lab test of prototype retrofits and verification of the technical documentation to meet the field engineering needs;. I...

Promoted
CHAOS Industries
San Francisco, California

Build and maintain our data infrastructure, real-time data processing, data transportation, and networking. CHAOS is seeking a highly skilled and motivated Software Engineer to join our team supporting our product engineering. Support and collaborate with system, software, and hardware engineers. Da...

Promoted
Convectivecapital
San Francisco, California

The ideal candidate will have a strong background in data processing pipelines, DAGs, ETLs, feature extraction, and statistical analytics using Python and AWS cloud. Rhizome is seeking a Software Engineer who can scale our Data Engineering capacity and contribute to Machine Learning development at t...

Promoted
Sandvik Group
San Francisco, California

Pursue sales leads; visit existing and new customers who may be of strategic importance to the organization; assess customer requirements and suggest appropriate products and services; respond to more complex customer enquiries; negotiate prices and delivery times within limits of authority and conc...

Promoted
Amazon
San Francisco, California

Provide mentorship to other cloud engineers and help change development processes to increase developer productivity and project predictability. The team is looking for a Software Engineer to build key features and backend cloud services. Collaborate with peers across engineering, product, and desig...

Promoted
CHAOS Industries
San Francisco, California

Build and maintain our data infrastructure, real-time data processing, data transportation, and some of the backend services. CHAOS is seeking a highly skilled and motivated Software Engineer to join our team supporting our product engineering. As an early engineer on a growing team, define major pa...

Disney Entertainment & ESPN Technology
San Francisco, California

As a member of the Data Capture team you will establish the foundational set of core platform frameworks and pipelines which are a vital key to success – enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering, analytics...

Unreal Gigs
San Francisco, California
Remote

Develop and maintain data ingestion pipelines to collect data from various sources, including databases, APIs, files, and streaming sources, ensuring efficient and reliable data ingestion into cloud storage. Develop and maintain data processing pipelines using cloud-native data processing frameworks...

Disney Entertainment & ESPN Technology
San Francisco, California

The Data Reliability Engineering team for Disney’s Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment’s big data platform, which processes hundreds of terabytes of data and billions of events daily. Whether that’s evolving our strea...