Sr GCP Data Engineer

Position : Sr. GCP DataEngineer

Location : Remote

FTEsalary : $145K / Annum Tech M Standardbenefits

Weare seeking a highly skilled GCP Data Engineer to join our team.The ideal candidate will have extensive experience with GoogleCloud Platform (GCP) services particularly Dataflow BigQueryPub / Sub and related services.

Additionally the candidate should beproficient in provisioning infrastructure on GCP usingInfrastructure as Code (IaC) with Terraform.

This role will becritical in building and managing data pipelines ensuring dataquality and optimizing data storage and retrievalprocesses.

Responsibilities :

Design develop and maintain data pipelines using GCP services suchas Dataflow BigQuery andPub / Sub.

Implement and manage data warehouse solutions using BigQueryensuring data is stored securely andefficiently.

Use Pub / Sub for realtime data ingestion and streaminganalytics.

Provision and manage GCP infrastructure using Terraform ensuringbest practices in IaC arefollowed.

Optimize data storage and retrieval processes to enhanceperformance and reducecosts.

Monitor and troubleshoot data pipeline issues ensuring highavailability and reliability of dataservices.

Ensure data quality and integrity through robust testing andvalidationprocesses.

Stay updated with the latest GCP features and best practicesintegrating them into existingworkflows.

Document data workflows infrastructure setups and processes forfuture reference and knowledgesharing.

Requirements :

Proven experience as a Data Engineer with a focus on GCPservices.

Strong proficiency in GCP services such as Dataflow BigQuery andPub / Sub.

Handson experience with Terraform for provisioning and managing GCPinfrastructure.

Proficiency in SQL and Python for data manipulation andanalysis.

Solid understanding of data warehousing concepts and ETLprocesses.

Experience with realtime data processing and streaminganalytics.

Strong problemsolving skills and attention todetail.

Excellent communication and collaborationskills.

PreferredQualifications :

Google Cloud Professional Data Engineercertification.

Experience with other GCP services like Cloud Storage CloudFunctions and CloudComposer.

Familiarity with other IaC tools such as Ansible or CloudDeploymentManager.

Experience with containerization technologies like Docker andKubernetes.

Knowledge of data security and governancepractices.

particularlyDataflow,BigQuery,Pub / Sub,and related services.Additionally,ensuring data quality,develop,and maintain datapipelines using GCP services such as Dataflow,BigQuery,integratingthem into existing workflows.

Document dataworkflows,infrastructure setups,BigQuery,CloudFunctions