Search jobs > San Francisco, CA > Senior data engineer

Senior Data Engineer

Webologix Ltd/ INC
San Francisco, CA, United States
Full-time

Role : Senior Data Engineer

Location : Dallas, TX / San Francisco, CA / Seattle, WA

Type of hiring : FTE

Job Description :

  • Atleast 4 years of experience in Information Technology
  • Atleast 4 years of experience in modern data engineering / data warehousing / data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc.

Azure experience is preferred over other cloud platforms.

  • Atleast 4 years of proven experience with SQL, schema design and dimensional data modelling
  • Solid knowledge of data warehouse best practices, development standards and methodologies
  • Experience with ETL / ELT tools like ADF, Informatica, Talend etc., and data warehousing technologies like Azure Synapse, Azure SQL, Amazon redshift, Snowflake, Google Big Query etc.
  • Strong experience with big data tools (Databricks, Spark etc..) and programming skills in PySpark and Spark SQL.

Preferred Skills :

  • Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Cosmo DB knowledge.
  • SAP ECC / S / 4 and Hana knowledge.
  • Intermediate knowledge on Power BI
  • Azure DevOps and CI / CD deployments, Cloud migration methodologies and processes
  • 8 days ago
Related jobs
Promoted
Tempus Ex
San Francisco, California

As a senior software engineer on the data infrastructure team, you'll be responsible for building out the infrastructure that underpins all of our systems. Your infrastructure will ingest data from first and third-party services, ensure that it's accurate and comprehensive, and make it available in ...

Promoted
Patreon
San Francisco, California

Work on a tight-knit team of highly motivated and experienced data engineers and data infra engineers with frequent collaboration with data scientists, product managers and the rest of engineering. Experience building platform tooling to enable data self-service by engineers and data scientists. Sof...

Promoted
DoorDash USA
San Francisco, California

We are continuing to grow rapidly and expanding our Engineering offices globally! We are looking for Frontend Engineers to build and maintain a large scale 24x7 global infrastructure system that powers DoorDash's 3-sided marketplace of Consumers, Merchants and Dashers. Frontend Engineers at DoorDash...

Promoted
The Walt Disney Company
San Francisco, California

As a member of the Data Capture team you will establish the foundational set of core platform frameworks and pipelines which are a vital key to success – enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering, analytics...

Promoted
DoorDash USA
San Francisco, California

The Core Data part of this includes data ingestion (batch and real time), data compute & transformation, data storage (warehouse, data lake, OLAP etc. You will report into the Senior Director of Engineering, Data Platform as part of our Data organization in Engineering. You will use your skills ...

Promoted
Cruise
San Francisco, California

As an engineer on this team, you will be responsible for building and supporting a petabyte-scale data platform in the cloud and providing powerful foundations for Cruise’s ML Data Platform tools, frameworks, and services. Responsibilities include ensuring scalable, transparent, and reliable data in...

GEICO
Berkeley, California
Remote

Advanced experience developing new and enhancing existing data processing (data ingestion, data transformation, data storage, data management, data quality) components. Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or Databricks. Senior Staff Engineer – Finan...

Blue Shield of California
Oakland, California

In this role you will be working with Data & Analytics, Data Engineering, Data Analysis, Application, and Business teams. The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within th...

Databricks
San Francisco, California

As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support...

Plato Systems
San Francisco, California

We are seeking a Senior Data Engineer with over 7 years of relevant experience to join our growing team. Work closely with our Head of Product to create and maintain complex ETL data pipelines using SQL and PySpark, while ensuring data quality. Demonstrated ability to work on the production of data ...