Search jobs > San Francisco, CA > Senior data engineer
Role : Senior Data Engineer
Location : Dallas, TX / San Francisco, CA / Seattle, WA
Type of hiring : FTE
Job Description :
- Atleast 4 years of experience in Information Technology
- Atleast 4 years of experience in modern data engineering / data warehousing / data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc.
Azure experience is preferred over other cloud platforms.
- Atleast 4 years of proven experience with SQL, schema design and dimensional data modelling
- Solid knowledge of data warehouse best practices, development standards and methodologies
- Experience with ETL / ELT tools like ADF, Informatica, Talend etc., and data warehousing technologies like Azure Synapse, Azure SQL, Amazon redshift, Snowflake, Google Big Query etc.
- Strong experience with big data tools (Databricks, Spark etc..) and programming skills in PySpark and Spark SQL.
Preferred Skills :
- Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Cosmo DB knowledge.
- SAP ECC / S / 4 and Hana knowledge.
- Intermediate knowledge on Power BI
- Azure DevOps and CI / CD deployments, Cloud migration methodologies and processes
Senior Software Engineer, Data Infrastructure
As a senior software engineer on the data infrastructure team, you'll be responsible for building out the infrastructure that underpins all of our systems. Your infrastructure will ingest data from first and third-party services, ensure that it's accurate and comprehensive, and make it available in ...
Senior Software Engineer, Data Infrastructure
Work on a tight-knit team of highly motivated and experienced data engineers and data infra engineers with frequent collaboration with data scientists, product managers and the rest of engineering. Experience building platform tooling to enable data self-service by engineers and data scientists. Sof...
Senior Frontend Engineer, Data Platform
We are continuing to grow rapidly and expanding our Engineering offices globally! We are looking for Frontend Engineers to build and maintain a large scale 24x7 global infrastructure system that powers DoorDash's 3-sided marketplace of Consumers, Merchants and Dashers. Frontend Engineers at DoorDash...
Senior Software Engineer - Data Capture Team
As a member of the Data Capture team you will establish the foundational set of core platform frameworks and pipelines which are a vital key to success – enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering, analytics...
Senior Staff Software Engineer, Data Platform
The Core Data part of this includes data ingestion (batch and real time), data compute & transformation, data storage (warehouse, data lake, OLAP etc. You will report into the Senior Director of Engineering, Data Platform as part of our Data organization in Engineering. You will use your skills ...
Senior Software Engineer II, ML Data Platform
As an engineer on this team, you will be responsible for building and supporting a petabyte-scale data platform in the cloud and providing powerful foundations for Cruise’s ML Data Platform tools, frameworks, and services. Responsibilities include ensuring scalable, transparent, and reliable data in...
Senior Staff Engineer – Finance Data - Remote
Advanced experience developing new and enhancing existing data processing (data ingestion, data transformation, data storage, data management, data quality) components. Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or Databricks. Senior Staff Engineer – Finan...
Data Quality Engineer, Senior
In this role you will be working with Data & Analytics, Data Engineering, Data Analysis, Application, and Business teams. The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within th...
Senior Software Engineer - Distributed Data Systems
As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support...
Senior Data Engineer
We are seeking a Senior Data Engineer with over 7 years of relevant experience to join our growing team. Work closely with our Head of Product to create and maintain complex ETL data pipelines using SQL and PySpark, while ensuring data quality. Demonstrated ability to work on the production of data ...