P-955
Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML / AI with a unified platform.
To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pattern, Lakehouse (), open platforms that unify data warehousing and advanced analytics.
The new architecture will help address several major challenges, including data staleness, reliability, total cost of ownership, data lock-in, and limited use-case support.
A critical part of realizing this vision is the next generation (decoupled) query engine and structured storage system that can outperform specialized data warehouses in relational query performance, yet retain the expressiveness and of general purpose systems such as Apcahe Spark™
to support diverse workloads ranging from ETL to data science.
As part of this team, you will be working in one or more of the following areas to design and implement these next gen systems that leapfrog state-of-the-art :
- Query compilation and optimization
- Distributed query execution and scheduling
- Vectorized execution engine
- Data security
- Resource management
- Transaction coordination
- Efficient storage structures (encodings, indexes)
- Automatic physical data optimization
What we look for :
- A passion for database systems, storage systems, distributed systems, language design, or performance optimization
- Experience working towards a multi-year vision with incremental deliverables
- Motivated by delivering customer value and impact
- 10+ years of experience working in a related system (preferred)
- Optional : PhD in databases or distributed systems
Software Engineer - Creation Engine
Under the hood, Figma shares a lot of similarities to a game engine. We develop this C++/WebAssembly engine to ensure internal and external developers can rapidly build new products and features that are fast and reliable by default. Regularly collaborate with designers, PMs, and other engineers bey...
Senior Software Engineer - Database Security
Experience with database systems and database internals, such as query engines and optimizers are a big plus. AS A SOFTWARE ENGINEER - DATABASE SECURITY AT SNOWFLAKE YOU WILL:. OUR IDEAL SOFTWARE ENGINEER - DATABASE SECURITY WILL HAVE:. Design and develop mechanisms to provide safety and security fo...
Senior Software Engineer - Database Engine Internals
A critical part of realizing this vision is the next generation (decoupled) query engine and structured storage system that can outperform specialized data warehouses in relational query performance, yet retain the expressiveness and of general purpose systems such as Spark™ to support diverse workl...
Staff Software Engineer, AR Platform
Niantic’s AR Engineering team seeks a Staff Engineer to build our native SDK for app developers on phones and headsets. Niantic Engineering leads the advancement of AR and other immersive technologies while creating engaging apps for a user base in the billions. The ideal candidate has strong techni...
Senior Staff Software Engineer - Cryptography
Our engineering teams build highly technical products that fulfill real, important needs in the world. Security Engineering is an integral part of Trust & Safety and has a critical role to play in keeping customer data from bad actors. Represent the security engineering discipline throughout the...
Staff Software Engineer, AI/ML Infrastructure, Google Cloud
Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch team...
Senior/ Staff - Full Stack Software Engineer - Seattle
Education: Bachelor’s Degree in Computer Science, Software Engineering, Mathematics, Computer Software, Computer Systems or Networks Engineering, Engineering, or a related technical field. As a Software Engineer at CSS, you'll be an integral part of our data-driven development team, contributing to ...
Staff Software Engineer, Lyft Media
As a software engineer at Lyft, you'll collaborate with other software engineers and cross functions like product, data science and analytics to lead and execute large projects from idea to efficient execution. We're looking for a motivated Software Engineer who is passionate about solving challengi...
Senior/Staff Software Engineer - 3D World Generation Pipelines
The Zoox simulation team is looking for experienced software engineers to take our 3D world-generation technology to the next level. You will work closely with technical artists to improve our procedural content pipeline and with simulation and ML engineers to deploy new methods to improve the fidel...
(USA) Staff, Software Engineer
Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years’ experience in software engineering or related area. Master’s degree in Computer Science, Computer Engineering, Computer Information Systems, Softwar...