Search jobs > San Francisco, CA > Engineer big data
Team Introduction
You could be just the right applicant for this job Read all associated information and make sure to apply.
The Data Platform team works on building data infrastructures and data products to support business engineering teams.
As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world.
You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.
Responsibilities - What You'll Do
- Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, multi-dimensional analysis)
- Design and implement reliable, scalable, robust and extensible big data systems that support core products and business
- Establish solid design and best engineering practice for engineers as well as non-technical people.
Requirements
- BS / MS from a quantitative field of study (CS, STEM, etc)
- Experience in API, backend, and data services development
- Experience in Big Data stack (Hadoop, M / R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink, etc.)
- Experience with ETL (Extraction, Transformation & Loading) or ELT, and architecting data systems
- Ability to ship code in Java, Python and SQL
- Solid communication and collaboration skills
J-18808-Ljbffr
Backend Software Development Engineer - Senior/Lead/Principal
Note: By applying to the Software Backend Development posting, recruiters and hiring managers across the organization hiring Software Engineers will review your resume. The software engineer role at Salesforce encompasses architecture, design, implementation, and testing to ensure we build products ...
Senior Software Engineer, Client Experience
As a Senior Software Engineer on the Client Experience team, you play a pivotal role in advancing our mission to deliver unparalleled mental health care accessible to all. Annual $500 professional development stipend to support your professional development. Joining forces with a dynamic team of ski...
Senior Software Engineer, PC Engineer
Senior Software Engineer, PC Engineer. We are seeking an experienced Software Engineer to join the team to develop, maintain, and improve the frameworks powering a rich set of user experiences on desktop platforms. Represent the team in technical forums, present designs, and share experiences with o...
Senior Software Engineer, iOS Tooling
Bonus: Generalist engineer experience (including but not limited to: building web services, working with various data stores, and iOS application feature development). Lyft’s Mobile Infrastructure teams are responsible for creating and maintaining the foundational systems that all Lyft mobile engine...
Software Engineer, Backend (Mid, Senior, Staff)
As a Backend Software Engineer on the Product Engineering team at Harvey, you will own and lead engineering projects across our various product lines. BS/MS) of backend-focused software engineering experience on product-centric teams. Harvey uses algorithms with reasoning-adept LLMs that have been c...
Senior Software Engineer, Frontend (Enterprise Products)
Our Senior Software Engineers lead and mentor engineers, delivering high-value products for our customers and infrastructure that enables our business to scale. As a Senior Software Engineer, you’ll be responsible for setting technical direction to enable our product and infrastructure to scale with...
Senior Software Engineer
Software Engineer role centers around envisioning superior technical solutions to our customers’ payment needs, leading its implementation and continuously ensuring reliable service to our customers. Finix is looking for a team member to join our engineering team who brings exceptional technical acu...
Senior Software Engineer - DevOps, Engineering Productivity
Senior Software Engineer - DevOps, Engineering Productivity. As a Senior DevOps Engineer on the Engineering Productivity Pod, you will play a crucial role in enhancing the productivity of our engineering team. Ideal candidates are proactive, experienced problem-solvers with strong development skills...
Senior Software Engineer - Cloud Data Platform
Prior experience of building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive. Excellent software development skills in Java. Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques. Design cloud-native data platform and analytics SaaS service...
Senior Big Data Engineer
Data platform development, data engineering, software development, or data science. Data platform development, data engineering, software development, or data science. In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-...