Search jobs > San Francisco, CA > Engineer big data

Senior Software Development Engineer - Big Data

CV Library
San Francisco, California, US
Full-time

Team Introduction

You could be just the right applicant for this job Read all associated information and make sure to apply.

The Data Platform team works on building data infrastructures and data products to support business engineering teams.

As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world.

You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.

Responsibilities - What You'll Do

  • Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, multi-dimensional analysis)
  • Design and implement reliable, scalable, robust and extensible big data systems that support core products and business
  • Establish solid design and best engineering practice for engineers as well as non-technical people.

Requirements

  • BS / MS from a quantitative field of study (CS, STEM, etc)
  • Experience in API, backend, and data services development
  • Experience in Big Data stack (Hadoop, M / R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink, etc.)
  • Experience with ETL (Extraction, Transformation & Loading) or ELT, and architecting data systems
  • Ability to ship code in Java, Python and SQL
  • Solid communication and collaboration skills

J-18808-Ljbffr

1 day ago
Related jobs
Promoted
Salesforce
San Francisco, California

Note: By applying to the Software Backend Development posting, recruiters and hiring managers across the organization hiring Software Engineers will review your resume. The software engineer role at Salesforce encompasses architecture, design, implementation, and testing to ensure we build products ...

Promoted
Two Chairs
San Francisco, California

As a Senior Software Engineer on the Client Experience team, you play a pivotal role in advancing our mission to deliver unparalleled mental health care accessible to all. Annual $500 professional development stipend to support your professional development. Joining forces with a dynamic team of ski...

Promoted
Tbwa Chiat/Day Inc
San Mateo, California

Senior Software Engineer, PC Engineer. We are seeking an experienced Software Engineer to join the team to develop, maintain, and improve the frameworks powering a rich set of user experiences on desktop platforms. Represent the team in technical forums, present designs, and share experiences with o...

Promoted
Lyft
San Francisco, California

Bonus: Generalist engineer experience (including but not limited to: building web services, working with various data stores, and iOS application feature development). Lyft’s Mobile Infrastructure teams are responsible for creating and maintaining the foundational systems that all Lyft mobile engine...

Promoted
harvey.ai
San Francisco, California

As a Backend Software Engineer on the Product Engineering team at Harvey, you will own and lead engineering projects across our various product lines. BS/MS) of backend-focused software engineering experience on product-centric teams. Harvey uses algorithms with reasoning-adept LLMs that have been c...

Promoted
Vanta
San Francisco, California

Our Senior Software Engineers lead and mentor engineers, delivering high-value products for our customers and infrastructure that enables our business to scale. As a Senior Software Engineer, you’ll be responsible for setting technical direction to enable our product and infrastructure to scale with...

Promoted
SENIOR SPIRIT OF ROSELLE PARK
San Francisco, California

Software Engineer role centers around envisioning superior technical solutions to our customers’ payment needs, leading its implementation and continuously ensuring reliable service to our customers. Finix is looking for a team member to join our engineering team who brings exceptional technical acu...

Promoted
Baton
San Francisco, California

Senior Software Engineer - DevOps, Engineering Productivity. As a Senior DevOps Engineer on the Engineering Productivity Pod, you will play a crucial role in enhancing the productivity of our engineering team. Ideal candidates are proactive, experienced problem-solvers with strong development skills...

Guidewire
San Mateo, California

Prior experience of building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive. Excellent software development skills in Java. Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques. Design cloud-native data platform and analytics SaaS service...

Highmark Health
CA, Working at Home, California

Data platform development, data engineering, software development, or data science. Data platform development, data engineering, software development, or data science. In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-...