Search jobs > San Francisco, CA > Senior engineer data

Senior Software Engineer, Data Processing & Workflow Foundations

Reddit
San Francisco, CA
$190.8K-$267.1K a year
Full-time

Reddit is a community of communities. It's built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet.

Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 73+ million daily active unique visitors, Reddit is one of the internet's largest sources of information.

For more information, visit redditinc.com .

The Data Processing and Workflow Foundations (DPWF) team is looking to hire a Senior Software Engineer that thrives at the intersection of infrastructure and software development.

This team's challenges break into 2 domains, which we consider engineering kafka as a platform and promoting event driven architectures .

Engineering kafka as a platform : Higher-level orchestration of Kafka to support our multi-cloud, multi-region, deployments.

A subset of current focuses include :

  • Software automation that creates, manages, and destroys kafka clusters in our environments.
  • APIs and controllers that support operation of kafka clusters at scale atop kubernetes
  • Automation of replication and other cluster management concerns.

Promoting event driven architectures : Reddit is increasingly adopting geographically distributed, eventually consistent architectures.

As part of this shift, many systems are shifting to event driven architectures, and the DPWF team is working to make this adoption simpler and faster. Current projects are :

  • Reddit specific clients and templates with helper functions and features suited to our use of Kafka
  • Schema Registries and enforcement
  • Capacity management and ACLs through client enforced authentication
  • GitOps developer experience for Kafka interaction

As a member of the Data Processing and Workflow Foundations team, your work will span these 2 domains, which are rich with challenging infrastructure and software engineering problems.

Your work will directly impact hundreds of millions of users around the world. Join us and help build the future of Reddit!

In your day-to-day, you can expect to :

  • Work collaboratively with a team of software engineers to create and maintain the foundational platform for running Reddit's infrastructure.
  • Deliver software to improve the availability, scalability, latency, and efficiency of Kafka and other messaging components.
  • Contribute feedback to the technical and strategic direction of eventing at Reddit.
  • Automate critical aspects of the event driven development process
  • Share on-call responsibilities.

You have :

  • 4+ years of experience developing internet-scale software, preferably in the context of infrastructure.
  • Familiarity with asynchronous communication, bonus if familiar with Kafka specifically
  • Experience developing on top of Kubernetes or similar distributed systems.
  • Kubernetes controller or operator development experience is a huge plus.
  • Strong troubleshooting capabilities surrounding both systems and software.
  • Experience engineering large systems, tracking work, and being a self-starter on projects.
  • Excellent communication skills to collaborate with a service-oriented team and company.

Benefits :

  • Comprehensive Healthcare Benefits
  • 401k Matching
  • Workspace benefits for your home office
  • Personal & Professional development funds
  • Family Planning Support
  • Flexible Vacation (please use them!) & Reddit Global Wellness Days
  • 4+ months paid Parental Leave
  • Paid Volunteer time off

LI-remote, #LI-JS5

Pay Transparency :

This job posting may span more than one career level.

In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission.

Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave.

To learn more, please visit https : / / www.redditinc.com / careers / .

To provide greater transparency to candidates, we share base pay ranges for all US-based job postings regardless of state.

We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies.

Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses / credentials, and may vary from the amounts listed below.

The base pay range for this position is :

$190,800 - $267,100 USD

Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures.

If you need assistance or an accommodation due to a disability, please contact us at ApplicationAssistance redacted .

30+ days ago
Related jobs
Promoted
Bloomberg
San Francisco, California

The Portfolio Enterprise Data Lake (PEDL) team applies modern data science technology and approaches to improve client access to PORT's curated data sets and sophisticated financial models. We are building a modern data lake house with Apache Iceberg that integrates PORT's enterprise reporting workf...

Promoted
VirtualVocations
Oakland, California

Key Responsibilities:Support and improve existing tools for build, release, and engineering teamsDefine, build, and maintain tools to enhance scale and efficiency in product and release processesDrive and own improvements in product quality coverageRequired Qualifications:BS degree in Computer Scien...

Promoted
Cypress HCM
San Francisco, California

Senior Software Engineer, Full Stack,. Leadership and Collaboration: Strong communication skills and experience leading cross-organizational projects, working closely with design, product, data science, and engineering teams to achieve shared goals. Experimentation: Familiarity with growth engineeri...

Promoted
Fanatics, Inc.
San Mateo, California

The Data Platforms organization at Fanatics is at the heart of our company's data-driven decision making, building the foundational infrastructure that empowers our data engineers and ML engineers to unlock the power of data. Lead large initiatives within the Data Platforms organization, collaborati...

Promoted
Cash App
San Francisco, California

As an engineer on Support Product’s Agent Tooling team you will be part of our distributed cross-functional product development team of Server Engineers, Mobile Engineers, Designers, Machine Learning Engineers and Modellers to build best in class agent tools that make it easier for our agent to find...

Promoted
Gantri, Inc.
San Francisco, California

We view each engineer as a true product engineer with a high degree of ownership and autonomy. Gantri is looking for a passionate backend engineer to focus on building APIs that power our online marketplace, designer Create Hub and manufacturing operations dashboard. ...

Promoted
Karkidi
Berkeley, California

We build the core libraries, services, and tools that form the foundation of AI software development at Covariant and we are hiring senior engineers to help us achieve our vision. The AI Infrastructure team makes Covariant’s robot data accessible and easy to leverage to develop, debug, and deploy AI...

Promoted
DoorDash USA
San Francisco, California
Remote

DoorDash Labs is hiring a generalist software engineer for the autonomy remote assistance team. To accomplish that, you will work on user facing clients, networking, wireless communication, video streaming, backend microservices, data pipelines, dashboards, and integration with autonomous systems. W...

Promoted
Salesforce
San Francisco, California

The internal Production Operations Engineering (ProdOpsEng) team at Salesforce is seeking a talented and experienced software engineer to work on our internal, world-class collaboration and productivity toolset used by our internal management for managing headcount and resource allocation. As a soft...

Promoted
Zip
San Francisco, California

Evolve Zip’s data access layer for sharded and distributed databases, to support Zip’s global expansion. Experience: Over 5 years of software engineering experience, particularly in cloud infrastructure. Our co-founders started Zip (YC S2020) because they saw the challenges companies had using outda...