Sr Staff Software Engineer Batch Stream Processing

VirtualVocations
Brooklyn, New York, United States
Full-time

A company is looking for a Sr. Staff Software Engineer, Batch & Stream ProcessingKey Responsibilities : Lead the strategy and technical direction of the Spark platformBuild and scale batch processing frameworks and infrastructure for petabytes-scale datasetsProvide thought leadership on data processing and storage at scaleRequired Qualifications : 8+ years of industry experience with technical excellence5+ years of experience building large scalable big data infrastructure / platform2+ years of contributing to open-source SparkDeep knowledge of big data technologies (e.

g. Spark, Hadoop, Parquet / ORC, Flink)Proficiency in programming languages like Java, Scala, Python

14 days ago
Related jobs
Promoted
VirtualVocations
Brooklyn, New York

Staff Software Engineer, Batch & Stream ProcessingKey Responsibilities:Lead the strategy and technical direction of the Spark platformBuild and scale batch processing frameworks and infrastructure for petabytes-scale datasetsProvide thought leadership on data processing and storage at scaleRequired ...

Promoted
Experian
New York, New York

The Staff Software Engineer will play a key role in the design and development of key initiatives within the Insurance domain in Experian Consumer Services. Insurance is one of the fastest growing areas within Experian and we are looking for a strong Software Engineer who thrives in a fast-moving en...

Vimeo
New York, US

Vimeos Payments team is looking for a hard-working & passionate Senior Software Engineer to help us build & scale our Payments Platform. Collaborate closely with our Product & Engineering teams to move key projects from conception to launch. Develop, test, deploy, & monitor software on our Payments ...

Fountain
New York, New York
Remote

Experience with tools, practices, and programming patterns for ensuring software correctness. BS or MS in computer science, engineering, or other technical degrees. ...

Crunchbase
New York, New York

We are hiring a hands-on Staff Machine Learning Engineer. At Crunchbase, we have Machine Learning Engineers in different teams including the Personalization team and the Graph team. Machine Learning engineers work on an array of challenges from creating features with personalized relevant informatio...

Reddit
New York, US

Reddit is a community of communities.Its built on shared interests, passion, & trust & is home to the most open & authentic conversations on the internet.Every day, Reddit users submit, vote, & comment on the topics they care most about.With 100,000+ active communities & approximately 73+ million da...

Intuit
New York, New York

Provide technical leadership and be a role model/coach to software engineers pursuing technical career path in engineering. Drive design and implementation of durable and software solutions that will solve critical customer problems, are scalable, secure, easy to maintain, and interact with numerous...

MongoDB
New York, New York

Our team plays a crucial role in the experience and performance of data processing. Degree in Computer Science or similar field, or equivalent practical experience, with strong competencies in data structures, algorithms, and software design/architecture. Work with other engineers to coordinate seam...

reddit
New York, New York

The Observability (OBS) team is looking to hire a Staff Software Engineer that thrives at the intersection of infrastructure and software development. As a member of the Observability team, your work will span these domains, which are rich with challenging infrastructure and software engineering pro...

Disney Entertainment & ESPN Technology
New York, New York

The Media Processing & Distribution group is hiring a talented Senior Software Engineer to support the growing Content Distribution & Origin (CDO) Engineering team. This work requires streamlining and repurposing technology across different business and distribution channels – including streaming, l...