Be one of the founding members of our data team and develop our next gen data platform. Help us build scalable distributed systems like you’d construct additional pylons in your base.
You build those in your sleep, amirite?
What you'll be doing
- You’ll be one of the first members of our Data team. Build the vision and help define the architecture of our new Data platform.
- Help us build a robust and scaleable foundation for data, from logging to streaming pipelines, ETL & data consumers.
- Own and operate our entire data stack using modern technologies such as Apache Beam, Pub / Sub and Airflow.
- Work closely with our engineers, data scientists and analysts to optimize our data pipelines and establish best practices for table schemas, data models and data storage.
- Build efficient solutions on top of GCP and AWS using Python, Scala and Go.
What you should have
- Minimum of 4 years experience building scalable backend systems.
- Experience working on, and deploying, large scale systems in Python, Go, Scala / Java, or other similar languages.
- Experience working with and managing varied forms of distributed data systems such as Kafka, Storm or Spark.
- Love to work with high volume heterogeneous data and distributed systems.
- Self-motivation and the ability to take a high-level goal and deliver shippable code.
Bonus Points
- Proven track record of working with terabyte or petabyte-scale data infrastructure.
- Love to work with high volume heterogeneous data and distributed systems.
- Experience working with varied data applications and databases, such as Hadoop, Druid, Spark or Redshift.
- Expert knowledge of SQL, MapReduce and / or statistics scripting tools (i.e. R).
- BS / MS / PhD in Computer Science, Applied Mathematics or a related field.
- Godlike pylon construction skills.
Skills
Python, Java, Hadoop, SQL, Scalable Systems, Distributed Systems, Mapreduce, Scalability, Scala, Kafka, Amazon Redshift, Apache Spark, Druid, Apache Storm, Go
Compensation
$190K $250K and higher (DOE)
0.001% 0.2%
Visa Sponsorship
Available
Staff Software Engineer- Lead
Collaborate Cross-Functionally: Collaborate with data scientists, software engineers, and other cross-functional teams including our engineering team in India, facilitate data-driven decision making, and drive innovative solutions. As the Lead of a software engineering team, you will oversee the ful...
Software Engineer, Infrastructure
Are you passionate about enabling large-scale compute efforts and enhancing the software infrastructure to support seamless research experiences? As a Software Engineer, Infrastructure, you will play a critical role in scaling our systems and creating robust tools for our team. Your work will ensure...
Lead Java Software Engineer
Resource Innovations is seeking Lead Java Software Developer to join our growing Software as a Service (SaaS) team. As a hands-on technical lead at Resource Innovations, you will be instrumental in the design, development and deployment of innovative cloud-based enterprise software used by leading E...
Technology and Data - Software Engineer 4 - Contingent
Genesis10 is currently seeking a Software Engineer with our client in the financial industry located in San Francisco, CA. Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex multi-faceted, larger scale or longer-term Softwar...
Senior Software Engineer - Infrastructure and Tools
As a Senior Software Engineer on the Infrastructure teams, you will build scalable systems to power the Databricks platform, making it the de-facto platform for running Big Data and AI workloads. You will build and extend the Databricks infrastructure platform, which includes multi-cloud systems and...
Software Engineer II, Data Platform
About The Role:We are seeking a motivated software engineer to join our Data Infrastructure team. You have some experience or academic background in data infrastructure, data engineering, or machine learning. Our Team’s Impact:The data infrastructure team is responsible for the data platform that su...
Senior Software Engineer - Polaris & Data Lake Catalog
As a Senior Software Engineer on the Polaris and Data Lake Catalog team, you’ll play a key role in building and evolving our open and interoperable data lake ecosystem. We’re at the forefront of innovation, helping customers realize the full potential of their data with our data cloud. We are now go...
Staff Software Engineer, Frontend Infrastructure
We are looking for a Staff Software Engineer to take on a key technical leadership role for a team focused on Asana’s Frontend Infrastructure. Staff Software Engineer, Frontend Infrastructure. You’ll be a Tech Lead driving long term frontend infrastructure vision, strategy, and influence infra and p...
Senior Staff Software Engineer, Data
We provide real-time access to critical data from any ocean on earth, 24/7/365, and use proprietary software applications to transform that data into actionable insights and intelligence. Required Skills and Experience• 10+ years of relevant experience and demonstrated track record of tech leading l...
Software Engineer – Data Engineering and Machine Learning
Rhizome is seeking a Software Engineer who can scale our Data Engineering capacity and contribute to Machine Learning development at the enterprise scale. The ideal candidate will have deep expertise in working with GIS data, relational databases, CSVs, and Excel at the enterprise scale. Successful ...