Required Skills
- 3+ years' experience working in a similar Software Engineer role within a data platform / data engineering team
- Experience with Big Data and distributed systems.
- Experience with focus on working with Debezium for change data capture and real-time data streaming.
- Experience working with Kubernetes, AWS, Docker, and Terraform.
- Prior experience in building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on the public cloud.
- Excellent programming skills in Java.
- Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms).
- Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques.
- Eager to learn new things and passionate about technology!
What you would do
- Design, develop and run cloud native data platform and analytics SaaS services
- Design and build large scale real-time stream processing systems
- Develop and run micro-services and analytics SaaS solutions
- Perform test driven unit and end to end testing of any code you develop.
- Own Continuous Integration (CI) and Continuous Deployment (CD) for your services
- Own scalability, availability and data security for your services
- Own, troubleshoot & resolve code defects
- Mentor other developers in best practices
What you would need to succeed
- Extensive experience working on a public cloud-like AWS
- Prior experience and passion for building a large-scale multi-tenant cloud-native data platform
- Emphasize team wins over individual success
- Strong technical interpersonal skills
- Excellent software development skills in one or more of the following languages : Java / Scala
- Extensive experience with Big Data and distributed systems.
- Expertise in Spark or Flink, Kafka, and Hadoop ecosystem
- Ability to design large-scale distributed systems
- Have developed in more than one language and ready to pivot to any language / framework
- Understand microservices architecture patterns pattern like Service Discovery / API Gateway / Domain Driven Design etc
- Experience with containers technology
- Ability to work in an agile fast-paced environment
- BS or MS degree (Computer Science or Math)
Bonus
- AWS (EMR, S3, Glue, Kinesis)
- Debezium
- Experience in building SaaS / PaaS on AWS / GCP / Azure.
$110000 - $130000 a year
Senior Software Engineer, Cloud Platform
Active contributor to one or more PAAS platforms software such as, Snowflake, Databricks, Confluent, Google BigQuery, Spanner, Redshift, Aurora, Cosmos DB, Redis, MongoDB, ElasticCloud, CockroachDB, Yugabyte, Hashicorp, etc. Founded by the engineers behind Milvus, the world's most popular open-sourc...
Software Engineer - Cloud Infrastructure
As an Infrastructure Engineer, you will have the opportunity to help Notable continue to rapidly scale our platform and infrastructure. This exciting opportunity will be responsible for designing and implementing the core infrastructure underlying the entire Notable platform. You will have a huge in...
Staff Software Engineer, Data Lake Ingestion
This role is highly cross-functional, requiring you to collaborate closely with Data Science, Data Engineering, and Product teams to understand customer requirements, and with Data Platform and Storage teams to develop integrated solutions. As a Staff Software Engineer, you will lead the development...
Senior Software Engineer - UI - GTM Platform
The Harness Software Delivery Platform includes modules for CI, CD, Cloud Cost Management, Feature Flags, Service Reliability Management, Security Testing Orchestration, Chaos Engineering, Software Engineering Insights and continues to expand at an incredibly fast pace. We offer solutions for every ...
Software Engineer - Data Engineering and Machine Learning
Rhizome is seeking a Software Engineer who can scale our Data Engineering capacity and contribute to Machine Learning development at the enterprise scale. The ideal candidate will have a strong background in data processing pipelines, DAGs, ETLs, feature extraction, and statistical analytics using P...
Software Engineer, Cloud Infra
In this role, you will help lead the design and development of core cloud infrastructure platforms and systems, while supporting orchestration, data abstraction, data pipelines, identity & access management, and underlying infrastructure. Extensive experience in software development and a deep u...
Staff Software Engineer, Apps Platform
Collaborate with leadership and senior engineers to build and improve upon the technical roadmap for Discord’s Developer Platform. Work with the Apps team within Platform Ecosystem to build & maintain SDKs, APIs, UI/UX and other platform services. We're a multi-platform team, so it's important t...
Software Engineer II (Streaming, Roku/BrightScript Developer)
We’re seeking a Software Engineer II for the Roku Client Application Engineering Team, where you’ll be part of the team that builds our Direct-to-Consumer client apps, such as Disney+, Star+, ESPN and Hulu on Roku streaming devices and smart TVs. Collaborate closely with our client SDK engineering, ...
Senior Software Engineer - Portfolio Enterprise Data Lake
We are growing the PEDL platform to cover additional client use cases, support more programmatic access through REST APIs and integration with cloud providers like Snowflake, and supply data for new AI-based products - all while scaling up to host an ever-increasing amount of data. The Portfolio Ent...
Senior Software Engineer, Platform Engineering
The Platform Engineering team is responsible for building a cloud-native developer platform (PaaS) that enables the end-to-end software development lifecycle for over 600 engineers at Verily. Prior experience with cloud technologies: Google Cloud Platform/Amazon Web Services/Azure or other cloud pro...