Required Skills
- 3+ years' experience working in a similar Software Engineer role within a data platform / data engineering team
- Experience with Big Data and distributed systems.
- Experience with focus on working with Debezium for change data capture and real-time data streaming.
- Experience working with Kubernetes, AWS, Docker, and Terraform.
- Prior experience in building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on the public cloud.
- Excellent programming skills in Java.
- Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms).
- Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques.
- Eager to learn new things and passionate about technology!
What you would do
- Design, develop and run cloud native data platform and analytics SaaS services
- Design and build large scale real-time stream processing systems
- Develop and run micro-services and analytics SaaS solutions
- Perform test driven unit and end to end testing of any code you develop.
- Own Continuous Integration (CI) and Continuous Deployment (CD) for your services
- Own scalability, availability and data security for your services
- Own, troubleshoot & resolve code defects
- Mentor other developers in best practices
What you would need to succeed
- Extensive experience working on a public cloud-like AWS
- Prior experience and passion for building a large-scale multi-tenant cloud-native data platform
- Emphasize team wins over individual success
- Strong technical interpersonal skills
- Excellent software development skills in one or more of the following languages : Java / Scala
- Extensive experience with Big Data and distributed systems.
- Expertise in Spark or Flink, Kafka, and Hadoop ecosystem
- Ability to design large-scale distributed systems
- Have developed in more than one language and ready to pivot to any language / framework
- Understand microservices architecture patterns pattern like Service Discovery / API Gateway / Domain Driven Design etc
- Experience with containers technology
- Ability to work in an agile fast-paced environment
- BS or MS degree (Computer Science or Math)
Bonus
- AWS (EMR, S3, Glue, Kinesis)
- Debezium
- Experience in building SaaS / PaaS on AWS / GCP / Azure.
$110000 - $130000 a year
30+ days ago