Overview
Senior Software Engineer, Platform at People Data Labs (PDL). You will be crucial in accelerating efforts to build standalone data products that enable data teams and independent developers to create innovative solutions at massive scale. You will work with a team, defining tools and infrastructure that facilitate big data processing, primarily within AWS. PDL embraces a high-autonomy environment with opportunities for direct contributions and a culture that values thoughtful experimentation and learning from failure.
Note for all engineering roles : With the rise of fake applicants and AI-enabled candidate fraud, we have built in additional measures throughout the process to identify such candidates and remove them.
What You Get To Do
- Manage and improve our growing AWS and data center infrastructures
- Design, implement, and maintain a CI / CD pipeline to improve developer workflows
- Utilize centralized monitoring and logging to improve visibility across the team
- Assist development teams in solving issues around scaling and bottlenecks
- Work with teammates to develop high-quality software, balancing security, reliability, and operational concerns
The Technical Chops You'll Need
5-7+ years of software development experience with a background in platform or cloud infrastructure engineering and clear examples of strategic technical problem-solving and implementation3+ years of experience with Python in a production environmentStrong software development fundamentals and system design experienceStrong experience with core technologies (AWS, ElasticSearch / OpenSearch, Python, Docker, scaled data processing technologies)AWS experience including EC2, Lambda, OpenSearch, API Gateway, ALB, and related servicesData stores experience (Postgres / MySQL, Dynamo, Redis, S3)Experience with Infrastructure-as-code frameworks (e.g., Pulumi, Terraform, CloudFormation, or similar)Experience with network design, including public / private availability, routing, firewalls / security groups, and VPNExperience with Identity and Access ManagementExperience with configuration management tools (e.g., Chef, Puppet, Ansible, etc.)Experience with observability tools such as Datadog for metrics and loggingExperience with build and deploy systems, architecting and developing CI / CD infrastructure, repo management, and integrating with tools like GitHub Actions (or similar)People Thrive Here Who Can
Balance high ownership and autonomy with a strong ability to collaborateCan work effectively remotely, proactively managing blockers and engaging with the teamStrong written communication skills on Slack / Chat and in documentsExperience writing data design docs (pipeline design, dataflow, schema design)Ability to scope and break down projects, and communicate progress and blockers effectively with your manager, team, and stakeholdersSome Nice To Haves
Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineeringExpertise with Apache Spark (Java, Scala, and / or Python-based)Experience with SQL Data Pipeline DevelopmentExperience with developer-oriented data pipeline and workflow orchestration (e.g., Airflow, dbt, dagster, or similar)Experience managing streaming platforms (e.g., Kafka)Experience evaluating data quality and maintaining high standards across feature releasesExperience using Databricks or similar data-development platformsExperience managing hybrid environments split between local datacenters and AWSBenefits
StockCompetitive SalariesUnlimited paid time offMedical, dental, & vision insuranceHealth, fitness, and office stipendsThe ability to work wherever and however you wantCompensation : $160K - $180K
No C2C, 1099, or Contract-to-Hire. Recruiters need not apply.
PDL does not discriminate on race, sex, color, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity or any other status protected by law in the provision of employment opportunities and benefits.
Qualified applicants with arrest or conviction records will be considered in accordance with applicable fair chance laws.
Personal Privacy Policy for California Residents : https : / / privacy.peopledatalabs.com / policies?name=personnel-privacy-policy
#J-18808-Ljbffr