Senior Data Platform Engineer

Job Summary

We are looking for a mid-level backend engineer who loves to build cloud services a systems engineer who is comfortable in every stage of the design, implementation, testing, and deployment process.

In particular, we are hiring an engineer who can develop and deploy cloud-based data analytics services to be used by data engineers, analysts and data scientists.

These initial services are similar to AWS EMR-on-EKS, EMR Studio, etc.

Note : We are looking for a mid to senior level data platform engineer who is based in the Bay Area and can come to the office up to 2-3 times per week.

This position requires someone who has experience building data platform tools for developers, rather than just being an end user .

The Team and Our Values

We are a team of software engineers of various technical backgrounds and at various stages in our careers. We value diverse viewpoints and have a culture built on respect, creativity, and collaboration.

We value self-motivation and self-learning; we are proactive in our actions and always eager to know more. We are always enthusiastic to share knowledge and expertise.

Position Details :

Location : Mountain View, CA (Hybrid / Onsite 2-3 days a week )

Type : Full Time

Job Responsibilities

• Building, implementing and deploying cloud services, especially data analysis-related tools.
• Integrate with other cloud services running in our client's private cloud.
• Participate in a globally distributed team of engineers that uses the cloud platforms to deliver services to include functional scoping and work distribution as subject matter expert

Skills & Competencies

• Strong CS Computer Science background
• Proficiency in one of the public cloud platforms such as AWS, GCP and Azure
• Excellent organizational skills with the ability to set priorities and meet deadlines
• Versatility in playing multiple roles and a willingness to learn new skills and take on diverse responsibilities
• Proficiency in learning new techniques, languages, and tools
• Ability to work with a small team of engineers to build, implement and commercialize a data analysis platform that manages tools including Spark, Flink, Airflow and Superset
• Strong analytical skills for troubleshooting unexpected system pathologies
• Demonstrated initiative and bias for action
• Innovative mindset with the ability to work with minimal supervision
• Understanding of Waterfall and Agile methodologies
• Good communication skills
• Ownership - Take ownership of projects, ensuring excellence in execution and accountability for results. Foster a sense of responsibility and pride in delivering high-quality work
• Innovation - Drive innovation by proposing and implementing creative solutions to challenges. Stay abreast of industry trends and technologies, bringing fresh ideas to the table
• Customer focus - Understand and prioritize customer needs, striving to exceed expectations in every interaction. Collaborate with cross-functional teams to ensure the delivery of customer-centric solutions
• Teamwork - Embrace a collaborative and inclusive approach, working seamlessly with colleagues to achieve common goals

Education & Experience

• Bachelor's degree in Computer Science or related field. A graduate degree is a plus.
• At least 5 years of experience developing cloud services, using data platform services is a big plus.
• Hands on experiences in AWS-SDKs, AWS-CLI, Golang, Java, Python, SQL, Terraform
• Hands on experiences and the internals of big data tools such Spark, Dela Lake, Jupyterhub and analytics tools
• Hands on experience in Docker, Kubernetes, Jenkins, Helm, Ansible and shell scripting
• Experience in managing software across hundreds of servers distributed among multiple data centers, understanding the unique trade-offs and pitfalls involved
• Participation in the open-source community is a plus

Blackstone Talent Group is a wholly owned subsidiary of Blackstone Technology Group, a global IT services and software firm that implements technological solutions across commercial industry verticals and the US Federal Government.

Blackstone's global talent augmentation practice was founded in 1998. Blackstone Talent Group has offices in San Francisco, Denver, Houston, Colorado Springs, and Washington, DC.

We specialize in providing clients the best talent across a variety of industries and sectors.