Senior Data Platform Engineer

About Mendel : At Mendel, we are enabling different stakeholders in healthcare to make better decisions by learning from every patient's journey from a physician deciding on the best treatment for a patient to a pharma company discovering the next blockbuster drug.

In creating depth and breadth for a patient’s health record journey, Mendel enables the right care to be delivered at the right time to the right person.

This is an incredible opportunity to join a unique vision to improve healthcare using AI technology.

About the Role :

We seek an experienced and highly skilled Senior Data Platform Engineer to join our dynamic team. In this crucial role, you will be responsible for designing, building, and maintaining our organization's data platforms and infrastructure, ensuring efficient and reliable data processing, storage, and analysis capabilities.

Your expertise in data engineering will contribute to our organization's data-driven decision-making and overall success.

Responsibilities :

• Architect and build scalable and performing data platforms by leveraging technologies like Apache Spark, Elastic, Kafka, Kubernetes, and various cloud-based data services.
• Design and develop data pipelines for ingesting, transforming, and processing large volumes of structured and unstructured data from multiple sources.
• Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and translate them into robust and efficient scalable data solutions.
• Optimize data workflows and processes for performance, reliability, and cost-effectiveness.
• Implement data governance policies, data quality controls, and data security measures to ensure data integrity and compliance with regulatory requirements.
• Automate and streamline data operations through scripting, containerization, and orchestration tools.
• Participate in code reviews, knowledge sharing, and mentoring of junior team members.
• Stay up-to-date with emerging data technologies, trends, and best practices, and contribute to the continuous improvement of our data platform.

Qualifications :

• Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent professional experience.
• Minimum of 5 years of experience in data engineering or a related role, with a strong focus on building and maintaining data platforms and infrastructure.
• Proficient in programming languages such as Python, Scala, or Java, and experience with SQL and NoSQL databases.
• Hands-on experience in distributed computing frameworks like Apache Spark, Ray, and related ecosystem tools.
• Experience cloud platforms (e.g., AWS, GCP, Azure) and their data services.
• Experience with containerization technologies like Docker and orchestration tools like Kubernetes.
• Experience in solving complex problems using both structured and unstructured data.
• Strong understanding of data modeling, data warehousing, and data integration concepts.
• Excellent problem-solving, analytical, and troubleshooting skills.
• Ability to work collaboratively in a team environment and communicate complex technical concepts effectively.

Preferred Skills :

• Master's degree in a relevant field or equivalent experience.
• Experience with real-time data processing and streaming technologies (e.g., Apache Kafka, Apache Flink).
• Experience in data governance, data quality, and data security best practices.
• Experience in agile software development methodologies and DevOps practices.
• Experience with machine learning and data science workflows is a plus.

P.S. : This role will require you working out of our San Jose office. Please feel free to apply if you are local or open to relocation.

Why should you join our team :

Benjamin Franklin once said : If you would not be forgotten as soon as you are dead, either write something worth reading, or do something worth writing.

at Mendel you can do the latter. There are two things more devastating than learning that you or your loved ones have a terminal illness;

getting the wrong treatment or not finding any. At Mendel, we are on a sincere mission to solve many never-solved-before technology challenges that can enable prescribers and drug makers to do their best