Job Description
Job Description
Senior Data Engineer&
Expertise
Python
NoSQL
Azure
Data Modeling
Kubernetes
HIPAA
Apache Spark - 3 years
PySpark
Snowflake - 3 years
Apache Airflow
Data Engineer - 3 years
Schema Design
Requirements :
Bachelor’s or master’s degree in computer science, Engineering, or a related field.
5 - 10 years of experience in data engineering, with a strong background in Apache Spark and cloud-based databases such as Snowflake.
Strong Knowledge in Big Data Technologies, PySpark, thorough in one or more programming language like Python
Proven experience with AWS or Azure cloud services for data storage, processing, and analytics.
Expertise in workflow management tools like Airflow and container orchestration systems such as Kubernetes.
Strong knowledge of SQL and NoSQL databases, as well as data modeling and schema design principles.
Familiarity with healthcare data standards, terminologies, and regulations, such as HIPAA and GDPR, is highly desirable.
Excellent problem-solving, communication, and collaboration skills, with the ability to work effectively in cross-functional teams.
Demonstrated ability to manage multiple projects, prioritize tasks, and meet deadlines in a fast-paced environment.
A strong desire to learn, adapt, and contribute to a rapidly evolving data landscape.
Responsibilities :
Design, develop, and maintain scalable, reliable, and secure data pipelines to process large volumes of structured and unstructured healthcare data using PySpark and cloud-based databases.
Collaborate with data architects, data scientists, and analysts to understand data requirements and implement solutions that meet business and technical objectives.
Leverage AWS or Azure cloud services for data storage, processing, and analytics, optimizing cost and performance.
Utilize tools like Airflow for workflow management and Kubernetes for container orchestration to ensure seamless deployment, scaling, and management of data processing applications.
Develop and implement data ingestion, transformation, and validation processes to ensure data quality, consistency, and reliability across various healthcare datasets.
Monitor and troubleshoot data pipelines, proactively identifying and resolving issues to minimize downtime and ensure optimal performance.
Establish and enforce data engineering best practices, ensuring compliance with data privacy and security regulations specific to the healthcare industry.
Continuously evaluate and adopt new tools, technologies, and frameworks to improve the data infrastructure and drive innovation.
Mentor and guide junior data engineers, fostering a culture of collaboration, learning, and growth within the team.
Collaborate with cross-functional teams to align data engineering efforts with broader organizational goals and strategies.
Is familiar with SOC 2 compliance and its impact on company policies and processes.
Understands importance of adhering to SOC 2 requirements and maintains an effort to do so
Senior Data Engineer
AWS Certified Data Analytics, Google Cloud Professional Data Engineer, Microsoft Azure Data Engineer Associate). As a Senior Data Engineer, you will play a pivotal role in our agile analytics team, leading the design, development, and optimization of complex data infrastructure and pipelines. You wi...
Senior Data Engineer
As a Senior Data Engineer on the Data team, you will help build the platform to generate, track, manage and triage key business and client success metrics. Create and manage ETL/ELT workflows that transform our billions of raw data points daily into quickly accessible information across our database...
Senior Mechanical Design Engineer (Data Center HVAC)
Senior Mechanical Design Engineer (Data Center HVAC). The Senior Mechanical Design Engineer mentors junior engineers. Effectively interacts with other internal and external teams, including the design engineering, site engineering, construction management and regional operations teams, onsite suppor...
Senior Data Engineer - Identity Data
As a Senior Data Engineer within Identity Data Engineering, You will help build systems which can elastically scale to handle extensive amounts of data. We contribute to the Company’s success by partnering with business, analytics and infrastructure teams in designing and building data pipelines for...
Command and Data Handling Engineer - Experienced, Lead, and Senior Level
Bachelor of Science degree from an accredited course of study in engineering, engineering technology (includes manufacturing engineering technology), chemistry, physics, mathematics, data science, or computer science. Command and Data Handling Engineer. Senior (level 5): Education/experience typical...
Senior Software Engineer, Data Platforms
Our Big Data Applications Engineering team is seeking a highly motivated Software Engineer with a strong technical background who is passionate about designing and building systems to process data at scale, solving challenging problems in both batch and real-time data processing, and working across ...
Senior Data Engineer - Startup Experience
You will help choose tech tools wisely, ensure data quality, collaborate to build effective data solutions, support self-service, troubleshoot data issues, and staying updated on data engineering trends for continuous improvement. We are looking for Senior Data Engineer with 5 years of experience wh...
Senior Data Warehouse Engineer, Business Intelligence Platform
Senior Data Warehouse Engineer**. ServiceTitan is seeking an exceptional Senior Data Warehouse Engineer to join one of the fastest-growing tech startups in Southern California, backed by the best VC firms in the SaaS space. Define governance and best practices around meta-data to ensure an integrate...
Senior Mechanical Engineer
Ampex is a small, fast-paced, growing aerospace company looking for a highly motivated and organized Senior Mechanical Engineer to join our multi-disciplinary engineering team in developing leading data management solution products for aerospace applications. Ampex is a cutting-edge technology innov...
Senior Data Engineer
The Wounded Warrior Project (WWP) Senior Data Engineer is a member of the Web, Data, and Analytics team responsible for data engineering and programming to build systems that collect, manage, and convert raw data into usable information for business analysts. Build required infrastructure for optima...