Data Engineer

Overview

The Data Engineer will play a crucial role in advancing the CDC Foundation's mission by designing, building, and maintaining data infrastructure for a public health organization.

This role is aligned to the Workforce Acceleration Initiative (WAI). WAI is a federally funded CDC Foundation program with the goal of helping the nation’s public health agencies by providing them with the technology and data experts they need to accelerate their information system improvements.

Working within Turtle Mountain Band of Chippewa Public Health Department (TMPHD), the Data Engineer will be responsible for creating and managing the architecture for data generation, storage, processing, and analysis.

This position involves collaborating with the TMPHD team and other organizational staff to design and implement solutions that address the public health agency’s needs, evaluate existing data governance processes, and establish secure data connections to enhance public health data sources.

The Data Engineer will be hired by the CDC Foundation and assigned to the Turtle Mountain Band of Chippewa Public Health Department.

This position is eligible for a fully remote work arrangement for based candidates.

Responsibilities

• Create and manage the systems and pipelines that enable efficient and reliable flow of data, including ingestion, processing, and storage.
• Design, develop, and manage data systems and pipelines to ensure efficient data flow, including ingestion, processing, and storage.
• Use Rhapsody to integrate data from diverse sources, transform and clean it to maintain accuracy, and load it into data storage systems or warehouses.
• Work closely with data technicians to deploy a public health surveillance system
• Optimize data pipelines, infrastructure, and workflows to enhance performance and scalability.
• Monitor and troubleshoot data pipelines and systems, addressing performance issues, errors, and anomalies.
• Implement security measures to safeguard sensitive information.
• Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and ensure that the data infrastructure supports organizational goals.
• Collaborate with cross-functional teams to design scalable data solutions that align with business needs.
• Develop and maintain ETL (Extract, Transform, Load) processes to ensure data accuracy and consistency.
• Manage data storage systems, including relational and NoSQL databases, and data warehouses.
• Stay informed about industry trends, best practices, and emerging technologies in data engineering, applying this knowledge to the organization's data infrastructure.
• Provide technical guidance to internal and external team members.
• Communicate effectively with all organizational levels to gather requirements, provide updates, and present findings.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
• Minimum 5 years of relevant professional experience in data engineering.
• Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL, with the ability to implement data automations within existing frameworks.
• Strong understanding of relational databases (, MySQL, PostgreSQL) and NoSQL databases (, MongoDB, Cassandra).
• Experience with establishing Secure File Transfer Protocols (SFTP) and / or Simple Storage Service (S3) connections
• Familiarity with engineering best practices, including source control, automated testing, continuous integration and deployment, and peer review.
• Knowledge of data warehousing concepts and tools.
• Experience with cloud computing platforms.
• Expertise in data modeling, ETL (Extract, Transform, Load) processes, and data integration techniques.
• Understanding of agile development methodologies and software design patterns.
• Strong analytical thinking and problem-solving abilities.
• Excellent verbal and written communication skills, with the ability to effectively convey technical concepts to non-technical stakeholders.
• Ability to adapt to evolving project requirements and priorities.
• Outstanding interpersonal skills and the ability to develop productive working relationships with colleagues and partners.
• Demonstrated capability to work well independently and as part of a team.
• Experience working in a remote environment with distributed teams
• Proficiency in Microsoft Office.

Special Notes This role is involved in a dynamic public health program. As such, roles and responsibilities are subject to change as situations evolve.

Roles and responsibilities listed above may be expanded upon or updated to match priorities and needs, once written approval is received by the CDC Foundation in order to best support the public health programming.