General Purpose
This role oversees and manages the work of Data Engineer who design and develop ETL pipelines and processes in our Cloud Infrastructure.
They are responsible for the overall data integrity and quality, pipeline performance, and cost optimization within our Cloud (Azure) infrastructure.
Duties and Responsibilities
- Manages the day-to-day tasks and development work of the Data Engineering team to ensure alignment with objectives and deliverables
- Conducts continuous evaluation and improvement on the ETL pipelines created by the Data Engineers to ensure cost effectiveness and performance
- Designs and implement automatic data quality reporting, communicating directly with different stakeholders whenever there are deviations
- Create and implement technical roadmaps to ensure we have the most up-to-date Cloud infrastructure
- Ensure technical alignment with the Data Engineering team from HQ.
Qualifications
- Bachelor's degree in computer science, software engineering, information technology, or a related field.
- Advanced degree is a plus.
- 3+ years experience in data engineering, including hands-on experience in building and maintaining data pipelines and data infrastructure.
- 3+ years proven experience leading and managing a team of data engineers, including setting objectives, providing guidance, and assessing performance
- A strong foundation in data engineering principles, including data integration, ETL (Extract, Transform, Load) processes, data warehousing, and data modeling.
- Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL.
- Proficiency with big data technologies and platforms, such as Hadoop, Spark, Apache Kafka, and distributed data processing frameworks.
- Experience with various database systems, including relational databases (e.g., SQL Server, PostgreSQL) and NoSQL databases (e.
g., MongoDB, Cassandra).
- Proficiency on cloud platforms like Azure, AWS, etc. for data storage and processing.
- Ability to lead and manage a team of data engineers, including setting objectives, providing guidance, and assessing performance.
- 30% travel projected
Lead Software Engineer Data Management
A company is looking for a Lead Software Engineer in Data Management. ...
Lead Data Engineer
The Data Engineer will be an experienced professional with exceptional leadership skills and a robust background in Big Data and Cloud Computing to drive the development of their Digital Transformation. Data Engineer | AWS | Big Data | Databricks. A globally recognized client of ours in Texas is loo...
Lead Data Analytics Engineer
A company is looking for a Lead Data Analytics Engineer. ...
Lead Data Platform Engineer
Design and manage data platforms, including data storage, data processing, data security, and data quality. Collaborate with cross-functional teams, such as data engineers, software engineers, infrastructure teams, and business units to enable effective data cohesion to support business processes an...
Project Engineer Principal (Tech Lead), Combat Data Systems - Level 6
You will be the Project Engineering Tech Lead supporting the execution of F-35 Combat Data Systems (CDS) Follow On Modernization, Block Four and other Combat Data Systems development contracts. As the Project Engineering Tech Lead you will be responsible for:. Collaboration with technical Integrated...
Data Engineer Lead / Architect
Data Engineer Lead / Architect. Experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python. Over 10+ years of total IT experience 5+ years of experience with Hadoop (Cloudera)/big data technologies. Advanced knowledge of the Hadoop ecosystem and ...
Lead Data Engineer
A strong foundation in data engineering principles, including data integration, ETL (Extract, Transform, Load) processes, data warehousing, and data modeling. Ability to lead and manage a team of data engineers, including setting objectives, providing guidance, and assessing performance. This role o...
Lead Data Engineer
We are looking for a Lead Data Engineer to join our Data Engineering team. In this role, you will lead a team of Data Engineers in designing and building scalable data pipelines and systems. The candidate should possess intellectual acumen, with an engineering mindset and an interest in developing e...
Lead Data Engineer/SQL Architect
Do you have an extensive understanding of multiple areas of data engineering? Our company is a leading fortune 500 national producer & distributor for energy, and we are looking to hire a principal data engineer to help develop resilient and scalable data infrastructure. We are looking for a Lead Da...
Lead Data Engineer
Are you an experienced data engineer looking for a unique challenge? We are seeking a seasoned data professional to develop and enhance data ingestion, cleaning, and transformation processes & ETL pipelines with a special eye towards scalability & high uptime requirements. This includes an understan...