Data Engineer Python (3845)

SMX
Washington, District of Columbia, United States
Full-time

We are seeking a talented Data Engineer (Python) with expertise in ETL (Extract, Transform, Load) processes and Apache Airflow.

The candidate will be responsible for designing and implementing robust and efficient data pipelines, ensuring high data quality, and contributing to the continuous improvement of our data management practices.

This is a remote position supporting a Washington, DC based team.

Essential Duties and Responsibilities :

  • Design, develop, and maintain ETL processes using Python and Apache Airflow.
  • Collaborate with data analysts and other stakeholders to understand and meet their data requirements.
  • Develop and implement data validation processes to ensure high data quality.
  • Troubleshoot and resolve issues related to data pipelines.
  • Optimize data extraction, transformation, and loading processes to improve efficiency and performance.
  • Document and maintain the design and details of data processes and schemas.
  • Stay updated with the latest industry trends and technologies to ensure our data practices remain current.

Required Skills :

  • Proficiency in Python : A strong understanding of Python programming language is crucial. This includes knowledge of Python libraries and frameworks like Pandas, NumPy, and Django.
  • Expertise in Apache Airflow : Experience in designing, building, and maintaining data pipelines using Apache Airflow. Knowledge of Airflow's architecture, including DAGs and Operators, is important.
  • ETL Processes : Proficiency in ETL (Extract, Transform, Load) processes, including data extraction from various sources, data transformation (cleaning, validating, aggregating, joining, etc.

and loading data into the end target (database or data warehouse).

  • Database Knowledge : Strong understanding of SQL and NoSQL databases, including writing complex queries and database optimization techniques.
  • Data Warehousing : Experience with data warehousing solutions like Amazon Redshift, Google BigQuery, or Microsoft Azure SQL Data Warehouse
  • Strong communication and collaboration skills.
  • Excellent problem-solving skills.

Desired Skills :

Knowledge of data modeling and data warehousing.

Education and Certifications :

Bachelor's degree in Computer Science, Information Systems, or a related field. Additional years of experience in lieu of degree will be considered.

Application deadline 10-25-2024

LI-Remote

The SMX salary determination process takes into account a number of factors, including but not limited to, geographic location, Federal Government contract labor categories, relevant prior work experience, specific skills, education and certifications.

At SMX, one of our Core Values is to Invest in Our People so we offer a competitive mix of compensation, learning & development opportunities, and benefits.

Some key components of our robust benefits include health insurance, paid leave, and retirement.

The proposed salary for this position is :

$96,800 $145,200 USD

At SMX®, we are a team of technical and domain experts dedicated to enabling your mission. From priority national security initiatives for the DoD to highly assured and compliant solutions for healthcare, we understand that digital transformation is key to your future success.

We share your vision for the future and strive to accelerate your impact on the world. We bring both cutting edge technology and an expansive view of what’s possible to every engagement.

Our delivery model and unique approaches harness our deep technical and domain knowledge, providing forward-looking insights and practical solutions to power secure mission acceleration.

SMX is committed to hiring and retaining a diverse workforce. All qualified candidates will receive consideration for employment without regard to disability status, protected veteran status, race, color, age, religion, national origin, citizenship, marital status, sex, sexual orientation, gender identity or expression, pregnancy or genetic information.

SMX is an Equal Opportunity / Affirmative Action employer including disability and veterans.

Selected applicant will be subject to a background investigation.

16 days ago
Related jobs
Promoted
Capital One
Washington, District of Columbia

What You’ll Do: Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insights Build the next generation Distributed Streaming Data Pipelines and Analytics Data Stores using streaming frameworks (Fl...

Promoted
Capital One
Washington, District of Columbia

West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Python, AWS, Kafka)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capit...

Promoted
Capital One
Washington, District of Columbia

What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Uti...

Promoted
DICE
Washington, District of Columbia

Fullstack Python Data Engineer - ZL. Data Engineer - The candidate will be working as part of scrum team with PO, Scrum Master, Tech Lead and several developers & testers, DevOps resources to move the OnPrem application to AWS Cloud. Technologies used are AWS Cloud, Python, etc. Python, Pandas ,...

Promoted
Capital One
Washington, District of Columbia

What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Uti...

SMX
Washington, District of Columbia

We are seeking a talented Data Engineer (Python) with expertise in ETL (Extract, Transform, Load) processes and Apache Airflow. The candidate will be responsible for designing and implementing robust and efficient data pipelines, ensuring high data quality, and contributing to the continuous improve...

Promoted
Booz Allen Hamilton
Washington, District of Columbia

Machine Learning Software Engineer, Senior. As a machine learning engineer, you’ll train, test, deploy, and maintain models that learn from data. As an experienced data professional, you know that machine learning (ML) is critical to understanding and processing massive datasets. You’ll be part of a...

Promoted
Accenture Federal Services
Washington, District of Columbia

As a Senior Full-Stack Developer, you will be responsible for driving innovation for a mission-critical web application built with. The candidate will be working with client leadership, and the existing team, to develop a long-term plan for the application and should have management and communicatio...

Promoted
Capital One
Washington, District of Columbia

West 19th Street (22008), United States of America, New York, New YorkSenior Machine Learning Engineer (Python, MLOPS, CI/CD)As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You’ll focus...

Promoted
VirtualVocations
Washington, District of Columbia

A company is looking for a Golang Full Stack Developer (Golang/ReactJS/AWS) for a remote position. ...