Data Engineer-Remote

Shuvel Digital
Fairfax, Virginia, United States
Remote
Full-time

Clearance Requirement : Must be US Citizen and should be able to obtain DHS FEMA clearance.

Primary Responsibilities

  • Take responsibility for the delivery of Data Migration for multiple systems : analysis, design, implementation, testing, validation, and acceptance.
  • Assembling large, complex sets of data that meet non-functional and functional business requirements.
  • Communicate with key stakeholders to understand the data migration needs and requirements and troubleshoot data inconsistencies that might arise.
  • Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
  • Working with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues
  • Develop logical and conceptual data models.
  • Develop data migration strategies and plans.
  • Develop scripts to extract, transform and load data.
  • Perform data analysis and cleansing activities to ensure data quality, as needed.
  • Troubleshoot and resolve issues related to data migration.
  • Participate in data migration testing including data-level validation and application-level validation.
  • Document data migration processes, procedures, and outcome.

Required Skills and Experience

  • 8+ years of work experience with a combination of data modeling, ETL, database operations, data services, data analytics, ETL and data migration tools.
  • 5+ years of work experience with coding in one of mainstream programming languages : Python, Java, Node.js etc.
  • Experience in design and development of ETL process using AWS ETL tools like AWS DMS, Glue, Athena, AWS Aurora PostgreSQL, etc.
  • Experience in designing data migration solutions, archival processes, and reconciliation.
  • Experience with data quality checks, data de-duplication and data validation processes.
  • Perform data migration audit, reconciliation, and exception reporting.
  • Experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • Experience operating production workloads on Oracle / PostgreSQL (preferred)
  • Solid understanding of data elements and their relationships between the source and target systems
  • Experience working on real-time data and streaming applications.
  • Experience with NoSQL implementation (DynamoDB, Mongo, Cassandra)
  • 24 days ago
Related jobs
Promoted
Capital One
McLean, Virginia
Remote

Senior Distinguished Engineer (Enterprise data storage and consumption platforms) (Remote-Eligible). Experience with modern data platform strategies (Data Mesh, Data Fabric). Distinguished Engineer - Enterprise data storage and consumption platforms. We are the  Data Storage, & Consumption platform ...

Promoted
Demo - Maximus
Reston, Virginia
Remote

They are experienced in data, analytics, and data science development and implementation, data architecture, data visualization and communication, ETL/ELT layers, and performance tuning. The Engineer - Data Analytics Technology contributes to the successful delivery of analytic solutions. The Engine...

Promoted
NuWave Solutions
Arlington, Virginia
Remote

Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets. Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets. As a Data Engineer, you ...

Promoted
Atlas Tech
Alexandria, Virginia
Remote

Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and provide robust solutions. Experience migrating data from Microsoft SQL Server Databases into Microsoft Dataverse. Strong understanding of data architecture, data modeling, and database design ...

Capital One
McLean, Virginia

Senior Distinguished Engineer (Enterprise data storage and consumption platforms) (Remote-Eligible). Experience with modern data platform strategies (Data Mesh, Data Fabric). Distinguished Engineer - Enterprise data storage and consumption platforms. We are the  Data Storage, & Consumption platform ...

Motion Recruitment
Virginia, United States
Remote

They are currently looking to hire a Senior ETL Operations and Data Analytics Engineer, someone that will serve as a driving force in the data-driven decision-making process. Committed to staying ahead in the dynamic landscape of data analytics, they are dedicated to providing top-tier expertise and...

NTT DATA Services
Herndon, Virginia
Remote

We are currently seeking a Senior DevOps Engineer - Remote to join our team in Herndon, Virginia (US-VA), United States (US). NTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications, headquartered in Texas. As part of NTT DATA, a $30 billion trust...

Shuvel Digital
Vienna, Virginia
Remote

Develop technical solutions for data acquisition, data integration, and data sharing with Navy Federal's digital platforms and fraud business in Near Real-Time and batch. Design and build highly scalable data pipelines for near real-time and batch data ingestion, processing, and data integration. Re...

BizFirst
Alexandria, Virginia
Remote

Databricks: Experience with Databricks for data processing and analytics, including building and managing data pipelines in Databricks environments. Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets. As a Senior D...

Shuvel Digital
Vienna, Virginia
Remote

Significant hands-on experience with Azure services such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage (ADLS Gen2), Azure SQL, and other data sources. You will be working with all levels of technology from backend data processing technologies (Databricks/Apache Spark) to other Clo...