Clearance Requirement : Must be US Citizen and should be able to obtain DHS FEMA clearance.
Primary Responsibilities
- Take responsibility for the delivery of Data Migration for multiple systems : analysis, design, implementation, testing, validation, and acceptance.
- Assembling large, complex sets of data that meet non-functional and functional business requirements.
- Communicate with key stakeholders to understand the data migration needs and requirements and troubleshoot data inconsistencies that might arise.
- Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
- Working with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues
- Develop logical and conceptual data models.
- Develop data migration strategies and plans.
- Develop scripts to extract, transform and load data.
- Perform data analysis and cleansing activities to ensure data quality, as needed.
- Troubleshoot and resolve issues related to data migration.
- Participate in data migration testing including data-level validation and application-level validation.
- Document data migration processes, procedures, and outcome.
Required Skills and Experience
- 8+ years of work experience with a combination of data modeling, ETL, database operations, data services, data analytics, ETL and data migration tools.
- 5+ years of work experience with coding in one of mainstream programming languages : Python, Java, Node.js etc.
- Experience in design and development of ETL process using AWS ETL tools like AWS DMS, Glue, Athena, AWS Aurora PostgreSQL, etc.
- Experience in designing data migration solutions, archival processes, and reconciliation.
- Experience with data quality checks, data de-duplication and data validation processes.
- Perform data migration audit, reconciliation, and exception reporting.
- Experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- Experience operating production workloads on Oracle / PostgreSQL (preferred)
- Solid understanding of data elements and their relationships between the source and target systems
- Experience working on real-time data and streaming applications.
- Experience with NoSQL implementation (DynamoDB, Mongo, Cassandra)
Data Engineer III - Remote
A company is looking for a Data Engineer III - REMOTE. ...
Azure Cloud Data Engineer-11324-Remote
Develop technical solutions for data acquisition, data integration, and data sharing with Navy Federal's digital platforms and fraud business in Near Real-Time and batch. Design and build highly scalable data pipelines for near real-time and batch data ingestion, processing, and data integration. Re...
Senior Data Engineer - Remote
...
Cloud Data Engineer- Only USC - Remote- Full time position
Hands on experience working with Google Data Products like BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Cloud Data Fusion, Dataprep, etc. Hands on experience working with Google Data Products like BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Cloud Data Fusion, Dataprep, etc...
Principal Data Engineer - Remote US
A company is looking for a Principal Data Engineer - Remote US. ...
Data Engineer-Remote
ETL, database operations, data services, data analytics, ETL and data migration tools. Experience with data quality checks, data de-duplication and data validation processes. Communicate with key stakeholders to understand the data migration needs and requirements and troubleshoot data inconsistenci...
Sr Lead Data Platform Engineer, Shopping (Remote-Eligible)
Sr Lead Data Platform Engineer, Shopping (Remote-Eligible). We are seeking Full Stack Software Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Software Engineer, you'll have the opportunity to be on the forefront of driving a major transforma...
Lead Data Engineer- Ab Initio Administrator (Remote)
Candidate will support the implementation of a Data Integration/Data Warehouse for the Data products on-prem and in AWS. Created Big Data pipelines (ETL) from on-premises to Data Factories, Data Lakes, and Cloud Storage such as EBS or S3. Defines and develop the Data Integration best practices for t...
Senior Data Engineer (Scala) (remote)
We are looking for a talented Data Engineer who is eager to apply computer science, software engineering, databases, and distributed/parallel processing frameworks to prepare big data for the use of data analysts and data scientists. Senior Data Engineer (Scala) (Remote). We are looking for a season...
Senior Data Validation Engineer - Scala - (Remote)
We are looking for a talented Data Validation Engineer who is eager to apply computer science, software engineering, databases, and distributed/parallel processing frameworks to prepare big data for the use of data analysts and data scientists. Work with huge data sets and work with other Data Engin...