Data Engineer

Horizontal Talent
Minneapolis, Minnesota, US
Full-time

JOB DESCRIPTION

Responsibilities :

Designing and developing data pipelines and data storage using cloud technologies using approved AWS technologies and services.

Data management for data in AWS GovCloud

Data migration for large programs such as migrating from Oracle, DB2.

Data mapping, ETL / ELT frame works, using streaming data processing

Developing data pipe lines using AWS technologies Aurora, DynamoDB, RedShift, S3, Glue, Lambda, etc.

Troubleshooting data related issues, helping testing team for data validation and partner with DevSecOps and external partners for releasing of software with appropriate documentation and controls

Proficient in database management best practices

Working experience in Agile development methodologies; SDLC

Working on complex projects crossing multiple platforms and diverse technologies

Data migration, database change management and data management through the stages of the development life cycle

Planning, estimating, performing, and tracking work related to systems development, systems process analysis, process design or process reengineering.

Resolve system problems and provide options to determine optimal solution.

Designing and implementing solutions and architectural design patterns requiring complex technologies in an enterprise environment across multiple platforms.

Qualifications :

10+ years working on designing and developing data pipelines and data storage using cloud technologies

AWS experience including DynamoDB and Redshift. Tableau, SQL.

Experience with data migration for large programs such as migrating from Oracle, DB2.

30+ days ago
Related jobs
Promoted
Sunrise Banks
Saint Paul, Minnesota

Technical Service Center, Data Engineering, Application Operations. Provides day-to-day operational support of Sunrise Bank’s data related systems, including helping resolve user issues, system alerts, and other alerts (external partner issues, etc. Leads or assists in problem solving issues with an...

Promoted
Olsson Associates Inc.
Minneapolis, Minnesota
Remote

Senior Electrical Engineer - Arc Flash - Data Center (Remote). We are Olsson, a team-based, purpose-driven engineering and design firm. As a Senior Electrical Engineer, you will work directly with some of the world’s largest technology companies and other mission-critical clients. You will serve as ...

020 Travelers Indemnity Co
Saint Paul, Minnesota

Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and trans...

Travelers
Saint Paul, Minnesota

Incorporate core data management competencies including data governance, data security and data quality. As a Data Engineer II within the ED&A organization, you will play a key role in growing and transforming our analytics landscape. In addition to your strong analytical mind, you will bring your i...

020 Travelers Indemnity Co
Saint Paul, Minnesota

Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Senior Associate Data Engineer you will help guide growth an...

Amazon Data Services, Inc.
Minneapolis, Minnesota

Engineers in the Backbone Enterprise and Regional Engineering (BERE) organization have a wide range of responsibilities; we work with internal partners to develop and implement the next-generation platforms along with the tooling ecosystems to support these platforms driving efficiency and scalabili...

020 Travelers Indemnity Co
Saint Paul, Minnesota

Incorporate core data management competencies including data governance, data security and data quality. As a Data Engineer II within the ED&A organization, you will play a key role in growing and transforming our analytics landscape. In addition to your strong analytical mind, you will bring your i...

Genesis10
Minneapolis, Minnesota

We believe in the unlimited potential of people, and most importantly, the unlimited potential in YOU! Did you realize too late in your degree program that you wished you had pursued technology? Do you wish you could pivot into data engineering from your current job or career path? Did a friend or ...

GEICO
Minneapolis, Minnesota
Remote

Advanced experience developing new and enhancing existing data processing (data ingestion, data transformation, data storage, data management, data quality) components. Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool) or Databricks. We are seeking experienced eng...

Asset Marketing Services, LLC.
Eagan, Minnesota

Integrate data from multiple data sources, including APIs, databases, and external data providers, ensuring seamless data flow and consistency. Design and develop data solutions using Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and other Azure services. Experie...