Talent.com
serp_jobs.error_messages.no_longer_accepting
Data Engineer

Data Engineer

RIT Solutions, Inc.Minneapolis, MN, United States
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Data Engineer (ADF, Orchestration, Data Flows, Snowflake) | REMOTE

Minneapolis, MN - Remote

Job Description

  • 10+Years of IT experience
  • Background candidates should ideally have come from SSIS / SQL transitioning to Azure Data Factory (Data Integration) Snowflake (Source and Target End Point)
  • Azure has a lot of components to it such as Fabric, DataBricks, ADF, Pyspark
  • They need candidates that can use ADF as both orchestration and integration
  • many candidates claim to have ADF but for orchestration really just use Pyspark to trigger the jobs through ADF
  • They need to be advanced at Building the Integration through data flows logic as well

100% Telecommute

Work Hours : 9am-5pm CST

Project :

  • As a member of the Data Management team, the Data Engineer supports the Alabama EDS by developing and maintaining workflows, identifying, and resolving data quality issues, and optimizing processes to improve performance.
  • The Data Engineer will also support intrastate agencies by monitoring automated data extracts and working directly with state partners to create new extracts based on business specifications.
  • Responsibilities :

  • Develop and manage effective working relationships with other departments, groups, and personnel with whom work must be coordinated or interfaced
  • Efficiently communicate with ETL architect while understanding the requirements and business process knowledge in order to transform the data in a way that's geared towards the needs of end users
  • Assist in the overall architecture of the ETL Design, and proactively provide inputs in designing, implementing, and automating the ETL flows
  • Investigate and mine data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
  • Developing ETL pipelines and data flows in and out of the data warehouse using a combination of Azure Data Factory and Snowflake toolsets
  • Developing idempotent ETL process design so that interrupted, incomplete, or failed processes can be rerun without errors using ADF dataflows and Pipelines
  • Ability to work in Snowflake Virtual Warehouses as needed in Snowflake and automate data pipelines using Snowpipe for tedious ETL problems
  • Capturing changes in data dimensions and maintaining versions of them using Stream sets in snowflake and scheduling them using Tasks
  • Optimize every step of the data movement not only limited to source and during travel but also when it's at rest in the database for accelerated responses
  • Must have the ability to build a highly efficient orchestrator that can schedule jobs, execute workflows, perform Data quality checks, and coordinate dependencies among tasks
  • Responsible for testing of ETL system code, data design, and pipelines and data flows. Root cause analysis on all processes and resolving production issues are also a part of the process and routine tests on databases and data flow and pipeline testing
  • Responsible for documenting the implementations, and test cases as well as responsible for building deployment documents needed for CI / CD
  • Ideal Background : Data Engineer with Healthcare (Medicaid) and Microsoft Azure based experience with Snowflake and Azure Data Factory

    TOP REQUIREMENTS :

  • 5+ years of Data engineering experience with a focus on Data Warehousing
  • 2+ years of experience creating pipelines in Azure Data Factory (ADF)
  • 3+ years of experience creating stored procedures with Oracle PL / SQL, SQL Server T-SQL, or Snowflake SQL
  • Required :

  • 5+ years of Data engineering experience with a focus on Data Warehousing
  • 2+ years of experience creating pipelines in Azure Data Factory (ADF)
  • 5+ years developing ETL using Informatica PowerCenter, SSIS, Azure Data Factory, or similar tools.
  • 5+ years of experience with Relational Databases, such as Oracle, Snowflake, SQL Server, etc.
  • 3+ years of experience creating stored procedures with Oracle PL / SQL, SQL Server T-SQL, or Snowflake SQL
  • 2+ years of experience with GitHub, SVN, or similar source control systems
  • 2+ years of experience processing structured and un-structured data.
  • Experience with HL7 and FHIR standards, and processing files in these formats.
  • 3+ years analyzing project requirements and developing detailed specifications for ETL requirements.
  • Excellent problem-solving and analytical skills, with the ability to troubleshoot and optimize data pipelines.
  • Ability to adapt to evolving technologies and changing business requirements.
  • Bachelors or Advanced Degree in a related field such as Information Technology / Computer Science, Mathematics / Statistics, Analytics, Business
  • Preferred :

  • 2+ years of batch or PowerShell scripting
  • 2+ years of experience with Python scripting.
  • 3+ years of data modeling experience in a data warehouse environment
  • Experience or familiarity with Informatica Intelligent Cloud Services (specifically Data Integration)
  • Experience designing and building APIs in Snowflake and ADF (e.g. REST, RPC)
  • Experience with State Medicaid / Medicare / Healthcare applications
  • Azure certifications related to data engineering or data analytics.
  • serp_jobs.job_alerts.create_a_job

    Data Engineer • Minneapolis, MN, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Data Engineer II (AWS, PySpark, Snowflake)

    Data Engineer II (AWS, PySpark, Snowflake)

    Travelers InsuranceSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Taking care of our customers, our communities and each other.By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 16...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer II (AbInitio / Snowflake / AWS / ETL Performance)

    Data Engineer II (AbInitio / Snowflake / AWS / ETL Performance)

    Travelers InsuranceSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Taking care of our customers, our communities and each other.By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 16...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer Lead

    Data Engineer Lead

    Old National BankSt Paul, MN, United States
    serp_jobs.job_card.full_time
    US-MN-Lake Elmo | US-MN-Minneapolis | US-MN-Saint Paul | US-MN-St Louis Park | US-IL-Chicago | US-IN-Evansville.Old National Bank has been serving clients and communities since 1834.With over $70 b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Tekfortune IncMinneapolis, MN, United States
    serp_jobs.job_card.permanent
    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries.In this quickly ch...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer I (AWS, PySpark, Snowflake)

    Data Engineer I (AWS, PySpark, Snowflake)

    Travelers InsuranceSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Taking care of our customers, our communities and each other.By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 16...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Technical Lead, Data Engineer

    Technical Lead, Data Engineer

    Digi-KeyBloomington, MN, United States
    serp_jobs.job_card.full_time
    DigiKey is one of the fastest growing distributors of electronic components in the world.In addition to offering the broadest selection of in-stock electronic components and providing the best serv...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    Old National BankSt Paul, MN, United States
    serp_jobs.job_card.full_time
    US-MN-Lake Elmo | US-IN-Evansville | US-IL-Chicago | US-IN-Indianapolis | US-MN-Saint Paul | US-MN-St Louis Park.Old National Bank has been serving clients and communities since 1834.With over $70 ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Lead Data Engineer, Functional Domains

    Lead Data Engineer, Functional Domains

    Travelers InsuranceSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Taking care of our customers, our communities and each other.By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 16...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    LeidosMinneapolis, MN, United States
    serp_jobs.job_card.full_time
    Looking for an opportunity to make an impact?.Powered by a team as diverse as it is talented, we're driven by a shared passion for delivering bold solutions that fuel our customers' success.We beli...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer - DBT / Snowflake

    Data Engineer - DBT / Snowflake

    Tekfortune IncEdina, MN, United States
    serp_jobs.job_card.permanent +1
    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries.In this quickly ch...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer II, Strategic Ingestion Product

    Data Engineer II, Strategic Ingestion Product

    Travelers InsuranceSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Taking care of our customers, our communities and each other.By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 16...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer I, AbInitio / AWS / DevOps

    Data Engineer I, AbInitio / AWS / DevOps

    Travelers InsuranceSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Taking care of our customers, our communities and each other.By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 16...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    UnitedHealth GroupMinnetonka, MN, United States
    serp_jobs.job_card.full_time
    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Data Engineer (Analytics)

    Data Engineer (Analytics)

    Meta IncSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Meta), formerly known as Facebook Inc.When Facebook launched in 2004, it changed the way people connect.Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    GravieMinneapolis, MN, United States
    serp_jobs.job_card.full_time
    Our mission is to improve the way people purchase and access healthcare through innovative, consumer-centric health benefit solutions that people can actually use. Our industry-changing products and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    SHI GmbHSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Since 1989, SHI International Corp.We've grown every year since, and today we're proud to be a $15 billion global provider of IT solutions and services. Over 17,000 organizations worldwide rely on S...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer II, Enterprise Analytics

    Data Engineer II, Enterprise Analytics

    Travelers InsuranceSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Taking care of our customers, our communities and each other.By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 16...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Data Engineer

    Data Engineer

    Meta IncSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Meta), formerly known as Facebook Inc.When Facebook launched in 2004, it changed the way people connect.Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer Developer

    Data Engineer Developer

    Simplicity Group HoldingsMinneapolis, MN, United States
    serp_jobs.job_card.full_time
    Simplicity Summit Office; 86 Summit Ave, Summit, NJ 07901; In-office.As a data engineer / developer, you will be responsible for designing, building, and maintaining scalable data pipelines and infra...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer I (AWS, Python)

    Data Engineer I (AWS, Python)

    Travelers InsuranceSt Paul, MN, United States
    serp_jobs.job_card.full_time
    Taking care of our customers, our communities and each other.By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 16...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day