Azure Data Engineer

Tata Consultancy Services
Portage, MI
Full-time
  • Good Knowledge of Data Brick lakehouse and Azure DataLake concept
  • Knowledge of Data Bricks delta concept Delta live tables (DLT)
  • Strong hands-on experience in ELT pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
  • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
  • Experience with data transformation using Spark, and SQL technologies.
  • Solid understanding of design patterns, and best practices of the cloud stack.
  • Experience with code management and version control using Git or similar tools.
  • Strong problem-solving and debugging skills in ETL workflows and data pipelines.
  • Strong understanding of Azure Data bricks and Azure Synapse internals features and capabilities.
  • Knowledge of Azure DevOps and continuous integration and deployment (CI / CD) process.
  • Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing.
  • 30+ days ago
Related jobs
Tata Consultancy Services
Portage, Michigan

Strong hands-on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task. In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool. Knowl...

Promoted
Level Data LLC
Kalamazoo, Michigan

We are seeking an experienced Senior Software Engineer to design, develop, and maintain Talent Management software solutions. This role requires a deep understanding of software engineering principles, exceptional problem-solving skills, and the ability to work effectively in a collaborative team en...

Sedgwick
Remote, Michigan, US

To manage a staff of data analysts; to develop complex reports and analyze company data including Corporate or client specific data; to serve as a technical resource for company staff on data analysis and benchmarking issues; to meet with clients on such issues as necessary; to provide training and ...

Splunk Inc
Michigan, United States
Remote

Splunk's Cloud group is looking for an experienced Cloud Software Engineer to join teams that are responsible for providing and maintaining an automated platform that enables internal and external customers to easily manage and modify Splunk Enterprise Cloud (SEC) environments. This is a fantastic o...

Highmark Health
MI, Working at Home, Michigan

This job is an integral member of an agile software engineer team responsible for building scalable software applications across all digital channels to serve our customers. Knowledge of professional software engineering practices & best practices for the full software development life cycle, includ...

Talent Sphere Staffing
, Michigan, ,
Remote

A Data Entry Specialist will compare data with source documents submitted by our members, checking for accuracy and that supporting documentation meets specified requirements. We are looking for a Data Entry Specialist whose main function is providing excellent customer service by quickly and accura...

Charles River Laboratories, Inc.
Mattawan, Michigan

Accurately identify and effectively communicates any issues with data. Independently compile and archive data books and departmental records. Review and issue data sets in adherence to established timelines. Accurately review departmental and study specific data to ensure adherence to SOPs, methods/...

Home Depot
MICHIGAN, US
Remote

Software Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical and leadership skills while creating, deploying, and supporting production applications. Software Engineers may be involved in product and tool selection, config...

Stryker Employment Company, LLC
Portage, Michigan

As the Material Data Management Analyst, you will act as an SAP Power User in the Master Data Governance (MDG) application and will drive data governance, data ownership, and data quality by working with teams in Engineering, Sales, Quality, Manufacturing, and IT. Manage data requests in support of ...

New York Community Bank
Nationwide, Michigan, United States of America

The Liquidity Data Quality Analyst reports to the Director of Data Quality & Analysis and is responsible for the analysis and implementation of FR2052a definitions including operational deposits, transactional accounts, and established relationships. This analyst may also interact with regulators re...