Search jobs > Raleigh, NC > Technical specialist

Technical Specialist (Databricks notebook code, , data warehouses, data lakes, Spark, Azure)

MVP Consulting
Raleigh, NC, United States
Full-time

NCDOT-(phone number removed)

NCDIT-Transportation Web Systems Team seeks an Azure Databricks Engineer who will work with existing staff to plan and design ETL pipelines and product solutions using Azure Databricks.

REQUIRED / DESIRED SKILLS

Skills

Required /

Desired

Experience

Excellent interpersonal skills as well as written and communication skills.

Required

5 Years

Able to write clean, easy-to-follow Databricks notebook code

Required

2 Years

Deep knowledge of data engineering best practices, data warehouses, data lakes, and the Delta Lake architecture

Required

2 Years

Good knowledge of Spark and Databricks SQL / PySpark

Required

2 Years

Technical experience with Azure Databricks and cloud providers like AWS, Google Cloud, or Azure

Required

2 Years

In-depth knowledge of OLTP and OLAP systems, Apache Spark, and streaming products like Azure Service Bus

Required

2 Years

Good practical experience with Databricks Delta Live Tables

Required

2 Years

Knowledge of object-oriented languages like C#, Java, or Python

Desired

7 Years

3 days ago
Related jobs
Promoted
Infosys Limited
Raleigh, North Carolina

At least 3 years of hands-on experience in using Azure Data Factory (ADF) to orchestrate data ingestion from various sources into Azure Synapse and Azure Data Lake Storage (ADLS). At least 2 years of experience designing and implementing data pipelines using Azure Databricks for data cleaning, trans...

Promoted
Oak Ridge Associated Universities
Durham, North Carolina

Data processing of NTA data requires manipulation of high dimensionality datasets and reference to a wide range of reference information to confirm chemical identifications, and application of NTA measurements requires further usage of database information and model predictions to put measurements i...

Promoted
VirtualVocations
Durham, North Carolina

A company is looking for a Renewals Data Specialist to coordinate renewal opportunities and manage vendor contract lifecycles. ...

Promoted
Accenture
Raleigh, North Carolina

Document Marketing Cloud data modeling and architecture including data extension modeling and cross-product data architecture & mapping. We're building the most resourceful team on the planet, and helping our people with new skills, training, and support to get over 4,200 certifications includin...

Promoted
VirtualVocations
Durham, North Carolina

A company is looking for a Senior Technical Data Analyst to drive business insights through data management and platform synchronization. ...

ITL USA
Raleigh, North Carolina

At least 2 years of experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Azure Synapse AnalyticsHands on experience in end-to-end implementation of data warehouse and data martsExperience in writing SQL queries to analysis Ty...

Promoted
VirtualVocations
Durham, North Carolina

A company is looking for a Project Manager & Data Management Specialist to drive the success of various initiatives and ensure data integrity. ...

Mediabistro
Raleigh, North Carolina

Candidates are required to currently live in or near Raleigh, NC.The position will be responsible for developing dashboards and reports for School Business Services as well as operational areas within the department5 years of experience and Background with BI tools and systems such as Power BI, Tabl...

Truist
Raleigh, North Carolina

Provide subject matter expertise in the planning and execution of cloud program and data management activities such as data aggregation, cleansing, cloud program and data management, data quality, data privacy or records management. At least 3 years of experience driving enterprise data strategy, da...

Wolters Kluwer DXG U.S., Inc.
Remote, NC, USA
Remote

The data engineer will review the existing solution and design a unified solution to transfer the data to data lake and data warehouse. Azure data lake, Azure SQL DB, Azure DW/Synapse). Design and develop highly optimized and reliable enterprise level data pipelines to move data to data warehouse in...