Azure Data Engineer Only W2

Job Title : Azure Data Engineer

Location NYC - 3 days Onsite

Duration : 6 months

Additional Details : Data Engineering

Data Engineering

Hands-on position

Hit the ground running

Should be able to start building very quick Experience in Financial or Banking Industry Engineer to build out data plans on Azure Cloud Agile Team Understand the business requirements Cross Functional stakeholder view Work with compliance and security team Capturing Marsh side of the business Collecting revenue data for brokers Build a very flexible data capture system BAU functionality

15 people aligned within the team

What are the applications to be supported? Azure Python

Soft Skill requirements (team fit / personality requirements) :

Trustworthy

Team player (Cross Functional)

Here is the job requirement for a Data Engineer position with expertise in Python ETL and Azure experience. We are seeking a highly skilled and motivated individual who can contribute to our team and help drive our data engineering initiatives.

Job Requirements

1. Python ETL : The ideal candidate should have strong proficiency in Python programming language and experience in Extract, Transform, Load (ETL) processes.

They should be able to design and develop efficient ETL workflows to extract data from various sources, transform it as per business requirements, and load it into target systems.

2. Azure Experience : The candidate should have hands-on experience working with Microsoft Azure cloud platform. They should be familiar with Azure services and tools, and have a good understanding of Azure architecture and best practices.

3. Azure Data Factory, DataBricks, Azure Storage, and Azure VM : The candidate should have practical experience with Azure Data Factory, DataBricks, Azure Storage, and Azure Virtual Machines.

They should be able to design and implement data pipelines using Azure Data Factory, perform data transformations and analytics using DataBricks, and manage data storage and virtual machines in Azure.

4. Data Governance, Data Quality, and Controls : The candidate should have a strong understanding of data governance principles, data quality management, and data controls.

They should be able to implement data governance frameworks, establish data quality standards, and ensure compliance with data regulations and policies.

5. Implementing alerts and notifications for batch jobs : The candidate should have experience in setting up alerts and notifications for batch jobs.

They should be able to configure monitoring and alerting mechanisms to ensure timely identification and resolution of issues in batch job execution.

Here are a few other notes I got from the call, but this JD is very detailed as it relates to what they're looking for.

• Underlying work is helping migrate current pipeline from the server into Azure Data factory.
• 1166 avenue of the Americas (NYC location)
• ETL and Azure Data Factory pipelines
• Their goal is to use AI techniques to solve problems. 15 people in this team. Roy is 1st consultant hired for this project.

A data scientist req will also be coming out for this team. Hiring in the US and Mexico, but most people are in US.

• Python is VERY important for this
• A lot of these pipelines on the team are generated through AI as code.
• Reporting into Martin, but a very flat team - don't really care who they report to.
4 days ago