Senior Data Engineer (MS SQL, T-SQL, SSIS, Snowflake, Python)

HexaQuEST Global
NYC, NY
Full-time

Job Description

Must have hands-on :

experience in SQL Server as it involves replicating functionality in Snowflake.

SSIS strongly preferred

Python

DBT, Mulesoft, Alation good to have

Primary Responsibilities :

Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.

Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel;

Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.

Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.

Need to have working knowledge of MS Azure configuration items with respect to Snowflake.

Developing EL pipelines in and out of data warehouse using combination of Data bricks, Python and Snow SQL.

Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.

Provide production support for Data Warehouse issues such data load problems, transformation translation problems

Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.

Understanding data pipelines and modern ways of automating data pipeline using cloud based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.

Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Basic Qualifications :

Minimum 7 years of designing and implementing an operational production grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.

Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL

Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies

Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.

30+ days ago
Related jobs
Promoted
Capital One
New York, New York

Utilize programming languages like JavaScript, Java, HTML/CSS, TypeScript, SQL, Python, and Go, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services . Senior Software Engineer, Full Stack (Java, Python). Do y...

Promoted
EMW Staffing Solutions LLC
New York, New York
Remote

Data Engineers analyze and develop on-premises and/or cloud data and ETL solutions to solve the client’s challenges. Develop data models to meet client needs, including transactional, third-normal form, dimensional, columnar, distributed and NoSQL. Data migrations and conversions to the cloud and to...

Promoted
Capital One
New York, New York
Remote

Senior Distinguished Engineer (Enterprise data storage and consumption platforms) (Remote-Eligible). Distinguished Engineer - Enterprise data storage and consumption platforms. Experience with modern data platform strategies (Data Mesh, Data Fabric). We are the  Data Storage, & Consumption platform ...

Promoted
Fetch..
New York, New York

Experience must include Data modeling & database design; MicroSoft SQL Server; SQL Server Reporting Services; ETL/ELT processes with Talend; Reqs gathering, design, development & testing & support of data warehousing & legacy applications. Implement data ingestion routines to curate data from intern...

Capital One
New York, New York
Remote

Center 3 (19075), United States of America, McLean, VirginiaSenior Distinguished Engineer (Enterprise data storage and consumption platforms) (Remote-Eligible). Distinguished Engineer - Enterprise data storage and consumption platforms. Experience with modern data platform strategies (Data Mesh, Dat...

HexaQuEST Global
New York, New York

Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures. Strong understanding or Snowflake on Azure Architecture, design, implementation and operation...

Capital One
New York, New York

Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake. West 19th Street (22008), United States of America, New York, New YorkSenior Data Engineer. As a Data Engineer on Apollo Core, yo...

Intone Networks
New York, New York

Position: Senior AWS Data Engineer Location: Remote Long Term Must Skill: - Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities - Design and develop data applications using big data technologies (AWS, Spark) to inge...

ActionIQ
New York, New York
Remote

ActionIQ is a new kind of customer data platform that lets marketing teams tap directly into central data sources and activate it anywhere in the customer journey. Experience in analyzing, diagnosing, and problem-solving with large-scale distributed systems/data and cloud-based platforms. Experience...

Goldman Sachs
New York, New York

Our engineering teams build scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. In-depth knowledge of relational and columnar SQL d...