Location
REMOTE
Required Skills
4 years of enterprise data warehouse development withSQL Python Azure Data Factory (ADF) Azure Databricks Kafka andideally Snowflake experience
Additional Skills
Job Description
Looking for a DataEngineer with SQL Python ADF Databricks Kafka and ideally Snowflakeexperience to work 100% remote.
- DataEngineer to develop CI / D data pipelines and ETL processes to curateand transform pharmacy data from different sources (both on premiseand cloud).
- Build large scale databases thatare robust and secure to be stored in a data lake or datawarehouse.
- Automate data workflows andprocesses including ingestion cleaning structuring formatting ofdata.
- Build engineering solutions that supportML / data science projects.
- Collaborate withData Scientists and business partners to deploy machine learningmodels in production (preferred).
- Extensivelywork on different kinds of datasets including text voice imagesunstructured structured.
Requirements :
- 46 years of enterprise data warehouse developmentpreferably on SQL or Snowflake
- 46 years ofexperience creating enhancing and maintaining ETL frameworks usingETL tools.
- Handson experience with SQL PL / SQLPython and / or Shell Scripting is a must.
- Experience migrating from RDBMS to Snowflake is aplus.
- Endtoend dataflow design and developmentexperience is a plus.
- Handson experience withAzure Cloud including Azure Data Factory and Databricks.
- Kafka experience to setup / attach toDatabricks.
Lead Product Software Engineer | Lead Data Engineer | Azure Data Architecture | Solution Architecture
The data engineer will review the existing solution and design a unified solution to transfer the data to data lake and data warehouse. Design and develop highly optimized and reliable enterprise level data pipelines to move data to data warehouse in real-time. Participate, collaborate and lead team...
Lead Big Data Engineer
Job Title: Lead Big DataEngineer. Mandatory skills: Big Data with Databricks Spark PySparkSQL. Skills andJD: Spark PySpark AWS Big Data Python SQL. Strong technicalexpertise in SQL Python Spark PySpark and Databricks. ...
Vulnerability Data Analytics Engineer
We are seeking a highly skilled and motivated individual to join our team as a Big Data Cloud-Based Vulnerability Management Data Analytics Developer. This is an exciting opportunity to work on cutting-edge technology and contribute to our mission of safeguarding critical data and infrastructure. Th...
Data Engineer AWS Python
Strong Python development experience with Python Pandas NumPyPyspark .Strong knowledge on AWS services suchas (S3 RDS EC2 Lambda SQS SNS Redshift).Tekshapers is anequal opportunity employer and will consider all applicationswithout regard to race sex age color religion national originveteran status ...
Data Engineer
DataEngineer to develop CI/D data pipelines and ETL processes to curateand transform pharmacy data from different sources (both on premiseand cloud). Looking for a DataEngineer with SQL Python ADF Databricks Kafka and ideally Snowflakeexperience to work 100% remote. Build large scale databases thata...
Staff Software Engineer (Remote)
The Staff Software Engineer is responsible for leading a team of engineers building and designing a product that our customers and associates love. As a Staff Software Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical an...
2025 Internship - Data Analyst, Parts
Performs data analysis via various data-mining and statistical techniques to gain insights from data to support business objectives. Work to improve data quality within TAPD by assisting Data Governance efforts in creating and maintaining data quality standards. Internship - Data Analyst, Parts. Col...
Principle Data Architect, Data Integration Hub
Our team includes a range of data engineers, data architects, and data-centric business system analysts, focusing heavily on cloud-based "big data" projects. Understand business requirements and translate them into conceptual, logical, and physical modelsArticulate and define architectural patterns ...
Senior NLP Software Engineer I - Java
Software Engineering experience. We are seeking a talented and experienced Senior NLP Engineer with a minimum of 6 years of industry experience, coupled with proficiency in Java development. BS Engineering/Computer Science or equivalent experience required. ...
Professional Data Analyst
Role Mainframe Production Control Analyst. The Production Control Analyst willcontribute to the support of the NJ MMIS Project and upcoming newinitiatives in an IBM zOS mainframe environment over multipleLPARs. Workclosely with Programmers and Business Analysts to solve issuescomplete projects and d...