Data Engineer

Chelsoft Solutions Co
Any, USA
Full-time

Location

REMOTE

Required Skills

4 years of enterprise data warehouse development withSQL Python Azure Data Factory (ADF) Azure Databricks Kafka andideally Snowflake experience

Additional Skills

Job Description

Looking for a DataEngineer with SQL Python ADF Databricks Kafka and ideally Snowflakeexperience to work 100% remote.

  • DataEngineer to develop CI / D data pipelines and ETL processes to curateand transform pharmacy data from different sources (both on premiseand cloud).
  • Build large scale databases thatare robust and secure to be stored in a data lake or datawarehouse.
  • Automate data workflows andprocesses including ingestion cleaning structuring formatting ofdata.
  • Build engineering solutions that supportML / data science projects.
  • Collaborate withData Scientists and business partners to deploy machine learningmodels in production (preferred).
  • Extensivelywork on different kinds of datasets including text voice imagesunstructured structured.

Requirements :

  • 46 years of enterprise data warehouse developmentpreferably on SQL or Snowflake
  • 46 years ofexperience creating enhancing and maintaining ETL frameworks usingETL tools.
  • Handson experience with SQL PL / SQLPython and / or Shell Scripting is a must.
  • Experience migrating from RDBMS to Snowflake is aplus.
  • Endtoend dataflow design and developmentexperience is a plus.
  • Handson experience withAzure Cloud including Azure Data Factory and Databricks.
  • Kafka experience to setup / attach toDatabricks.
  • 30+ days ago
Related jobs
Wolters Kluwer DXG U.S., Inc.
Remote, KS, USA
Remote

The data engineer will review the existing solution and design a unified solution to transfer the data to data lake and data warehouse. Design and develop highly optimized and reliable enterprise level data pipelines to move data to data warehouse in real-time. Participate, collaborate and lead team...

Saransh Inc
Anthony, Kansas

Job Title: Lead Big DataEngineer. Mandatory skills: Big Data with Databricks Spark PySparkSQL. Skills andJD: Spark PySpark AWS Big Data Python SQL. Strong technicalexpertise in SQL Python Spark PySpark and Databricks. ...

CVS Health
Work from home, KS, US
Remote

We are seeking a highly skilled and motivated individual to join our team as a Big Data Cloud-Based Vulnerability Management Data Analytics Developer. This is an exciting opportunity to work on cutting-edge technology and contribute to our mission of safeguarding critical data and infrastructure. Th...

Tekshapers Inc
Anthony, Kansas

Strong Python development experience with Python Pandas NumPyPyspark .Strong knowledge on AWS services suchas (S3 RDS EC2 Lambda SQS SNS Redshift).Tekshapers is anequal opportunity employer and will consider all applicationswithout regard to race sex age color religion national originveteran status ...

Chelsoft Solutions Co
Anthony, Kansas

DataEngineer to develop CI/D data pipelines and ETL processes to curateand transform pharmacy data from different sources (both on premiseand cloud). Looking for a DataEngineer with SQL Python ADF Databricks Kafka and ideally Snowflakeexperience to work 100% remote. Build large scale databases thata...

Home Depot
KANSAS, US
Remote

The Staff Software Engineer is responsible for leading a team of engineers building and designing a product that our customers and associates love. As a Staff Software Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical an...

Textron
KS, United States

Performs data analysis via various data-mining and statistical techniques to gain insights from data to support business objectives. Work to improve data quality within TAPD by assisting Data Governance efforts in creating and maintaining data quality standards. Internship - Data Analyst, Parts. Col...

IDEXX
US, KS, Virtual

Our team includes a range of data engineers, data architects, and data-centric business system analysts, focusing heavily on cloud-based "big data" projects. Understand business requirements and translate them into conceptual, logical, and physical modelsArticulate and define architectural patterns ...

LexisNexis Risk Solutions Inc. Company
Kansas
Remote

Software Engineering experience. We are seeking a talented and experienced Senior NLP Engineer with a minimum of 6 years of industry experience, coupled with proficiency in Java development. BS Engineering/Computer Science or equivalent experience required. ...

V R Della Infotech Inc
Anthony, Kansas

Role Mainframe Production Control Analyst. The Production Control Analyst willcontribute to the support of the NJ MMIS Project and upcoming newinitiatives in an IBM zOS mainframe environment over multipleLPARs. Workclosely with Programmers and Business Analysts to solve issuescomplete projects and d...