Search jobs > Phoenix, AZ > Temporary > Lead data engineer

Lead Data Engineer

Insight Global
Phoenix, AZ, United States
Full-time

Position : Lead Data Engineer

Company : A large healthcare company

Location : Hybrid 1-2x a week onsite in N. Scottsdale

Interview Process : 2 rounds

Duration : 2 year long contract

Work authorization : W2

Qualifications :

  • 5-7 years of data engineering experience
  • Capable of leading other data engineers
  • 3+ years of experience with Apache Airflow and / or Composer
  • 3+ years of experience with DataProc and / or Spark
  • 5+ years of experience with CI / CD
  • Experience producing architecture solutions using Composer and Spark
  • Experience in large-scale batch processing with cloud services
  • Ability to collaborate with architects to solve problems and provide data engineering solutions
  • Familiarity with databases and SQL
  • Familiarity with at least one OOP language, Java preferred
  • Familiarity with GCP, GKE, and Cloud IAM
  • Experience working with Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data Stage & Spring Batch

Overview of the role :

A large healthcare company in Phoenix is looking for a Lead Data Engineer to assist them in solutioning architecture as they transform the Rebate Processing System from its legacy platform.

This person will assist their software engineers in rearchitecting, transforming, and designing data pipelines.

3 days ago
Related jobs
Promoted
PetSmart
Phoenix, Arizona

Specific duties include: 1) design, develop, and modify software applications with an emphasis on performance, scalability, and high reliability (DevOps model); 2) code, test, and document new or modified data systems to create robust and scalable applications for data analytics; 3) design enterpris...

Promoted
VirtualVocations
Glendale, Arizona

A company is looking for a Corporate Vice President, Lead Actuarial Data Engineer/Architect. ...

ClifyX
Phoenix, Arizona

BigQuery, Cloud Dataproc, Cloud Storage). ...

Strategic Employment
Phoenix, Arizona

You will be leading a team responsible for creating efficient ETL (Extract, Transform, Load) processes in Azure Data Factory, managing and collaborating with both IT and Business stakeholders to fulfill new data requests and ensure data quality and integrity. A SaaS company which has been in busines...

Wolters Kluwer DXG U.S., Inc.
Tempe, Arizona
Remote

The data engineer will review the existing solution and design a unified solution to transfer the data to data lake and data warehouse. Participate, collaborate and lead team of data engineers. Design and develop highly optimized and reliable enterprise level data pipelines to move data to data ware...

Carvana
Tempe, Arizona

What you should have</strong></p><ul><li>Extensive experience with SQL and at least one programming language such as Python, R, or Scala for data processing tasks</li><li>A solid understanding of data integration concepts, data modeling, business intelligence, dat...

Strategic Employment Partners (SEP)
Phoenix, Arizona

You will be leading a team responsible for creating efficient ETL (Extract, Transform, Load) processes in Azure Data Factory, managing and collaborating with both IT and Business stakeholders to fulfill new data requests and ensure data quality and integrity. A SaaS company which has been in busines...

PetSmart
Phoenix, Arizona

Specific duties include: 1) design, develop, and modify software applications with an emphasis on performance, scalability, and high reliability (DevOps model); 2) code, test, and document new or modified data systems to create robust and scalable applications for data analytics; 3) design enterpris...

Goli Tech
Scottsdale, Arizona

Work location: Hybrid-Scottsdale, AZ (on site 3 or more days per week)</p><p>Level/rate: Senior </p><p>Required skills: 5-7 years of data engineering experience Capable of leading other data engineers 3+ years of experience with Apache Airflow and/or Composer ...

Jobot
Phoenix, Arizona

REMOTE Lead Data Product Engineer / Senior Data Engineer Needed for Growing Subsidiary of a Large Public Company!. Data Engineer writing code to extract, process and store data within different types of data stores (Snowflake, Postgres, DynamoDB, Kafka, Graph databases). We are a growing subsidiary ...