Lead Data Engineer

eTeam
Remote, TX
$68-$72 an hour
Remote
Full-time

Cloud Data Engineer with min years’ experience in designing , building, and optimizing data pipelines.

Experience with Google Cloud Composer, DataFlow, DataProc clusters, Apache beam, Hadoop, BigQuery.

Experience in process automation and application development using Java, Python, Unix and PL / SQL.

Hands-on experience with Database CDC ingestion and streaming ingestion applications like Striim, Nifi is a plus.

Experience in Agile software development lifecycle disciplines including Analysis, Design, Coding and Testing.

Experience in Big Data and creating high performance / low-latency pipelines using Hadoop, PySpark, Apache beam

30+ days ago
Related jobs
Promoted
Hispanic Technology Executive Council
Irving, Texas

In-depth understanding in Big Data technologies such as RDD, Data frames, dataset within Hadoop, Spark framework (Spark API) and distributed databases such as MongoDB and Cassandra. The Data Engineer Team Lead Java Senior Vice President is a senior management level position responsible for accomplis...

Promoted
VirtualVocations
Irving, Texas

A company is looking for a Lead Software Engineer in Data Management. ...

Promoted
DallasNews Corporation
Dallas, Texas

Ability to lead and mentor a team of data analysts and engineers. The Dallas Morning News is seeking a Data Analytics Engineer to join our team. In this role, you will use your expertise in data analysis tools and techniques to collect, clean, and interpret data, extracting valuable insights to info...

Promoted
VirtualVocations
Garland, Texas

A company is looking for a Lead Data Analytics Engineer. ...

DTCC
Dallas, Texas

Looking for a strong data engineer with hands-on experience in developing large scale Data engineering pipelines for financial services and preferably for risk management. Data warehouse ETL Data Engineer – Snowflake and Python:. Minimum 4 years of experience in developing complex data pipelines loa...

Lorven Technologies
Dallas, Texas

Job Title: Lead Data Engineer. Knowledge with Data Warehouse Architecture to build and articulate conceptual, logical, and physical dimensional data models, and Star Schema artifacts. Designing, constructing, installing, testing, and maintaining highly scalable data management systems. Works with pr...

eTeam
Dallas, Texas
Remote

Cloud Data Engineer with min years’ experience in designing , building, and optimizing data pipelines. Experience with Google Cloud Composer, DataFlow, DataProc clusters, Apache beam, Hadoop, BigQuery. Hands-on experience with Database CDC ingestion and streaming ingestion applications like Striim, ...

Prudential Financial
TX, US

As a Lead Software Engineer on/in Data Management & Governance you will partner with product owners, tech leads, designers, engineers and delivery professionals to improve Data Management and Governance services. Experience in building scalable and stronger data pipelines to support data integra...

INSPYR Solutions
Dallas, Texas

Job Description: The Lead Data Engineer is the senior software engineer in the Business Intelligence and Data Warehousing team. This role requires + years of engineering experience including work on Azure Data Factory and Informatica Power Center / IICS. Scope the data engineering roadmap and delive...

OscarMike
Irving, Texas
Remote

We are looking for a Lead Data Engineer to join our Data Engineering team. In this role, you will lead a team of Data Engineers in designing and building scalable data pipelines and systems. The candidate should possess intellectual acumen, with an engineering mindset and an interest in developing e...