Lead Data Bricks Engineer

Themesoft Inc.
Rahway, NJ, United States
Full-time

Position : Lead Data Bricks Engineer

Location : Rahway, NJ

Job Description :

TechStack (Must Have) :

  • AWS, Confluent Kafka Streaming, Pyspark, Delta Lake
  • Databricks(Medallion Architecture, DeltaLiveTables (DLT) with serverless, CDC(SCD Type 1 and Type2),Autoloader, Materialized Views, Unity Catalog, Workflows, DBT basic knowledge)
  • Autoloader - streaming experience
  • DevOps - CI / CD, Jenkins
  • Automation Guidance and service-based offering for the stream processing part

TechStack (Good to Have) :

  • Data Bricks Certified Data engineer professional
  • AWS Knowledge (Athena, EC2, S3)
  • Trino SQL query engine
  • PowerBi

Regards

Patrick Fernandez

Talent Acquisition Group - Strategic Recruitment Manager

2 days ago
Related jobs
Promoted
JPMorganChase
Jersey City, New Jersey

A motivated individual with a strong background in data platforms, ETL pipeline setup and analysis, you will lead the data catalog initiatives to establish and maintain a cohesive and effective data cataloging system, integral to the broader data governance strategy and objectives. As a Lead Softwar...

Promoted
Rad Hires
Hoboken, New Jersey

As a member of the Data Strategy group, the Senior Software Engineer will work with fellow data and web engineers, data scientists, product managers, business analysts, and stakeholders from other internal groups to design and improve data-centric projects with the dual mandate of (1) increasing the...

Promoted
Automatic Data Processing, Inc.
Roseland, New Jersey

Lead Engineers at ADP are expected to be results-oriented, learn new and legacy technologies, have knowledge of the relevant platforms and environments, and be familiar with business processes, functions and data to provide innovative, insightful, and secure solutions. ADP is hiring a Lead System Re...

HireTalent
Newark, New Jersey

Manager (Data Engineering Lead, Data Team) - Engineering lead to help the design/build of the CDO enterprise data projects. Lead Data Engineer VMS Prudential. Migrate data from traditional relational database systems to AWS relational databases such as Amazon RDS, Aurora, and Redshift. Migrate data ...

E-Solutions
Edison, New Jersey

Key Skills: Strong Data Background, Azure Databricks, Azure Data Factory, Synapse, Power BI , Fabric (Good to have). Lead / Sr Data EngineerLocation: Edison & Montvale, NJ (Hybrid- Should be ready to work from both client locations) Full Time. Databricks technology (Experience with Unity Catalog is ...

JPMorgan Chase & Co.
Jersey City, New Jersey

Worked with building Data lake, built Data platforms, built Data frameworks, Built/Design of Data as a Service AP. As a Data Engineer at JPMorgan Chase within the Consumer and Community Banking in the Connected Commerce Technology Team, your role involves being a seasoned member of an agile team, ta...

Yoh, A Day & Zimmermann Company
Woodbridge Township, New Jersey

Data Group 65-70 resources including Data Engineers, Data Analysts, BA’s, QA, Scrum Masters, etc broken out into 6 teams Do NOT use ETL tools, utilize Data Vault 2. Sr/Lead Data Engineer (Python/Spark/Jupyter Notebooks/Delta Lake/Data Vault 2. Client has built a modern data platform and needs senior...

TrekRecruit LLC
Jersey City, New Jersey

Job Title: Data Engineer<br /> Location:Jersey City, NJ<br /> Hybrid role- Twice in a week</div> <div> </div> <div> </div> <div><u><b>Job Description :</b></u></div> <ul> <li>Design and implement data storage...

JPMorgan Chase & Co.
Jersey City, New Jersey

As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector, AI/ML Data Platforms Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading and cutting edge technology products in a secure, stable, and scalable way. Collabor...

Emonics LLC
New Jersey, United States

Hands-on experience with Snowflake, Databricks tools. Please get rating on how many years the candidates have hands one experience on Python coding, SQL and Databricks. Design, build, and maintain end-to-end database solutions. Write complex SQL queries for data extraction and analysis. ...