Big Data engineer

Overview

Specifically, you will be working on projects involving leveraging AI / ML for Data Management Efficiencies & Query Optimizations.

Responsibilities

• Collaborate with cross-functional teams such as Data Scientists, Product Partners and Partner Team Developers to identify opportunities for Big Data, Query (Spark, Hive SQL, BigQuery, SQL) tuning opportunities that can be solved using machine learning and generative AI.
• Write clean, high-performance, high-quality, maintainable code.
• Create backend applications using Python, Docker, Google Cloud & in-house ML frameworks to orchestrate end to end applications.
• Stay abreast of the latest advancements in the field of Generative AI Application Development and actively contribute to the research and development of new Generative AI Applications.
• Deep understanding and experience in tuning Dataproc, BigQuery, and Spark Applications.
• Solid knowledge of software engineering best practices, including version control systems (e.g., Git), code reviews, and testing methodologies.

J-18808-Ljbffr