Role : Big Data Engineer
Location : NYC(Onsite)
Experience Level : 10+ years
Note : Only on W2
Job Description :
ETL Pipelines using python from scratch ability to independently write efficient and reusable code for ETL Pipelines Expert pipelines expert in OOP Principles and concepts Expert in Data modelling Concepts such as Schemas and entity relationships Expert at Analysing and developing quires in SQL in Various dialects (SQL Server, DB2, Oracle) familiarity with Airflow understands how to develop DAGs Expert in Data ware houses Big Query Data Bricks Delta Lake house and how to programmatically ingest, Cleanse govern and report data out of the familiarity with spark is a plus.
Big Data Engineer • NY, United States