Senior ETL Hadoop Developer

Description :

Position requires resource to work with business team to understand data requirements and work with source systems. Requires extracting data from source systems and loading into Hadoop (Spark). Requires investing and resolving data and system issues, provide support.

Proven experience in designing and building data lake on Hadoop using latest technologies. Experience in building integration layer to integrate data from multiple systems to Hadoop. Experience in architecture and solution design of analytics on Hadoop. Experience in building pipeline to ingest data into Hadoop. Working experience in dealing with data in multiple formats (csv, txt, xml, JSON). 10 Years of experience in building DW / ETL applications. 5+ Years of experience in working with Hadoop ecosystem. Working experience with Hive, Spark, Python, Hadoop libraries. Experience in building data lake in Hadoop is must. Experience in building ETL and data aggregations. Experience with sqoop / flumes / spark is required. Excellent SQL knowledge is required. Experience in working in extracting data from RDBMS, SAS applications using APIs.

Must have skills

• 10+ yrs experience in building DW / ETL applications
• 5+ yrs experience in working with Hadoop ecosystem
• Knowledge of Hive, Spark, Python, Hadoop libraries
• Experience building data lake in Hadoop
• Experience with sqoop, flumes, spark
• Excellent SQL knowledge

Nice to have skills

Roles and responsibilities

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues.

BLOCKCHAIN TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M / F / D / V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship / immigration status, veteran status or any other protected status. BLOCKCHAIN TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will BLOCKCHAIN TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

J-18808-Ljbffr