Big Data Engineer (Various Levels)

E-Solutions
phoenix, Arizona, United States
Full-time

Job Title : Big Data Engineer (Java or Python)

Job Location : Phoenix, AZ (Hybrid)

Type : Contract

Job Description :

6+ years of software development experience and leading teams of engineers and scrum teams

3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark) Solid Datawarehousing concepts,Knowledge of Financial reporting ecosystem will be a plus

Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python / Scala,Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive / PySpark-dataframes), optimizing joins while processing huge amount of data Experience in UNIX shell scripting Ability to design and develop optimized Data pipelines for batch and real time data processing.

Should have experience in analysis, design, development, testing, and implementation of system application. Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.

Preferred Qualifications : Knowledge of cloud platforms like GCP / AWS, building Microservices and scalable solutions, will be an advantage,1 + years of experience in designing and building solutions using Kafka streams or queues.

Experience with GitHub / Bitbucket and leveraging CI / CD pipelines ,Experience with NoSQL ., HBase, Couchbase, MongoDB is good to have Excellent technical and analytical aptitude,Good communication skills, Excellent Project management skills. Results driven

19 days ago
Related jobs
Promoted
VirtualVocations
Mesa, Arizona

A company is looking for a Software Engineer (Big Data) for a remote full-time experienced position. Key Responsibilities:Understanding code flow and interaction with componentsAnalyzing incidents, providing resolutions, and participating in status callsBuilding web applications, APIs, and algorithm...

Lorven Technologies
Phoenix, Arizona

Integrate various internal and external data sources (including SharePoint, One Drive, One Note, to create a unified data platform. Demonstrated experience with data engineering and familiarity with graph database management. Integrate various internal and external data sources (including SharePoint...

SRI Tech Solutions Inc
Phoenix, Arizona

Job: Big Data Engineer with GCP Experience Location: Phoenix, AZ (Onsite role with Face to Face Client interview) Duration: Contract Job Description: This role requires a seasoned developer having 9+ years of experience in Big Data, Java. The ideal candidate will be having sound knowledge of...

SharpHeads
Phoenix, Arizona

Job Title: Big Data Engineer<br /> Contract: 6-12 Months<br /> Phoenix, AZ</b><br /> </div> <div><b>OPEN TO C2C - Any VISA</b></div> <div><br /> <b>Description: </b></div> <ol> <li>4+ years of experience...

Purple Drive
Phoenix, Arizona

Expert on Distributed ecosystemHandson experience with programming using Core Java orPython/ScalaExpert on Hadoop and Spark Architecture and its workingprinciple Handson experience on writing and understanding complexSQL(Hive/PySparkdataframes) optimizing joins while processing hugeamount of data Ex...

E-Solutions
Phoenix, Arizona

Hello, Role--Big Data Engineer Location--Phoenix, AZ. Hands-on experience in Big Data technologies (Spark, Hive, MapReduce and Hbase). We are looking for energetic, high-performing and highly skilled Engineers to help shape our technology and product roadmap. Develop maintain large data processing p...

Lorven Technologies
Phoenix, Arizona

Hands-on expertise with application design and software development in Big Data across one or more platforms, languages, and tools. Have had prior experience of architecting data abstraction layers using some NoSQL/in-memory database. Data modeling and data architecture experience will be an advanta...

Purple Drive
Phoenix, Arizona

Expert on Distributed ecosystem Handson experience withprogramming using Core Java or Python/ScalaExpert on Hadoop andSpark Architecture and its working principle Handson experience onwriting and understanding complex SQL(Hive/PySparkdataframes)optimizing joins while processing huge amount of data E...

IntraEdge
Phoenix, Arizona

Supports partners to achieve targeted levels of information security, project oversight and controls. Builds relationships with diverse groups and leads meetings to gather and document data and information to measure and improve the effectiveness of information security activities performed within t...

eTeam
Phoenix, Arizona

This role requires a seasoned developer having + years of experience in Big Data, Java. The ideal candidate will be having sound knowledge of big data ecosystem esp. Spark and handling massive data sets. ...