Hadoop Framework Developer - Data Quality

E-Solutions
Chicago, Illinois, United States
Permanent
Temporary
Full-time
Part-time

Title : Hadoop Framework Developer - Data Quality

Location : Chicago, IL

Job description :

  • Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. You will play a crucial role in ensuring the accuracy, consistency, and reliability of large-scale data across our organization.
  • Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.
  • Implementing automated data quality checks and validations to ensure data integrity throughout the ETL processes.
  • Optimizing Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.

Basic Qualifications :

  • A minimum of 3 years of experience with Hadoop Framework
  • A minimum of 3 years of experience with ETL Processing
  • A minimum of 3 years of experience with Spark
  • Associate's Degree

Preferred Qualifications :

  • Experience with Python
  • Experience with Data
  • Experience with Hive

Disclaimer : E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation,gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws.

We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO / AA / M / F / Vet / Disability.

30+ days ago
Related jobs
Promoted
Accenture
Chicago, Illinois

Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark. Implementing automated data quality checks and validations to ensure da...

E-Solutions
Chicago, Illinois

Title: Hadoop Framework Developer - Data Quality. Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark. Implementing automate...

Promoted
VirtualVocations
Chicago, Illinois

A company is looking for a Healthcare SQL Developer - Oracle to develop complex data sources and pipelines. ...

Promoted
Virtualan Software, LLC
Chicago, Illinois

We are seeking a Full Stack Developer responsible for the analysis, design and development of scalable software solutions across the full secure software development life cycle – from conception to deployment. Role: Full Stack Java Developer. Knowledge of full secure software development lifec...

Promoted
Canonical - Jobs
Chicago, Illinois

Canonical seeks an experienced developer with a proven track record in Python and/or Go. You are a skilled Python developer, preferably with a track record in open source. ...

Promoted
Alert IT Solutions
Chicago, Illinois

A Senior SQL Report Developer is responsible to participate in the analysis, build, and test of software components for data migration solutions. Responsible for developing SQL databases and writing applications to interface with SQL databases. It would be particularly beneficial for a Senior SQL Re...

Promoted
Paul Murphy Associates
Chicago, Illinois

As a Database Developer, you will design and implement database models and scripts that support commission payout processes. Your expertise in SQL Server and database modeling will be crucial in ensuring accurate and efficient calculations. Develop, test, and maintain complex SQL queries and scripts...

Promoted
Deluxe Corporation
Chicago, Illinois

The Senior Software Developer role is to define, develop, test, analyze, and maintain software applications in support of the achievement of business requirements. The Software Developer IV will also research, design, document, and modify software specifications throughout the production life cycle....

Promoted
Technogen International Company
Chicago, Illinois

Builds ETL components according to ETL specifications. Read and understand business requirements, write functional requirements, develop detailed technical designs, and build / unit / system test ETL code. ETL product (SSIS, Ab Initio, etc) in a development role (administrative knowledge a plus). ...

Promoted
Accenture
Chicago, Illinois

We are seeking a highly skilled Python Developer with a strong technical background and some experience in the financial services (FS) sector. Strong technical background with a focus on Python development (Python 3. The ideal candidate should have a solid foundation in engineering and be proficient...