Hadoop Framework Developer - Data Quality

E-Solutions
Chicago, Illinois, United States
Permanent
Temporary
Full-time
Part-time

Title : Hadoop Framework Developer - Data Quality

Location : Chicago, IL

Job description :

  • Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. You will play a crucial role in ensuring the accuracy, consistency, and reliability of large-scale data across our organization.
  • Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.
  • Implementing automated data quality checks and validations to ensure data integrity throughout the ETL processes.
  • Optimizing Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.

Basic Qualifications :

  • A minimum of 3 years of experience with Hadoop Framework
  • A minimum of 3 years of experience with ETL Processing
  • A minimum of 3 years of experience with Spark
  • Associate's Degree

Preferred Qualifications :

  • Experience with Python
  • Experience with Data
  • Experience with Hive

Disclaimer : E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation,gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws.

We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO / AA / M / F / Vet / Disability.

30+ days ago
Related jobs
Promoted
Accenture
Chicago, Illinois

Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark. Implementing automated data quality checks and validations to ensure da...

E-Solutions
Chicago, Illinois

Title: Hadoop Framework Developer - Data Quality. Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark. Implementing automate...

Promoted
Capital One
Chicago, Illinois

Illinois (Hybrid On-Site): $187,700 - $214,200 for Manager, Lead Software Engineer; $187,700 - $214,200 for Lead Software EngineerCandidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candida...

Promoted
VirtualVocations
Chicago, Illinois

A company is looking for a PL SQL Developer to work remotely in the USA. ...

Promoted
Selby Jennings
Chicago, Illinois

Experience in developing data quality control processes to detect and address data gaps or inaccuracies. Experience in leveraging and building cloud-native technologies for scalable data processing. Data Formats and Serialization:. Experience with multiple data formats and serialization systems like...

Promoted
Tata Consultancy Services
Chicago, Illinois

Role: Oracle PL/SQL, Informatica Developer. Informatica, Oracle SQL, PL/SQL Unix Skills. Hands on coding experience in Oracle PL/SQL, Informatica and performance tuning of SQL queries. ...

Promoted
DV Trading
Chicago, Illinois

Troubleshoot discrepancies in P&L data by collaborating with traders, middle office, accounting, risk teams, technology, and external data vendors. Data Science, Quantitative Finance, Mathematics, or Engineering) is preferred. Proficiency in SQL for database management and data querying. Work cl...

Promoted
Swoon
Chicago, Illinois

Swoon is actively seeking a ETL Data Engineer/Developer to join the team!. Responsible for formulating system scope and objectives, gather requirements, convert business requirements into technical requirements based on the architecture and ETL guidelines. ...

Promoted
Alert IT Solutions
Chicago, Illinois

A Senior SQL Report Developer is responsible to participate in the analysis, build, and test of software components for data migration solutions. Responsible for developing SQL databases and writing applications to interface with SQL databases. It would be particularly beneficial for a Senior SQL Re...

Promoted
Randstad Digital
Chicago, Illinois

Expertise in full-stack development with Python; experience with Quartz is a plus. ...