Title : Hadoop Framework Developer - Data Quality
Location : Chicago, IL
Job description :
- Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. You will play a crucial role in ensuring the accuracy, consistency, and reliability of large-scale data across our organization.
- Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.
- Implementing automated data quality checks and validations to ensure data integrity throughout the ETL processes.
- Optimizing Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.
Basic Qualifications :
- A minimum of 3 years of experience with Hadoop Framework
- A minimum of 3 years of experience with ETL Processing
- A minimum of 3 years of experience with Spark
- Associate's Degree
Preferred Qualifications :
- Experience with Python
- Experience with Data
- Experience with Hive
Disclaimer : E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation,gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws.
We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO / AA / M / F / Vet / Disability.
30+ days ago