Job Summary : We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team.
The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.
Key Responsibilities :
- Design, implement, and manage data pipelines using AWS services, particularly Amazon EMR.
- Optimize EMR cluster configuration for performance and cost efficiency.
- Develop ETL processes to extract, transform, and load data from various sources into data lakes or warehouses.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
- Monitor and troubleshoot EMR clusters to ensure high availability and reliability.
- Implement data governance and security best practices.
- Create and maintain documentation for data engineering processes, workflows, and systems.
- Stay updated with the latest AWS technologies and best practices in data engineering.
Qualifications :
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer, with a focus on AWS and EMR.
- Strong knowledge of AWS services (S3, Redshift, Glue, Lambda, etc.).
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with big data technologies (Hadoop, Spark, etc.).
- Familiarity with SQL and NoSQL databases.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills and the ability to work collaboratively in a team environment.
Preferred Qualifications :
- AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect).
- Experience with data visualization tools (Tableau, Power BI, etc.).
- Knowledge of data warehousing concepts and architectures.
AWS Data Engineer (EMR Clusters)
We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. Proven experience as a Data Engineer, with a focus on AWS and EMR. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technol...
AWS Data Engineer with EMR clusters
AWS EMR Clusters: Configure, manage, and optimize Amazon EMR clusters for big data processing using Apache Spark, Hive, or Presto. AWS Data Engineer with EMR clusters Piscataway, NJ 12 months Visa: Any visa independent. Data Pipeline Development: Design and implement robust ETL processes to extrac...
AWS Data Engineer with EMR
Configure, manage, and optimize Amazon EMR clusters for big data processing using Apache Spark, Hive, or Presto. Design and implement robust ETL processes to extract, transform, and load data from various sources into data lakes and warehouses. Develop and maintain CI/CD pipelines for automated depl...
AWS Data engineer
Required Skills & Experience: AWS (the dataset from the Cloud Engineer and Snowflake data lake), Snowflake, SQL, Python and PowerBI Responsibilities: They will be designing, developing, and deploying a portfolio of Data & Analytics technology assets and platforms leveraging cloud-based tools...
AWS Data Engineer
...
Sr. AWS Data Engineer
Senior Data Engineering ETL Developer who will be responsible for designing and implementing robust ETL pipelines, integrating AWS services such as Redshift and S3, and developing telemetry dashboards that provide insightful analytics on developer activities. Integrate various data sources into AWS ...
Senior Database/Data Warehouse Engineer - Oracle/AWS/Redshift
Our client, a financial services firm based in NJ is looking for a Senior Level Engineer with solid experience in developing and optimizing cloud database platforms. Optimize database performance through tuning, indexing, and data modeling. Ensure data integrity and security in database design and i...
AWS Data Engineer
The successful candidate will have a strong background in cloud-based data engineering, with mandatory expertise in AWS Glue, Databricks, and Apache Spark. Databricks: Experience with big data analytics and collaborative data engineering. Role: Job Title: AWS Data Engineer. Client is seeking an exp...
AWS DevOps Engineer [EMR Cluster experience is must]
We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. Design, implement, and manage AWS EMR clusters for large-scale data processing tasks. Proven experience with AWS EMR, including configuration and management of EMR clusters. AWS...
Senior Software Engineer (Python, AWS) - Capital One
West Creek 1 (12071), United States of America, Richmond, VirginiaSenior Software Engineer (Python, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capita...