AWS DevOps Engineer [EMR Cluster experience is must]

Synechron
Piscataway, NJ, United States
Full-time

Job Details :

Role : AWS DevOps Engineer EMR Cluster

Location : Piscataway, NJ / Hybrid

Summary :

We are seeking an AWS DevOps Engineer EMR Cluster who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins.

This role will focus on automating infrastructure deployments, writing validation checks, and enhancing our data processing capabilities using AWS EMR.

Key Responsibilities :

  • Design, implement, and manage AWS EMR clusters for large-scale data processing tasks.
  • Develop and maintain CI / CD pipelines using tools like Jenkins and Code Deploy to automate deployment processes.
  • Write and manage infrastructure as code (IaC) using Terraform, including reading and interpreting Terraform plans for effective infrastructure deployment.
  • Create, execute, and optimize data pipelines to run Bash or Python scripts for automating deployments and validation checks.
  • Collaborate with cross-functional teams to gather requirements and implement efficient workflows for data processing and infrastructure management.
  • Ensure high availability and performance of EMR jobs and troubleshoot any issues that arise.
  • Document processes, workflows, and architectural designs for future reference and knowledge sharing.
  • Implement best practices for security, governance, and compliance within the AWS environment.

Qualifications :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience with AWS EMR, including configuration and management of EMR clusters.
  • Strong understanding of API development and integration.
  • Hands-on experience with AWS DevOps tools, including Code Deploy, Jenkins, or equivalent.
  • Familiarity with Terraform for infrastructure provisioning and management, including the ability to read and interpret plans.
  • Proficient in scripting languages such as Bash or Python for automation tasks.
  • Excellent problem-solving skills, attention to detail, and a proactive approach to challenges.

Preferred Qualifications :

  • AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified DevOps Engineer).
  • Experience with monitoring and logging tools (e.g., CloudWatch, ELK Stack).
  • Familiarity with data processing frameworks (e.g., Apache Spark).

We can offer you :

  • A highly competitive compensation and benefits package
  • A multinational organization with 58 offices in 21 countries and the possibility to work abroad
  • Laptop and a mobile phone
  • 10 days of paid annual leave (plus sick leave and national holidays)
  • Maternity & Paternity leave plans
  • A comprehensive insurance plan including : medical, dental, vision, life insurance, and long- / short-term disability (plans vary by region)
  • Retirement savings plans
  • A higher education certification policy
  • Commuter benefits (varies by region)
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups
  • Cutting edge projects at the world s leading tier-one banks, financial institutions and insurance firms
  • A flat and approachable organization
  • A truly diverse, fun-loving and global work culture.

SYNECHRON S DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer.

Our Diversity, Equity, and Inclusion (DEI) initiative Synclusive is committed to fostering an inclusive culture promoting equality, diversity and an environment that is respectful to all.

We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply.

We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

9 hours ago
Related jobs
Accord Tecnologies.Inc
Piscataway Township, New Jersey

AWS Data Engineer with EMR clusters Piscataway, NJ 12 months Visa: Any visa independent. AWS EMR Clusters: Configure, manage, and optimize Amazon EMR clusters for big data processing using Apache Spark, Hive, or Presto. Experience: 3+ years of experience in data engineering or a related role, with...

Synechron
Piscataway, New Jersey

We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. Proven experience as a Data Engineer, with a focus on AWS and EMR. Design, implement, and manage data pipelines using AWS services, particularly Amazon EMR. Optimize EMR clust...

Vanator Technology Pvt. Ltd
NJ, United States

Amazon Web Service frameworks·         3 years of experience with Cybersecurity·         Experience with writing system security plans·         Experience working in environments that leverage continuous deployment with tools, including Jenkins·         Ability to write and implement continuous moni...

Radiant Digital
Bedminster, New Jersey

Job Title: AWS and On-Prem DevOps EngineerJob Description:The AWS and On-Prem DevOps Engineer is responsible for designing, implementing, and maintaining AWS and on-premises infrastructure, including RedHat OpenShift Container Platform. The ideal candidate will have a strong understanding of AWS and...

mavinsys
Bedminster Township, New Jersey

Master's in Computer Science, IT, or related field</li> <li>5+ years in AWS and on-prem infrastructure</li> <li>Strong knowledge of AWS (EC2, S3, RDS, VPC)</li> <li>Proficient in Linux administration and networking</li> <li>Experience with RedHat ...

Radiant Digital
Bedminster, New Jersey

Responsibilities:The AWS and On-Prem DevOps Engineer is responsible for designing, implementing, and maintaining AWS and on-premises infrastructure, including RedHat OpenShift Container Platform. The ideal candidate will have a strong understanding of AWS and on-premise infrastructure, Linux adminis...

Marshall Technologies
New Jersey, NJ, United States

Job Title:</b> AWS and On-Prem DevOps Engineer<br /> <b>Location:</b> NJ/NY (Local Candidates Only)<br /> <b>Job Type:</b> Contract</p> <p><b>Job Description:</b><br /> We are seeking an experienced AWS and On-Prem DevOps Engine...

HAN
Woodbridge Township, New Jersey

Configure, manage, and optimize Amazon EMR clusters for big data processing using Apache Spark, Hive, or Presto. Proficient in AWS services such as EMR, S, RDS, Redshift, Lambda, and CloudFormation. Develop and maintain CI/CD pipelines for automated deployment of data applications and services using...

Techno-Comp USA, Inc.
Bedminster, New Jersey

Job Title: AWS and On-Prem DevOps EngineerWork Location: Bedminster, NJ (Hybrid Work Model – 3 Days in a Week Onsite) Job Description:The AWS and On-Prem DevOps Engineer is responsible for designing, implementing, and maintaining AWS and on-premises infrastructure, including RedHat OpenShift Contain...

Endava
Berkeley Heights, New Jersey

Must have experience scaling large-scale, high-performance Kubernetes clusters, beyond just deploying applications. Experience with implemented large-scale, high-availability, and disaster recovery solutions rather than limited experience with small proof-of-concept (POC) projects. Provide hand...