Job Title : AWS Data Bricks Spark / Scala Engineer
Have you got the right qualifications and skills for this job Find out below, and hit apply to be considered.
Job ID : 2023-11933
Job Location : Morris Plains, NJ (remote to start); Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO
Employment Type : W2
Key Technology : DataBricks, AWS, Spark
Job Responsibilities :
- Drive mentality of building well architected applications for AWS Cloud.
- Drive the mentality of quality being owned by the entire team.
- Identify code defects and work with developers to address quality issues in product code.
- Finding bottlenecks and thresholds in existing code through the use of automation tools.
- Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily.
- Ownership over your work task and are comfortable interacting with all levels of the team and raise challenges when necessary.
Skills and Experience Required :
- 6-8 years of strong experience in Spark, Python, Shell Scripting, PostgreSQL, Hadoop, AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch), Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure / AWS integration).
- In depth knowledge on Hadoop architecture and its components. Troubleshooting the Hadoop Yarn jobs is a must. Implement Hadoop job orchestration using Shell scripting and Airflow.
- In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
- Strong experience in writing complex and effective SQLs, and Stored Procedures. Strong query optimization skills to improve performance of ETL process.
- Strong hands-on cloud experience with AWS suite.
- Demonstrated work experience in Hadoop, Spark, and Hive.
- Strong development experience on Databricks components.
- Strong hands-on experience on Spark is a must.
- Work experience on Hadoop as data warehouse / Data Lake implementations.
- Moderate to senior Terraform development experience needed.
- Health care domain knowledge is a plus.
J-18808-Ljbffr
Lead AWS Data Bricks Spark/Scala Engineer
Data Management, Solutioning, Data Engineering and ETL proficiency using Data Bricks tool/framework which includes programming with Spark/Scala. Lead AWS Data Bricks Spark/Scala Engineer. In-depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD ...
AWS Data Engineer (Only Locals)
Need strong data engineers for migration from on-prem Hadoop to AWS Redshift experience. ...
AWS Data Bricks Spark/Scala Engineer
AWS Data Bricks Spark/Scala Engineer. In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib. Spark, Python, Shell Scripting, PostgreSQL, Hadoop, AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch), Databricks (...
AWS Data Engineer
Key Skills: </b></p> <p style="text-align:justify">Data Engineering, Data Pipelines, Apache Spark, ETL, Apache Airflow, Data Ingestion, Scala, Python, AWS, S3, Redshift, CI/CD. Job Title:</b> AWS Data Engineer</p> <p style="text-align:justify">...
RQ181766 - DevOps Engineer, Sr. - Security Clearance Required
Deliver simple solutions to complex problems as a DevOps Engineer, Sr. Our work depends on a TS/SCI cleared DevOps Engineer, Sr. HOW A DEVOPS ENGINEER WILL MAKE AN IMPACT. Follow up on engineering tasks for operational solutions, and validate completion. ...
Lead Data Scientist
In the role of Lead Data Scientist we are seeking a seasoned data science professional with proven track record in leading and overseeing the execution of data science projects. Provide guidance and direction to junior data scientists on analyzing large and diverse insurance datasets, and creating c...
Cloud DevOps Engineer
Cloud Native: Provisioning Azure, AWS, and or Google Cloud environments as well as working with tools like Cloud Foundry and / or Kubernetes. As a Cloud DevOps Engineer you will be charged with supporting teams routinely asked to press the boundaries of the possible. This role is right for you if yo...
AI Solutions Engineer- Global Enterprise Sales Central
Bachelor's degree in computer science, Computer Engineering, Electrical Engineering, or a related field. We are seeking a Solutions Engineer - Artificial Intelligence (AI) to join our dynamic sales team. Understanding and experience with AI/ML (Transformers, Deep Neural Networks, Reinforcement learn...
Data Analyst - Hybrid
We are looking for candidates that have strong problem-solving skills, have a technical aptitude, and data experience. Implement program solutions using Maritz Engagement Software Solutions; create Jira tickets for implementation, configure platforms sites, setup of data imports and works with devel...
VDH Cloud Engineer 3 REMOTE (730682)
The Azure Cloud and DevOps Trainer/Developer/Engineer is a versatile role that combines the responsibilities of developing and delivering Azure cloud migration from on-premises systems to Microsoft Azure cloud and DevOps training programs. The Azure Cloud and DevOps Trainer/Developer/Engineer is a v...