AWS Data Engineer (10737-1) San Francisco, CA

AWS Data Engineer (10737-1) San Francisco, CA

AWS Data Engineer, Python, Spark, AWS Services, ETL, Glue, EMR, S3, Redshift, Airflow, Data Quality, CI / CD

If you post this job on a job board, please do not use company name or salary.

Experience level : Mid-senior Experience required : 7 Years Education level : Bachelor’s degree Job function : Information Technology Industry : Information Technology and Services Pay rate : View hourly payrate Total position : 1 Relocation assistance : No Visa sponsorship eligibility : No

Job Description :

7+ years of experience in Amazon Web Services (AWS) Cloud Computing

Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and processing using Python, Spark, and AWS services

Key Skills & Expertise

ETL Development : Implement and manage ETL processes using AWS Glue and EMR for both batch and streaming data

Data Storage Solutions : Design and maintain storage solutions using Medallion Architecture in S3 and Redshift

Workflow Orchestration : Monitor and optimize data workflows using Airflow or other orchestration tools

Data Quality : Ensure accuracy, consistency, and integrity throughout the data lifecycle

CI / CD : Implement and understand CI / CD practices for automated data pipeline deployment

System Monitoring : Utilize CloudWatch and Datadog for performance monitoring and reliability

Collaboration : Work closely with cross-functional teams to gather requirements and deliver business-driven data solutions

Communication : Strong ability to communicate project updates and technical details to stakeholders.

Additional Notes :

Please submit the candidate's resume in PDF format.

Please remove the candidate's LinkedIn URL from the resume; otherwise, the profile will not be considered.