Data Engineer Python, PySpark, AWS
W2 ONLY- NO C2C
Location : Richmond, VA
Setting : May work remote or on site
Contract : 4+months
Beware of scams. S3 never asks for money during its onboarding process.
Position Overview :
As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure.
You will work closely with our data scientists and analysts to understand data requirements and ensure data quality and reliability.
The ideal candidate will have strong technical skills in Python, PySpark, and AWS, along with experience in data modeling, ETL processes, and cloud-based data solutions.
Key Responsibilities :
- Design and develop robust data pipelines using Python and PySpark to process large volumes of data from multiple sources.
- Implement efficient ETL processes to transform and cleanse data before loading into our data warehouse.
- Collaborate with data scientists and analysts to understand data requirements and ensure data quality and consistency.
- Optimize data infrastructure and pipeline performance for scalability and reliability.
- Monitor and troubleshoot data pipelines and infrastructure to ensure uptime and performance.
- Implement best practices for data security, privacy, and compliance.
- Stay current with advancements in data engineering technologies and best practices. Tech stack :
- Python
- Python
- PySpark
Responsibilities :
- Development and maintenance of data pipelines using Python, PySpark and various AWS services.
- End to End testing, deployment, Product support and Defect fixes.
Job ID : JOB-236362
Publish Date : 20 Aug 2024
Tagged as : Data Engineer - Python, PySpark, AWS
ERP Developer – Workday – W2 ONLY Contract Strategic Staffing SolutionsRichmond VA3 weeks ago
Develop and maintain integrations between Workday and other systems, ensuring seamless data flow and integrity. ...
Senior Software Engineer, Back End (java, Python, Aws)
Senior Software Engineer, Back End (Java, Python, AWS). Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services . Capital One will cons...
Senior Software Engineer, Full Stack (Python, AWS)
Senior Software Engineer, Full Stack (Python, AWS). Utilize programming languages like JavaScript, Java, HTML/CSS, TypeScript, SQL, Python, and Go, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services. Capita...
Senior Software Engineer, Back End (aws, Go, Python)
Senior Software Engineer, Back End (AWS, GO, Python). Utilize programming languages like Python, Go, and a variety of AWS tools and services . Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regardi...
Senior Software Engineer, Back End (Java, Springboot, Python, AWS)
Senior Software Engineer, Back End (Java, Springboot, Python, AWS). Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services. We are seek...
Transformer Component Engineer Contract-to-Hire BrooksourceGlen Allen, VA2 months ago
Whether it’s contract, contract-to-hire, or permanent placement work, we customise our search based upon your company’s unique initiatives, culture and technologies. Transformer Component Engineer. Our large energy & utility client is currently seeking to fill a position in the Corporate Fleet Compo...
Senior DevOps Engineer (DevOps, Python, AWS)
Senior DevOps Engineer (DevOps, Python, AWS). We are seeking DevOps Engineers who are passionate about marrying data with emerging technologies to join our team. Utilize programming languages like Java, Python, SQL, Ruby and Go, Container Orchestration services including Docker and Kubernetes, CM to...
Data Engineer
Must have experience: AWS Glu, Spark, Databricks & Python. Tech: Databricks, Python, Spark, AWS (Glue, lambda, RDS, CloudWatch, S3, IAM, Fargate, etc. Utilize programming languages like Databricks, Python, Spark, AWS (Glue, lambda, RDS, CloudWatch, S3, IAM, Fargate, etc. Spark, Python,Databricks...
Senior Data Engineer - Principal Associate (Spark, Scala, AWS)
West Wacker Dr (35012), United States of America, Chicago, IllinoisSenior Data Engineer - Principal Associate (Spark, Scala, AWS). Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake...
Senior Software Engineer, Backend (AWS, Python)
Recruiting: VA - McLean, United States of America, McLean, VirginiaSenior Software Engineer, Backend (AWS, Python). Utilize programming languages like Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake. We are seeking a Senior So...