Position : AWS Data Engineer
Location : Bloomfield, CT (Onsite)
Duration : FTE / Direct Hire
Job Description :
Relevant Experience :
- 7-10 years of hands on Pyspark / Databricks development experience.
- Knowledge in Terraform, S3, API Gateway, Lamba, SNS and SQS.
- Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL
- Should have CICD experience using tools like GIT, Jenkins etc
- Should have extensive hands-on experience with SPARK and real time analytic frameworks, data streaming & Structured streaming.
- Knowledge in Databricks reporting.
- They need to be experienced in programming language (Python, Pyspark)
- Hands-on experience integrating open-source components into data-analytic solutions
- Working with vendors to enhance tool capabilities to meet enterprise needs
- Willingness to continuously learn & share learnings with others
- Strong troubleshooting and performance tuning skills.
- Experience building multi-tenant, virtualized infrastructure a strong plus
Technical / Functional Skills :
- AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL, Sprak Streaming, Data Streaming
Data Governance Engineer
A company is looking for a Data Governance Engineer IV to drive data governance and quality practices across business lines. ...
Staff Data Engineer - Hybrid
Join a fast-paced and talented team to deliver Data Engineering capabilities for The Hartford’s Commercial Data Science Data Delivery. Programming, SDLC practices, Distributed systems, Data warehousing solutions SQL and NoSQL, ETL tools, CICD, Cloud Technologies (AWS/AZURE),Python/Spark, Datamesh an...
Geospatial Data Engineer
A company is looking for a Geospatial Data Engineer to manage and enhance geospatial data systems in support of conservation efforts. ...
Data Engineer - Sr. ETL Developer
Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and trans...
Staff Data Engineer (Hartford, CT)
Support software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. Staff Data Engineer (Hartford, CT)Staff Data Engineer - GE07CE. Implement and test data processing pipeline...
Data Engineer I - ETL/AWS
Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and trans...
Lead Data Engineer, Data Reliability
The Data Reliability Engineering team for Disney’s Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment’s big data platform, which processes hundreds of terabytes of data and billions of events daily. The Lead Data Engineer will help ...
Data Engineer I (Snowflake, AWS and Python)
Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and trans...
Data Engineer II - Artificial Intelligence
Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and trans...
Data Engineer II
Incorporate core data management competencies including data governance, data security and data quality. The ideal candidate will contribute as a data engineer in developing the necessary components of a modernized, scalable, performant and extensible ecosystem of data and analytics capabilities. Yo...