The Resilience & Technology team in the AWS Security Operations Center (SOC) is seeking a creative, curious, and ambitious Senior Data Engineer to design, build and optimize the data infrastructure that powers AWS's security monitoring and analytics solutions.
You will play a key role in building highly scalable and reliable data pipelines that ingest, process and serve security data at a massive scale across Amazon's systems.
In this critical role, you will collaborate closely with Industry Specialists, Software Engineers, Security Engineers, and Product Managers to understand data requirements.
You will architect data models, build ETL / ELT pipelines, and implement data distribution layers that enable advanced security use cases like threat detection, incident response, forensic analysis and data exploration.
With your keen data engineering skills, you will empower AWS SOC to derive insights from our security telemetry data and drive continuous improvement of Amazon's security posture.
This is a unique opportunity to join a world-class team and have a direct impact on safeguarding Amazon's infrastructure and customer trust.
We are looking for an exceptional data professional with deep expertise in distributed data systems and big data technologies on AWS.
You will thrive in our dynamic environment by driving innovation, setting best practices, and mentoring other engineers.
Key job responsibilities
- Architect and build scalable data pipelines for ingesting, processing and serving security data from diverse sources across Amazon
- Design and implement data models, storage solutions and distributed processing frameworks for security analytics workloads
- Collaborate with data scientists to build features, transformations and serving layers for machine learning models
- Optimize data engineering systems for performance, cost, reliability, recoverability and security
- Automate data quality monitoring, testing and validation processes
- Partner with software engineering teams to seamlessly integrate data solutions with security applications and services
About the team
About Amazon Security
Diverse Experiences
Amazon Security values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply.
If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Why Amazon Security?
At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services.
We offer talented security professionals the chance to accelerate their careers with opportunities to build experience in a wide variety of areas including cloud, devices, retail, entertainment, healthcare, operations, and physical stores.
Inclusive Team Culture
In Amazon Security, it’s in our nature to learn and be curious. Ongoing DEI events and learning experiences inspire us to continue learning and to embrace our uniqueness.
Addressing the toughest security challenges requires that we seek out and celebrate a diversity of ideas, perspectives, and voices.
Training & Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional.
Work / Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture.
When we feel supported in the workplace and at home, there’s nothing we can’t achieve.
We are open to hiring candidates to work out of one of the following locations :
Arlington, VA, USA Herndon, VA, USA Seattle, WA, USA
BASIC QUALIFICATIONS
- 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience with big data technologies such as : Hadoop, Hive, Spark, EMR
- Experience building production data pipelines and processing frameworks on AWS
PREFERRED QUALIFICATIONS
- Experience operating large data warehouses
- Experience communicating with users, other technical teams, and management to collect requirements, describe data modeling decisions and data engineering strategy
- Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
- Experience with MPP databases such as Amazon Redshift
- Experience with SQL
- Experience in a security operations, cybersecurity or incident response environment
- Familiarity with stream processing engines like Spark Streaming, Flink
- Knowledge of machine learning / deep learning frameworks and feature engineering
- Experience with DataOps practices and data quality frameworks