Are you passionate about Big Data and Distributed systems? Do you enjoy building new state-of-the-art products at Petabyte scale?
Be part of a team of world-class engineers and industry leading experts operating one of the largest big data platforms for advertising at Amazon scale.
Key job responsibilities
We are seeking an experienced Data Engineer to build the next generation of systems using open source technologies such as Hadoop, Hive, Spark, and AWS services like EMR, Kinesis and DynamoDB.
You will have background working in big data platforms and possess extensive experience in highly distributed systems at scale.
You will be proficient in data engineering design patterns, and have a proven track record of implementing and operating scalable and cost-effective solutions to manage data flow from multiple production systems.
You have strong operational background collaborating seamlessly with cross-functional teams. You will be responsible for designing and developing software products that will provide measurement and reporting to a wide set of users across all of Amazon's advertising suite across display, search, native, and video on all devices.
Candidates for this position should have strong engineering fundamentals as well as real-world experience. You will showcase diverse architectural approaches and design patterns in your technical design.
Think big and stay informed about industry standards in the Ad tech space. Communicate effectively across all leadership levels verbally and in writing.
Lead deep technical discussions with senior engineers, collaborating to solve challenging problems. You will be able to quickly grasp new systems and provide valuable consultation.
A day in the life
We are responsible for processing all advertising events (over tens of billions of new events per day) such as impressions, clicks and views across all Amazon products.
We provide petabyte-scale, low latency and highly available event look up services to a wide set of users within Amazon Ads.
We apply the latest machine learning and big data technologies available on terabytes of data daily, operating petabyte-size clusters.
Our data must always be fast, enabling advertisers to optimize ad spend and allocate budgets effectively by providing accurate, actionable and timely performance metrics across all of Amazon’s advertising products.
You will design and implement complex data pipelines in Amazon's advertising platform and other BI solutions to support the rapidly growing and dynamic business demand for data.
You will leverage this data to deliver data-driven insights that will have an immediate impact on day-to-day decision-making at Amazon.
About the team
Join our fast growing Amazon Ads team! This presents a unique opportunity to take ownership and lead significant initiatives, building innovative solutions to complex and challenging problems.
You will encounter some of the toughest and most inspiring technical challenges of your career as you build petabyte-scale services, invent new big data paradigms, and scale for extreme growth.
If you are passionate about technologies, strongly biased to go deep to find insights and build scalable platforms, relentless in ensuring quality and reliability, and feel comfortable communicating with different levels of leadership, you are the candidate we are seeking!
BASIC QUALIFICATIONS
- 3+ years of data engineering experience
- 2+ years of analyzing and interpreting data with Redshift, Oracle, NoSQL etc. experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
- Experience with data visualization using Tableau, Quicksight, or similar tools
- Experience operating large data warehouses or data lakes
- Experience in designing data models that supports structures and unstructured data
- Experience in gathering requirements and formulating business metrics for reporting
- Ability to deal with ambiguities and competing priorities.
- Prior experience in programming using Scala / Python / Java