About the Company
The firm is a recognized market innovator with the technology and tools that accurately authenticate the quality of digital media and drive ad performance for the world's largest brands. They provide media transparency and accountability to deliver the highest level of impression quality for maximum advertising performance.
Position Overview
As a Big Data ETL Developer you will be designing and implementing systems that crunch and process billions of records a day and make them available in the company's analytics platform, helping our clients to make smarter decisions that continuously improve their ad-impression quality.
You will develop ETL processes on both home-grown and 3rd party frameworks.
Responsibilities
- Developing ETL processes that process billions of records a day efficiently
- Delivering insightful data to clients, partners and internal users in various ways by implementing robust, scalable data delivery applications and APIs.
- Collaborating and participating in project meetings.
- Analyzing data to test the correctness and effectiveness of ETL processes.
Position Requirements
At least 3 years hands-on development experience of ETLsAt least 2 years working in a DWH environment – schema design is an advantageHands-on development experience in pythonExperience in one or more of the following technologies : Hadoop, Spark, Kafka, Parquet, Hive, Pig.Advanced SQL query writing abilities and data understandingExcellent communication skills and a team playerExperience with GoodData CloudConnect is a plusExperience with Vertica or other columnar data stores is a plusHands on experience with Spark Streaming or other live stream processing technology – a plusJ-18808-Ljbffr