Senior Data Engineering

Company Description

R24 0006748 US

Gfk is seeking a System Architect with hands-on Python, Pyspark experience and proven abilities to support software development activities in an Agile software development lifecycle.

We are seeking a well-rounded architect for a cloud based big data application using a variety of technologies. The ideal candidate will possess strong technical, analytical, and interpersonal skills.

In addition, the candidate will collaborate with developers on the team to achieve architecture and design objectives as agreed with stakeholders.

Job Description

Position Description

• Meet with stakeholders to understand the big picture and asks.
• Recommend architecture aligned with the goals and objectives of the product / organization.
• Recommend standard ETL design patterns and best practice.
• Drive the detail design and architectural discussions as well as customer requirements sessions to support the implementation of code and procedures for our big data product.
• Design and develop proof of concept / prototype to demonstrate architecture feasibility.
• Collaborate with developers on the team to meet product deliverables.
• Must have familiarity with data science tech stack. Any one of the languages : SAS,SPSS code or R-code.
• Work independently and collaboratively on a multi-disciplined project team in an Agile development environment.
• Ability to identify and solve for code / design optimization.
• Learn and integrate with a variety of systems, APIs, and platforms.
• Interact with a multi-disciplined team to clarify, analyze, and assess requirements.
• Be actively involved in the design, development, and testing activities in big data applications.

Qualifications

• Hands-on experience Python and Pyspark, Jupyter Notebooks, Python.
• Familiarity with Databricks. Azure Databricks is a plus.
• Familiarity with data cleansing, transformation, and validation.
• Proven architecture skills on Big Data projects.
• Hands-on experience with a code versioning tool such as GitHub, Bitbucket, etc.
• Hands-on experience building pipelines in GitHub (or Azure Devops,Github, Jenkins, etc.)
• Hands-on experience with Spark.
• Strong written and verbal communication skills.
• Self-motivated and ability to work well in a team.

Any mix of the following skills is also valuable :

• Experience with data visualization tools such as Power BI or Tableau.
• Experience with DEVOPS CI / CD tools and automation processes (, Azure DevOPS, GitHub, BitBucket).
• Experience with Azure Cloud Services and Azure Data Factory.
• Azure or AWS Cloud certification preferred.

Education :

Bachelor of Science degree from an accredited university

Additional Information

Our Benefits

• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)

About NIQ

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth.

In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights delivered with advanced analytics through state-of-the-art platforms NIQ delivers the Full View.

NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit

Want to keep up with our latest updates?

Follow us on :

Our commitment to Diversity, Equity, and Inclusion

NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce.

We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products.

We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity / Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class.

Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center :