**Company Description**
NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach.
Founded in Barcelona in 2001, Netquest is the data collection provider of choice for the Market Research Industry. A tech-driven company built on a robust and engaged panel and a strict quality standard (ISO 20252). We make possible a truly 360 degrees view of today’s consumers collecting behavioral and declarative data from a single source, our panelists, in 23 countries across the globe. Leveraging our data, savvy researchers better define winning strategies based on an in-deep understanding of consumers' preferences and behaviors.
As a Data team we have to cover the three main specialties at the data field: Data Science, Data Analytics and Data Engineering. Today we have covered all the current needs in each field but we are looking for a boost in the Data Engineering part, looking to the future, by adding a person who provides us experience and knowledge about doing things in the right direction.
**Technologies and standards**
- Proficiency in Python and SQL
- Awareness of scheduling tools, like Apache Airflow
- Interest in Big Data solutions, like Apache Spark
- In depth understanding of the Data Engineering techniques
- Ability to maintain and extend processes and functionalities
- The ability to integrate partial solutions and RnD results into production-ready data pipelines
- The ability to build and operate infrastructure (e.g, for testing purposes)
- The ability to support on operational questions for environments in production
- Understanding of cloud infrastructure and services available for setting up and maintaining data pipelines (e.g., AWS)
- Ability to advise on data transformation workflow designs and optimizations with the dimensions of cost, performance and delivery mechanisms (streams / increments / etc.)
**Qualifications**
- The ability to design and implement an entire **data pipeline** from scratch
- The ability to decide which problems to solve with scale-up and which ones to tackle with scale-out approaches and how to combine them in data pipelines
- Knowledge about Data Architecture
- Awareness of Data Governance
- An economic view on questions of operability of crafted data pipelines:
- Maintenance of data integrity in cases of reprocessing
- Understanding of whether or how (internal or external) customer data deliveries are affected by changes to the software
- Awareness of data design patterns in the organization and best practices in general
- Deep understanding of data modelling, data schemas and evolution thereof
- Awareness of best practices of data transformation design patterns
- An advanced focus on data integrity when crafting data pipelines, by building in means to monitor data health and state of intermediate data and alerting mechanisms
- Designing Quality Control/Validation processes / Quality Gates
**Additional Information**
The accountabilities of a data engineer include the accountabilities of a data engineer but increased norms apply, meaning a senior data engineer is expected to be able to accomplish their tasks in less time, to a higher standard (total understanding and excellent adherence to applicable standards and guidelines) and be able to solve more complex problems.
The senior data engineer is expected to look beyond their primary team scope and strive for harmonization and improvement of solutions across the CSG or even beyond.
The senior data engineer is also accountable to pro-actively pass on their knowledge on to other engineers when the opportunity arises during the course of their work:
- During pair programming/ pair work
- When sought for advice
- During code reviews
- By participating in _Communities of Practice_
The senior data engineer is accountable for bringing together technical assets from different disciplines within their cross-functional team and for fostering a common solution approach between team members with different technical backgrounds.
**Our Benefits**
- Adaptable working environment
- Volunteer time off
- LinkedIn Learning
- Employee-Assistance-Program (EAP)
**About NIQ**
NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.
Want to keep up with our latest updates?
Follow us on: LinkedIn | Instag