As a key member of our Data Engineering team, you will play a vital role in shaping the future of eDreams ODIGEO's data and machine learning platform.
We are seeking a highly skilled CX Senior Data Engineer to join our team in Barcelona and contribute to the development of highly scalable Big Data platforms that enable the collection, storage, modeling, and analysis of large datasets.
About eDreams ODIGEO
eDreams ODIGEO is the world's leading travel subscription platform and one of the largest e-commerce businesses in Europe. With 22 million customers across 44 markets, 5 brands, and 7M members in Prime, we process over 100 million searches per day and generate up to 6 billion daily AI predictions.
Our diverse team of over 1,600 employees from more than 50 nationalities collaborate to drive innovation and growth. We prioritize transparency, employee care, and flexibility, offering a hybrid home-office model that allows for work-life balance.
Your Key Responsibilities
* Design and implement eDreams' data architecture with a focus on scalability, performance, and data quality.
* Ensure the architecture is sophisticated, maintainable, and adaptable to future growth.
Data Architecture and Scalability:
* Define and maintain the current data engineering environment and tools, including Jenkins, Google Kubernetes Engine (GKE), and Cloud Composer (Airflow).
* Automate the development and deployment processes of ETL pipelines to empower stakeholders and increase autonomy.
* Utilize Docker and Docker Compose for building and testing ETL processes.
ETL Development and Optimization:
* Develop, maintain, and optimize ETL pipelines and related tools, primarily using Python.
* Contribute to Java and Scala/Spark projects as needed.
* Write and execute complex SQL queries on Google BigQuery for data analysis and transformation.
Platform Evolution and Innovation:
* Drive the evolution of the GCP data platform by researching and implementing new and emerging technologies.
* Contribute to the development and enhancement of internal libraries and automation tools to reduce time-to-market.
Collaboration and Communication:
* Collaborate with stakeholders to align, clarify, and gather project business requirements.
* Utilize Git (Bitbucket) for version control and collaborative code development.
* Strong communication skills are required to explain technical concepts to stakeholders.
Requirements
* Degree in Computer Science or equivalent (IT engineer).
* At least 3 years of experience in Data Engineering.
* Proficiency in Python for data engineering tasks.
* Experience with Java and Scala/Spark (desirable).
* Expertise in SQL and Google BigQuery.
* Hands-on experience with cloud platforms, specifically Google Cloud Platform (GCP).
* Experience with containerization (Docker, Docker Compose) and orchestration (Kubernetes/GKE).
* Familiarity with workflow orchestration tools (Airflow/Cloud Composer).
* Experience with CI/CD pipelines (Jenkins).
* Strong understanding of data architecture principles.
* Excellent problem-solving and analytical skills.
* Good understanding of Git version control.
* Ability to gather and translate business requirements.
* Working English fluency.
What's in it for you?
* A rewarding compensation package, including Prime Plus membership, competitive salary, and benefits package.
* Continuous learning opportunities through free Coursera access, soft skills workshops, tech training, leadership development, and more.
* Grow opportunities to empower your career, and unleash your potential through personalized career paths and the eVOLVE Program.
* A dynamic and healthy environment that prioritizes work-life balance, innovation, and collaboration.