One of Futureheads longest standing consultancy partners is looking to hire multiple Data Engineers to join one of their fintech clients, based in Madrid.
This role requires candidates who are able to work 5 days p/week in office, so please only apply if you are able to commit to this.
This position with have responsibility for building and optimising data ingestion, transformation, and publication pipelines within the Europe Data Lake architecture, with a focus on performance, scalability, and quality.
Main Responsibilities:
* Develop and maintain data pipelines (ingestion, transformation, publication) using Databricks and Azure Data Factory.
* Operate automation processes through CI/CD (Azure DevOps).
* Configure and monitor pipelines, including logs, alerts, and dashboards.
* Ensure versioning and traceability of data artifacts.
* Ensure compliance with security, encryption, and data anonymization policies (PCI, LGPD).
* Participate in unit, integration, and performance testing.
* Contribute to technical documentation and data dictionary development.
Technical Requirements:
* Solid experience (minimum of 3 years) with Databricks (Java/Scala/Spark) and ADF.
* Knowledge of Delta Lake, Control-M, and B2B integrations (REST, SFTP, APIs).
* Experience with high-volume pipelines and monitoring (Observability).
* Knowledge of version control (Git) and agile methodologies (Scrum).
* Experience with performance tuning and optimization of SQL/Spark queries.
Desired Profile:
* Analytical and performance-oriented mindset.
* Proactive problem-solving approach.
* Collaborative work style in multidisciplinary squads.