Our goal is to strengthen the brand in Spain. We are looking for an expert to work as a Senior Data Engineer .
Responsibilities :
* Design, develop, and optimize data pipelines and ETL workflows using Databricks.
* Implement data transformation and processing solutions in Databricks using Python and SQL.
* Ensure data security, governance, and compliance by following industry best practices.
* Work with Azure Data Lake Storage (ADLS) to efficiently store, manage, and process large datasets.
* Collaborate with stakeholders to define data governance frameworks and improve data quality.
* Integrate Azure Data Factory (ADF) pipelines to support data ingestion and transformation processes.
Minimum Requirements :
* 5+ years of experience in Databricks and big data processing.
* Hands-on experience with Azure Data Lake (ADLS).
* Strong programming skills in Python and SQL.
* Understanding of Data Governance concepts, including data quality, metadata management, and security policies.
* Experience in performance tuning and optimization of data pipelines.
* Familiarity with Azure Data Factory (ADF) is a plus.
* Strong problem-solving skills and ability to work in an agile environment.
Preferred Skills :
* Experience with Data Cataloging tools (e.g., Azure Purview, Alation, or Collibra).
* Knowledge of CI / CD pipelines for data engineering.
J-18808-Ljbffr
#J-18808-Ljbffr