We're Hiring: Data Engineer (Azure and Databricks)
We are looking for a Mid-Level to Senior Data Engineer with hands-on experience in Azure Databricks and modern data engineering practices to join our growing data team and help us build our next-generation data platform. If you have 5-6 years of relevant experience building ETL/ELT pipelines and working across the Azure data stack, this could be a great fit.
Role Overview
In this role, you will work on designing and developing scalable data pipelines using Databricks (PySpark/Spark SQL) and Azure cloud services. You will support analytics, BI and product teams by delivering clean, reliable datasets and well-structured data models. Knowledge of Power BI and Fabric is a big plus.
Key Responsibilities
- Develop and maintain ETL/ELT data pipelines using Azure Databricks (PySpark, Spark SQL).
- Work with Delta Lake (Bronze/Silver/Gold layers) for scalable data transformations.
- Integrate and process data from multiple sources (APIs, databases, storage).
- Collaborate on pipeline orchestration using Azure Data Factory or Synapse.
- Work with ADLS Gen2, One Lake, Azure SQL, Key Vault, Event Hub, and other Azure resources.
- Implement data quality checks, documentation, and best practices.
- Optimize cluster usage, job performance, and pipeline runtimes.
- Support BI, analytics and product teams by delivering clean datasets that can be used for data reporting and self-serve analytics purposes, training machine learning models or augmenting AI products such as the chatbot with customer specific knowledge
Required Skills
- 5-6 years of hands-on experience as a Data Engineer.
- Proved experience with Azure Databricks (PySpark/Spark SQL).
- Strong understanding of Delta Lake and data Lakehouse concepts.
- Experience with Azure Data Factory, ADLS Gen2, Azure SQL, and related Azure services.
- Solid SQL skills and knowledge of ETL/ELT processes.
- Experience using Git, Terraform and best DevOps practices.
Nice to have
- knowledge of Power BI (Data Modelling, DAX, Power Query).
- Exposure to MLflow and Microsoft Fabric- One lake
- Familiarity with Agile ways of working
- Experience with preparing data that can be connected to LLM systems in a RAG like setting
Location
Norway (Oslo), Spain (Malaga or Madrid)
About the Recruitment Process
We will recruit on a rolling basis, so please do not hesitate to apply with a CV in English. A criminal record check will be requested for the successful candidate.
Ready to make an impact? See what our employees in Tech say about the culture at Sector Alarm: