Data Platform Engineer (Azure Databricks) Fully Remote from Spain€25–30/hour12-month contract (Autonomo setup)We are looking for aData Platform Engineerto support and evolve multipleUnity Catalog–enabled Azure Databricks environments.This role is focused onplatform engineering and operations, NOT on building data pipelines or ML models.
\n
No espere a enviar su solicitud después de leer esta descripción; se espera un gran volumen de candidaturas para esta posibilidad.
\n
You will work on improving, automating, and scaling the platform itself.Key Responsibilities:Platform Engineering & OperationsImprove implementation patterns across jobs and platform componentsIdentify and resolve scalability, reliability, and maintainability bottlenecksStandardise workspace configurations and environment structuresMonitor platform health and performanceUnity Catalog ManagementMaintain consistent and secure Unity Catalog configurationsEnsure governance structures (catalogs, schemas, grants, service principals) are efficient and developer-friendlyPerformance & Cost OptimisationOptimise compute configurations and autoscaling behaviourAnalyse Spark jobs, Delta Lake usage, and storage layout for performance and cost efficiencyAutomation & Infrastructure-as-CodeAutomate environments using Databricks Asset Bundles (DABs) and TerraformEnsure reproducible, versioned environments aligned with CI/CD principlesMinimise manual configurationDocumentation & GuidanceDocument platform patterns and operational runbooksSupport engineers and analysts working with DatabricksRequired Experience:~3–5+ years in Platform (Data) Engineering~ xcskxlj Strong hands-on experience with Azure Databricks~ Strong knowledge of Unity Catalog (access models, governance, service principals, workspace configs)~ Solid PySpark and SQL skills~ Understanding of performance optimisation (partitioning, Z-ordering, caching, data layout)~ Experience with CI/CD, Git workflows, and Infrastructure-as-Code~ Bonus: MLOps experience
\n
If you're based in Spain and available for a 12-month Autonomo contract, feel free to apply or message me directly.