Role: DevOps Engineer (Databricks platform)
Skills: Databricks, Azure, GitHub, IaaC & Terraform.
Location: Madrid, Spain
Languages: English C1
We at Coforge are looking to hire a DevOps Engineer with knowledge of the DataBricks platform with the following characteristics:
Key Responsibilities
* Operate, maintain, and continuously improve the Databricks platform in Azure.
* Develop and maintain deployment automation using Azure DevOps (and progressively GitHub as part of the migration).
* Collaborate with cloud networking and security teams to ensure topics such as secure connectivity, private endpoints, firewalls, routing, identity integration, etc.
* Provide guidance to internal consumers on efficient use of Databricks (clusters, jobs, UC, storage patterns).
* Participate in Agile ceremonies and contribute to SAFe PI planning and continuous improvement.
Required Technical Skills
* Strong Cloud Engineering expertise, primarily Azure (VNETs, DNS, NSG, Load Balancing, routing, identity, private networking).
* Infrastructure-as-Code expertise.
* CI/CD pipelines using Azure DevOps; familiarity with GitHub is a plus.
* Proficiency with Databricks platform administration:
-Workspaces, cluster policies, job orchestration
-Unity Catalog, metastore configuration
-Storage integration (ADLS)
* Solid understanding of cloud networking in enterprise environments.
* Experience with scripting languages (Python, Bash, PowerShell).
* Knowledge of monitoring tools (Azure Monitor, Prometheus, Grafana, Datadog, etc.).
* Experience working in Agile/Scrum or SAFe environments.
Nice-to-Have
* Experience with Databricks in AWS (IAM roles, S3, networking models).
* Familiarity with FinOps principles.