Develop and maintain scalable data pipelines and architectures using Databricks and related technologies.