Capitole keeps growing, and we want to do it with you!We are seeking a skilled Data Engineer proficient in building robust ETL (Extract, Transform, Load) pipelines using Azure Data Factory, Databricks, SQL, and Azure Data Lake.The ideal candidate will have a strong background in data engineering with a focus on Azure technologies, particularly Azure Data Factory and Databricks.Key Responsibilities:
Design, develop, and maintain ETL pipelines using Azure Data Factory to extract, transform, and load data from various sources into Azure Data Lake and other target destinations.Utilize Databricks for advanced data transformations, processing, and analytics, ensuring optimal performance and scalability.Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.Develop and maintain data catalogs within Databricks, ensuring accurate documentation and metadata management.Optimize and troubleshoot existing ETL processes to improve efficiency, reliability, and performance.Stay up-to-date with the latest Azure technologies and best practices in data engineering.Actively participate in code reviews, documentation, and knowledge sharing sessions.Requirements:
Bachelor's degree in Computer Science, Engineering, or a related field.Proven experience in building ETL pipelines using Azure Data Factory, Databricks, SQL, and Azure Data Lake.Strong proficiency in SQL for data manipulation and querying.Deep knowledge of programming languages:
proficiency in Python, Java, or Scala.Strong knowledge in Apache Spark.Excellent problem-solving skills and attention to detail.Ability to work effectively both independently and as part of a team in a fast-paced environment.Strong communication and interpersonal skills.Preferred Qualifications:
Certification in Azure Data Engineering or related field.Knowledge of data governance principles and best practices.Familiarity with DevOps practices for CI/CD pipelines using GitHub workflows.Familiarity with the SPIRE working model is highly desirable.Experience in the Finance sector or similar regulated industries is a plus.We're great, but with you we'll be even better.Benefits include:
Budget of 1,200€ for personal training (courses, certifications, books, etc.).Monthly follow-up meetings for continuous feedback.Teleworking options.Flexible working hours for work-life balance.Private medical insurance paid in full by Capitole.Flexible remuneration options (restaurant tickets, transport, childcare).Andjoy Gym membership.Discounts on major brands (Club Capitole).Team activities and community engagement:
Bi-monthly team buildings, summer parties, Christmas dinners.Sponsorship of a football team.Participation in technological communities to share knowledge.Join us and become part of a team that values collaboration and innovation!To learn more about us, visit:
Original Job PostingNote:
The employee must adhere to information security policies, including NDA signing and confidentiality agreements.
#J-18808-Ljbffr