Capitole keeps growing, and we want to do it with you!We are seeking a skilled Data Engineer proficient in building robust ETL (Extract, Transform, Load) pipelines using Azure Data Factory, Databricks, SQL, and Azure Data Lake.The ideal candidate will have a strong background in data engineering with a focus on Azure technologies, particularly Azure Data Factory and Databricks.Key Responsibilities:
Design, develop, and maintain ETL pipelines using Azure Data Factory to extract, transform, and load data from various sources into Azure Data Lake and other target destinations.Utilize Databricks for advanced data transformations, processing, and analytics, ensuring optimal performance and scalability.Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.Develop and maintain data catalogs within Databricks, ensuring accurate documentation and metadata management.Optimize and troubleshoot existing ETL processes to improve efficiency, reliability, and performance.Stay up-to-date with the latest Azure technologies and best practices in data engineering.Participate in code reviews, documentation, and knowledge sharing sessions.Requirements:
Bachelor's degree in Computer Science, Engineering, or a related field.Proven experience in building ETL pipelines using Azure Data Factory, Databricks, SQL, and Azure Data Lake.Strong proficiency in SQL for data manipulation and querying.Deep knowledge of programming languages:
proficiency in Python, Java, or Scala.Strong knowledge in Apache Spark.Excellent problem-solving skills and attention to detail.Ability to work effectively both independently and as part of a team in a fast-paced environment.Strong communication and interpersonal skills.Preferred Qualifications:
Certification in Azure Data Engineering or related field.Knowledge of data governance principles and best practices.Familiarity with DevOps practices for CI/CD pipelines using GitHub workflows.Familiarity with the SPIRE working model is highly desirable.Experience in the Finance sector or similar regulated industries is a plus.What We Offer:
Budget of 1,200€ in individual training for you to use in whatever you want (technological events, books, trainings, certifications, etc.).Follow-up with your team every month for continuous feedback.Teleworking and flexible working hours to help you reconcile your professional and family life.Private medical insurance paid in full by Capitole.Flexible remuneration options (restaurant tickets, transport, and/or childcare).Andjoy (Gymforless).Discounts on major brands for employees (Club Capitole).Team Buildings every two months, including summer parties and Christmas dinners.Football team sponsored by Capitole.Technological communities for sharing knowledge and ideas.Don't hesitate to send us your profile;
we are looking forward to meeting you!The employee will adhere to the information security policies, including signing an NDA, as they will have access to confidential information and must comply with internal policies.
#J-18808-Ljbffr