Scala & spark data engineer - a year

Title: Data Engineer Location: Madrid, Spain (5 days per week on-site) Salary: €60,000 – €80,000 per annum + benefits Industry: Software / Artificial Intelligence Employment Type: Full-time About the Company - Our client who are a fast-growing and exciting Software and AI business at an early stage of development. Joining now offers a rare opportunity to help shape both the technology and the culture of a company from the ground up. They are building a high-calibre team of talented individuals who want to solve complex problems and create impactful data-driven solutions. An exciting aspect of joining a newly created business at this stage is the opportunity to help define our culture from the very beginning. The Role We are seeking an experienced Data Engineer to join our client's Data Analytics Team. This role focuses on building and maintaining data pipelines into the firm’s central data platform while supporting the ongoing development, testing, and optimisation of the platform. The objective is to ensure the availability, reliability, and integrity of the data that underpins the investment process. Key Responsibilities Data Pipeline Development Design and develop sophisticated data pipelines Integrate data from external vendors, sell-side partners, and other providers into the central data platform Ensure efficient and scalable data ingestion processes Platform Development & Testing Contribute to the development and enhancement of the central data platform Ensure the platform evolves alongside changing business requirements Conduct regular testing to maintain system performance and stability Troubleshoot and resolve platform issues when necessary Platform Maintenance & Data Reliability Maintain the platform to ensure uninterrupted access to critical data Continuously verify the quality,