Lead Databricks Engineer (relocation to Cyprus) Join to apply for the Lead Databricks Engineer (relocation to Cyprus) role at EPAM Systems
Lead Databricks Engineer (relocation to Cyprus) 1 day ago Be among the first 25 applicants
Join to apply for the Lead Databricks Engineer (relocation to Cyprus) role at EPAM Systems
We are looking for a Lead Databricks Engineer with expertise in cloud infrastructure, big data processing, data integration and analytics, particularly with Azure.
In this role, you will play a crucial part in advancing our client's Data-Driven Company initiative within the insurance sector. Your role will involve designing and building robust data architecture to support various aspects of the client's business.
This position is integral to one of our projects in the client's Finance IT area, focusing on the integration component of their finance landscape. Proficiency in SQL and Azure Data Factory is essential for success in this role. Join us at our Cyprus office, which offers a flexible hybrid work setup. If you're ready to leverage your skills and perspective to make a significant impact, apply now and help us transform our data capabilities in the finance and insurance industries.
Responsibilities
Data integration, transformation and modeling
Serving large amounts of structured & semi-structured financial data
Analyze existing process logic
Implement best practices in data architecture, including security, governance, compliance and performance optimization
Optimize the data storage across Delta Lake for data management
Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity
Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization
Requirements
At least 5+ years of professional experience in the data engineering field
Proficiency in Azure Databricks, Delta Lake, Python and PySpark for data manipulation
Proficiency in designing and optimising pipelines using Azure Data Factory, including performance tuning and optimising data pipelines with Databricks Notebooks
Experience with Azure data platforms and related services
Good understanding of SQL and experience with relational database systems (e.g. MSSQL, PostgreSQL, Oracle DB)
Understanding data structures, data modelling and data architecture patterns (Data Lake, DWH, Data mesh, etc.)
Ability to work in an agile environment and eager to learn and develop new skills
Good problem-solving skills and attention to detail
Strong written and spoken English
Nice to have
Certifications in Azure data or Cloud Services (e.g., Azure Data Engineer Associate)
Business understanding of the insurance or financial domain
Experience with BI Tools (Power BI)
We offer
Global travel medical and accident insurance
Regular performance assessments
Family friendly initiatives
Learning and development opportunities including in-house training and coaching, professional certifications, over 22,000 courses on LinkedIn Learning Solutions and much more
*All benefits and perks are subject to certain eligibility requirements
Seniority level Seniority level Mid-Senior level
Employment type Employment type Full-time
Job function Job function Information Technology, Engineering, and Business Development
Industries Software Development and IT Services and IT Consulting
Referrals increase your chances of interviewing at EPAM Systems by 2x
Sign in to set job alerts for "Lead Software Engineer" roles. Senior Full-Stack Software Engineer (Remote) Greater Madrid Metropolitan Area 1 month ago
Greater Barcelona Metropolitan Area 1 month ago
Greater Madrid Metropolitan Area 1 month ago
Greater Barcelona Metropolitan Area 1 month ago
Senior Software Engineer - Python/MongoDB Senior Software Engineer - Age of Empires (Remote) Senior Software Engineer - Age of Empires (Remote) Madrid, Community of Madrid, Spain 1 month ago
Madrid, Community of Madrid, Spain 9 months ago
Senior Software Engineer - U.S. or EU (remote) Spain $150,000.00-$195,000.00 8 months ago
Madrid, Community of Madrid, Spain 3 days ago
Madrid, Community of Madrid, Spain 5 months ago
Madrid, Community of Madrid, Spain 3 weeks ago
Principal Software Engineer (Java)-Gaming Tech Senior Software Engineer - Front End - Remote (f/m) Madrid, Community of Madrid, Spain 2 weeks ago
Greater Madrid Metropolitan Area 6 months ago
Senior or Staff+ Software Engineer - Identity Senior Software Engineer, Organisations (Auth0) We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr