Overview
Lead Data Software Engineer (Spark/Scala/Databricks) role at EPAM Systems. We are looking for a team player with excellent communication and organizational skills, mastery in engineering and English fluency (B2+/C1) to communicate with stakeholders and contribute to data solutions.
Responsibilities
* Develop, monitor, and operate the most used and most critical curated data pipeline at the client (Sales Order Data, including post-order information such as shipment, return, and payment).
* Consult with analysts, data scientists, and product managers to build and continuously improve the \"Single Source of Truth\" KPI for business steering (e.g., central Profit Contribution measurement).
* Redevelop legacy pipelines to modern, maintainable, scalable versions.
* Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala.
Requirements
* Expertise in Apache Spark and Spark streaming.
* Hands-on experience with Databricks and Delta Lake.
* Fluency in the Scala programming language.
* Expertise in SQL.
* Understanding and hands-on experience with CI/CD.
* Extensive experience with GitHub.
* Fluency working with AWS landscape.
* Ability to build Apache Airflow pipelines.
Nice to have
* Presto
* Superset
* Starburst
* Oracle & Exasol
We offer
* Private health insurance
* EPAM Employees Stock Purchase Plan
* 100% paid sick leave
* Referral Program
* Professional certification
* Language courses
About EPAM
EPAM is a leading digital transformation services and product engineering company with 61,700+ EPAMers in 55+ countries and regions. Since 1993, our multidisciplinary teams have been helping make the future real for our clients and communities around the world. In 2018, we opened an office in Spain that grew to over 1,450 EPAMers across Málaga, Madrid, Cáceres and remote locations. Here you will collaborate with multinational teams, contribute to innovative projects, and have opportunities to learn and grow continuously.
Application information
Referrals increase your chances of interviewing at EPAM Systems. Get notified about new Lead Software Engineer jobs in Madrid, Community of Madrid, Spain.
#J-18808-Ljbffr