Principal Data Software Engineer (Databricks)
We are looking for a Principal Data Software Engineer who possesses expertise in Databricks and has a proactive, open‑minded approach. This role offers the opportunity to become a pivotal member of our expert team, making significant contributions in a collaborative environment.
Responsibilities
* Design, develop, and maintain scalable data pipelines and robust data architectures
* Optimize data models and ETL processes using Databricks and complementary technologies
* Implement data quality checks and monitoring systems to maintain high data integrity
* Stay current with emerging trends and technologies in data engineering, and advocate for the integration of new tools
* Troubleshoot and resolve data‑related issues efficiently
* Conduct code reviews to ensure high standards of code quality are maintained
* Drive technology initiatives, including designs, proof of concept, and research and development
* Streamline project processes to enhance data engineering practices
* Foster transparent and effective communication with team members and clients to justify and discuss technical solutions
Requirements
* Proven expertise in Spark, using either Scala or PySpark
* Strong background in data architecture, data modeling, and building ETL pipelines using Databricks
* Experience with multiple SDLC phases and technical leadership over complex implementations
* Proficiency in cloud‑native technologies and software engineering best practices including unit testing and linting
* Engineering background in at least one major cloud platform: AWS, Azure, or GCP
* Skillful in performance optimization for data‑intensive applications
* Keen on technological advancements and modernizing legacy systems
* Proven ability to present and advocate for technical solutions to stakeholders
* Independent problem‑solving skills and comfort with ambiguity
* Highly proactive with evident client‑facing experience
We Offer
* Private health insurance
* EPAM Employees Stock Purchase Plan
* 100% paid sick leave
* Referral Program
* Professional certification
* Language courses
Why Join EPAM
* WORK AND LIFE BALANCE – Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays.
* CONTINUOUS LEARNING CULTURE – Craft your personal Career Development Plan to align with your learning objectives. Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses.
* CLEAR AND DIFFERENT CAREER PATHS – Grow in engineering or managerial direction to become a People Manager, in‑depth technical specialist, Solution Architect, or Project/Delivery Manager.
* STRONG PROFESSIONAL COMMUNITY – Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends.
Seniority level
Mid‑Senior level
Employment type
Full‑time
Job function
Business Development, Information Technology, and Engineering
Industries
Software Development and IT Services and IT Consulting
#J-18808-Ljbffr