Principal Data Engineer
Department:
Technology:
Data TechnologyEmployment Type:
Permanent - Full TimeLocation:
London or Manchester UK
Description
About us
We're Transform.
We turn data and tech into competitive advantage and social impact for the world's most complex organisations, both public and private.
Organisations like Toyota, the Cabinet Office, Transport for London, Public Health England, Historic Royal Palaces, HM Courts and Tribunal Service, Santander, Department for Education and Domino’s. To name but a few.
We're not here to generate more business for ourselves. We're here to create startling, ambitious outcomes for clients - leaving them with the capabilities they need to take it from there.
We love creating real change. Making a big impact on people's lives. Optimising services, driving business growth or realising social change.
To do that, we built an inclusive, high-performance culture where the world's most talented people do the best work of their careers.
That's what gets us out of bed every day. We hope you feel the same.
We're part of the Next 15 group, a multi-national organisation spanning over 25 brands. Brands like ours, looking to stand out from the crowd as they deliver best in class work for their clients. Find out more at:
www.TransformUK.Com
The Role:
The Principal Data Engineer will be responsible for working as part of an Agile delivery squad and will lead other data engineers and senior data engineers. Working to deliver data engineering pipelines and metadata driven data engineering frameworks on a range of data products for use in insight, reporting and analytics including AI, working closely with product owners, business analysts, data architects, data analysts, delivery projects managers and data scientists.Key Responsibilities
Managing quality of own and teams’ outputs as well as mentoring the team3-5 years’ experience as a Lead/Principal Data Engineer ensuring quality outcomesAbility to lead data engineering development activities to meet client needs and able to communicate at a business level with senior key stakeholdersAbility to explain complex technical data engineering processes and concepts with business users and strong communication skillsDelivering data engineering solutions on a range of complex data sources, data integrations and used for marketing and research processesWorking with clients to understand needs, and best implement that with our available technology solutionsWorking with a range of data sources such as CRM, customer, product, sales, Finance, research and HR data.Building Single Customer Views, CDPs or Data Warehouses/Data Lakes to merge disparate data sets for marketing or sales activationBuilding and configuring data ingestion methods from APIs, flat files, streaming, public data sources and survey data with metadata driven reusable components and design patters
Skills, Knowledge and Expertise
Must have experience of using Azure Databricks and Medallion architectureExpert experience with Azure Data Factory or Python/Airflow and a range of associated libraries for data processing and manipulationExperience with a range of database technologies including data lakes such as Azure SQL, SQL Server, Azure Data Lake, PostgreSQL, Snowflake, MySQL, Cosmos DB or Mongo DBUnderstanding of Azure DevOps and CI/CD processesKnowledge of data warehouse or data lakes with SCVs or in conjunction with CDP platformsKnowledge of data ingestion of streaming data using Databricks and PysparkUnderstanding and application of statistical methodsAbility to lead multiple teams, and to work well as part of, a team using the agile methodologyDesirable Skills:
Knowledge of ELT/ETL tools such as Informatica DEI/BDM and Talend would be beneficialExperience of mentoring junior to mid-level Data Engineers would be beneficial
Our culture and our benefits
Being one team;
looking out for each other as a teamThe world never stops changing and we’ll never stop learningInfinity & Beyond;
we’re crazy ambitious, not afraid to fail along the way (it’s just falling with style)Integrity is everything;
we’re honest with each other and with our clientsDiversity is our superpower;
everyone’s story is different, and we celebrate differencesWe’re all in;
we take on tough, complex challenges with lots of moving parts and we’re committed to the work, our clients and each other
Our benefits include:
Holiday entitlement, 28 days with the option to buy/sell up to 5 daysDay off (on or in the week of) your birthdayPension eligibility, up to 5% matched contributionsPrivate healthcareLife assuranceEnhanced maternity and enhanced paternity and shared parental leaveCycle to work & electric car schemesGym & retail discountsRegular social events/activitiesA range of other benefits from our flexible benefits packageAt Transform we believe in a
culture of inclusivity, we
celebrate difference
and believe that diversity makes our business more
relevant, our work more
meaningful
and our people more
empowered. We’re committed to equality of opportunity for all, and we actively seek applications from all ethnicities, orientations, beliefs, gender identities + those with neurodiverse traits and disabilities. We want you to have the
best opportunity
to show us who you are and what you can do. Please do let us know
if you need any adjustments
now or at any point in the recruitment process.
If this sounds like you, please get in touch to discuss in more detail.
Use of AI in CV and InterviewsWhilst we are a technology company and promote using AI the right and ethical way, we value authenticity and transparency in our hiring process. To ensure fairness and accuracy in assessing your skills and experience, we kindly request that you refrain from using AI-assisted tools to generate answers during interviews or enhancing your CV.We are looking for genuine insights into your abilities, experiences, and personality. Any misrepresentation through AI-generated content may impact our ability to make an informed decision. We look forward to getting to know the real you!#J-18808-Ljbffr