We are seeking a skilled and experienced Software Engineer to join our team, focusing on the Customer Data Platform (CDP). This role is crucial in building and maintaining the data infrastructure that powers our personalized customer experiences. As a Data Engineer, you will be responsible for managing integrations with 3rd party systems, developing and maintaining ETL processes, and ensuring the reliability and performance of our data orchestration pipelines. You will collaborate closely with cross-functional teams, including product owners, data analysts, and other engineers, to ensure data quality, integrity, and accessibility. Your work will enable data-driven decision-making and drive impactful marketing outcomes across Mars Petcare.
Key Responsibilities:
3rd Party System Integrations: Design, develop, and manage integrations between the CDP and various 3rd party systems, ensuring seamless data flow and compatibility.
ETL Development and Management: Design, build, and maintain efficient and scalable ETL processes to extract, transform, and load data from diverse sources into the CDP.
Data Orchestration Pipeline Management: Develop, manage, and optimize data orchestration pipelines using tools like Digdag, ensuring reliable and timely data delivery.
Data Pipeline Validation and Testing: Develop and execute comprehensive test plans to validate the accuracy and performance of data orchestration pipelines
CDP Instance Maintenance: Perform general maintenance and troubleshooting of the CDP instance, ensuring optimal performance and stability.
Data Quality and Governance: Implement data quality checks, validation processes, and data governance policies to ensure data accuracy, consistency, and compliance.
Performance Optimization: Optimize data pipelines and queries for performance and efficiency, ensuring timely data delivery for business needs.
Collaboration and Communication: Collaborate with product owners, data analysts, and other engineers to understand data requirements and deliver effective solutions. Communicate technical concepts and findings clearly to both technical and non-technical stakeholders.
Documentation: Create and maintain technical documentation as needed for data pipelines, data models, and data processes, etc.
Setup and configure data source authentications
Implement and manage data ingestion processes from multiple sources
Assist in setting up and maintaining the customer unification workflows
Set up and manage the parent segment
Assist in validating and testing segment creation processes
MUST HAVE
Proficiency in SQL: Expert-level knowledge and experience in writing complex SQL queries and optimizing database performance.
Proficiency in Python: Strong programming skills in Python for data manipulation, automation, and scripting.
Experience with Digdag: Hands-on experience with Digdag for building and managing data orchestration pipelines.
Experience managing 3rd party system integrations: Proven ability to design and implement integrations with various external systems.
Strong understanding of ETL processes and data warehousing concepts.
Experience building and maintaining data pipelines.
Understanding of data integration and data governance principles.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Experience with Agile methodologies.
Understanding of data privacy regulations.
Experience working with Customer Data Platforms (CDPs)
Understanding of data warehousing concepts and data modeling techniques.
NICE TO HAVE
Experience with cloud-based data platforms (e.g., Azure).
Experience with real-time data processing and streaming technologies.
Experience working in a global, multi-brand company.
Relevant certifications in data engineering or cloud platforms.
What can you expect from Mars?
Work with diverse and talented Associates, all guided by the Five Principles.
Join a purpose driven company, where we’re striving to build the world we want tomorrow, today.
Best-in-class learning and development support from day one, including access to our in-house Mars University.
An industry competitive salary and benefits package, including company bonus.
#TBDDT
Mars is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law. If you need assistance or an accommodation during the application process because of a disability, it is available upon request. The company is pleased to provide such assistance, and no applicant will be penalized as a result of such a request.