Your role: Join our dynamic team as a Data Engineer, where your expertise will drive impactful data solutions that enhance productivity and support data-driven decision-making across the organization. You will design and implement scalable data pipelines using PySpark and Palantir Foundry, integrating data from various systems such as SAP and LIMS to create usable formats for analytics. Your role will involve developing robust ETL/ELT processes for large-scale datasets in manufacturing, supply chain, and commercial operations. Collaborate with cross-functional teams to identify and drive data-related use cases, translating complex business contexts into actionable deliverables. By ensuring data quality, lineage, and performance through monitoring and automation, you will play a crucial part in delivering reliable data products. Additionally, you will develop front-end applications that eliminate manual processes and enhance user experience. Your contributions will not only streamline operations but also empower stakeholders with the insights they need to make informed decisions. If you're passionate about leveraging data to drive business outcomes and thrive in a collaborative environment, we want to hear from you!
Who you are:
* You have a minimum of 5 years of IT experience, with at least 5 years in Foundry or AWS development.
* You possess expertise in data modeling, ETL/ELT processes, and big data technologies such as Spark, Kafka, and Hadoop.
* You are skilled in advanced development using PySpark and Pandas within Foundry for sophisticated data processing.
* You have strong experience with cloud data warehouses and lakehouse frameworks.
* You are proficient in SQL, Python, and distributed data processing frameworks.
* You have a proven track record of delivering scalable and efficient data engineering solutions.
* You possess strong communication and problem-solving skills to bridge technical and business perspectives.
* You are willing to travel domestically and internationally (25% travel required).
#J-18808-Ljbffr