About us
For more than 20 years, our global network of passionate technologists and pioneering craftspeople has delivered cutting-edge technology and game-changing consulting to companies on the brink of AI driven digital transformation. Since 2001, we have grown into a full service digital consulting company with 5500+ professionals working on a worldwide ambition. Driven by the desire to make a difference, we keep innovating. Fuelling the growth of our company with our knowledge worker culture. When teaming up with Xebia, expect in-depth expertise based on an authentic, value-led, and high quality way of working that inspires all we do.
At Xebia, we put ‘People First’—committed to attracting diverse talent and fostering an inclusive, respectful workplace where everyone is valued for their contributions. We welcome all individuals and evaluate solely on the quality of their work and teamwork.
About the Role
As a Senior DevOps-HPC Engineer at Xebia, you will join a dynamic Engineering team in a high-energy and collaborative environment. This role is ideal for a seasoned HPC engineer with deep expertise in SLURM, Linux, and cloud migration expertise in SLURM, Linux, and cloud migrations, who thrives on leading complex projects, designing robust architectures, and implementing high-performance solutions in Google Cloud.
Responsibilities:
Lead the migration of on-premises SLURM-based HPC clusters to Google Cloud Platform.
Design, implement, and manage scalable and secure HPC infrastructure solutions on GCP.
Optimize SLURM configurations and workflows to ensure efficient use of cloud resources.
Manage and optimize HPC environments, focusing on workload scheduling, job efficiency, and scaling SLURM clusters.
Automate cluster deployment, configuration, and maintenance tasks using scripting languages (Python, Bash) and automation tools (Ansible, Terraform).
Integrate HPC software stack using tools like Spack for dependency management and easy installation of HPC libraries and applications.
Deploy, manage, and troubleshoot applications using MPI, OpenMP, and other parallel computing frameworks on GCP instances.
Collaborate with engineering, support teams, and stakeholders to ensure smooth migration and ongoing operation of HPC workloads.
Provide expert-level support for performance tuning, job scheduling, and cluster resource optimization.
Stay current with emerging HPC technologies and GCP services to continually improve HPC cluster performance and cost efficiency.
Expertise on HPC
Requirements:
Basics:
Minimum 5 years of experience with HPC environments, including SLURM workload manager, MPI, and other HPC-related software.
Extensive hands-on experience managing Linux-based systems, including performance tuning and troubleshooting in an HPC context.
Proven experience migrating and managing SLURM clusters in cloud environments, preferably GCP.
Proficiency with automation tools such as Ansible and Terraform for cluster deployment and management.
Experience with Spack for managing and deploying HPC software stacks.
Strong scripting skills in Python, Bash, or similar languages for automating cluster operations.
In-depth knowledge of GCP services relevant to HPC, such as Compute Engine (GCE), Cloud Storage, and VPC networking.
Strong problem-solving skills with a focus on optimizing HPC workloads and resource utilization.
Recommended:
Google Cloud Professional DevOps Engineer or similar GCP certifications.
Familiarity with GCP’s HPC-specific offerings, such as Preemptible VMs, HPC VM images, and other cost-optimization strategies.
Experience with performance profiling and debugging tools for HPC applications.
Advanced knowledge of HPC data management strategies, including parallel file systems and data transfer tools.
Understanding of container technologies (e.g., Singularity, Docker) specifically within HPC contexts.
Experience with Spark or other big data tools in an HPC environment is a plus.
Focusing now on modules/libs migration, so expertise on Spack containers,
Pipelines (GHA)