Running Cloud-native Workloads on HPC with High-Performance Kubernetes
Abstract
The escalating complexity of applications and services encourages a shift towards higher-level data processing pipelines that integrate both Cloud-native and HPC steps into the same workflow. Cloud providers and HPC centers typically provide both execution platforms on separate resources. In this paper we explore a more practical design that enables running unmodified Cloud-native workloads directly on the main HPC cluster, avoiding resource partitioning and retaining the HPC center's existing job management and accounting policies.
- Publication:
-
arXiv e-prints
- Pub Date:
- September 2024
- DOI:
- 10.48550/arXiv.2409.16919
- arXiv:
- arXiv:2409.16919
- Bibcode:
- 2024arXiv240916919C
- Keywords:
-
- Computer Science - Distributed;
- Parallel;
- and Cluster Computing