1. Container orchestration on HPC systems through Kubernetes
- Author
-
Zhou, Naweiluo, Georgiou, Yiannis, Pospieszny, Marcin, Zhong, Li, Zhou, Huan, Niethammer, Christoph, Pejak, Branislav, Marko, Oskar, and Hoppe, Dennis
- Subjects
lcsh:Computer engineering. Computer hardware ,Container orchestration ,Singularity ,Cloud computing ,HPC workload manager ,lcsh:TK7885-7895 ,Kubernetes ,lcsh:Electronic computers. Computer science ,Cloud computing, HPC workload manager, Container orchestration, TORQUE, Kubernetes, Singularity ,TORQUE ,lcsh:QA75.5-76.95 - Abstract
Containerisation demonstrates its efficiency in application deployment in Cloud Computing. Containers can encapsulate complex programs with their dependencies in isolated environments making applications more portable, hence are being adopted in High Performance Computing (HPC) clusters. Singularity, initially designed for HPC systems, has become their de facto standard container runtime. Nevertheless, conventional HPC workload managers lack micro-service support and deeply-integrated container management, as opposed to container orchestrators. We introduce a Torque-Operator which serves as a bridge between HPC workload manager (TORQUE) and container orchestrator (Kubernetes). We propose a hybrid architecture that integrates HPC and Cloud clusters seamlessly with little interference to HPC systems where container orchestration is performed on two levels., European Union’s Horizon 2020 research and innovation programme, Projekt DEAL
- Published
- 2023
- Full Text
- View/download PDF