Back to Search Start Over

Distributed filesystems (GPFS, CephFS and Lustre-ZFS) deployment on Kubernetes/Docker clusters

Authors :
V. Sapunenko
Daniele Cesini
A Prosperini
Federico Fornari
A. Cavalli
Antonio Falabella
Enrico Fattibene
Lucia Morganti
Source :
Proceedings of International Symposium on Grids & Clouds 2021 — PoS(ISGC2021).
Publication Year :
2021
Publisher :
Sissa Medialab, 2021.

Abstract

Nowadays Kubernetes has become a powerful tool to deploy and manage containerized applications. Modern datacenters need distributed filesystems to provide user applications with access to stored data on a large number of nodes. The possibility to mount a distributed filesystem and exploit its native application programming interfaces in a Docker container, combined with the advanced orchestration features provided by Kubernetes, may enhance flexibility in data management, installation, running and monitoring of transfer services. Moreover, it would allow the execution of dedicated services on different nodes, in isolated and automatically replicable environments, so to improve deployment efficiency and fail-safeness. The goal of this work is to demonstrate the feasibility of using Kubernetes and Docker to setup clients capable to access a distributed filesystem from existing clusters and to create clusters based on containerized servers. Despite being just a proof of concept, the effort has shown the possibility of using different types of distributed filesystems (GPFS, CephFS, Lustre-ZFS) with equally positive results.

Details

Database :
OpenAIRE
Journal :
Proceedings of International Symposium on Grids & Clouds 2021 — PoS(ISGC2021)
Accession number :
edsair.doi...........35433b81197586edd3b6518ae63b6bc4