Back to Search Start Over

A Checkpoint of Research on Parallel I/O for High-Performance Computing

Authors :
Philippe O. A. Navaux
Eduardo C. Inacio
Mario A. R. Dantas
Jean Luca Bez
Yves Denneulin
Francieli Zanon Boito
Universidade Federal do Rio Grande do Sul [Porto Alegre] (UFRGS)
Universidade Federal de Santa Catarina = Federal University of Santa Catarina [Florianópolis] (UFSC)
Data Aware Large Scale Computing (DATAMOVE )
Inria Grenoble - Rhône-Alpes
Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire d'Informatique de Grenoble (LIG )
Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])
Source :
ACM Computing Surveys, ACM Computing Surveys, Association for Computing Machinery, 2018, 51 (2), pp.23:1-23:35. ⟨10.1145/3152891⟩, ACM Computing Surveys, 2018, 51 (2), pp.23:1-23:35. ⟨10.1145/3152891⟩
Publication Year :
2018
Publisher :
Association for Computing Machinery (ACM), 2018.

Abstract

We present a comprehensive survey on parallel I/O in the high-performance computing (HPC) context. This is an important field for HPC because of the historic gap between processing power and storage latency, which causes application performance to be impaired when accessing or generating large amounts of data. As the available processing power and amount of data increase, I/O remains a central issue for the scientific community. In this survey article, we focus on a traditional I/O stack, with a POSIX parallel file system. We present background concepts everyone could benefit from. Moreover, through the comprehensive study of publications from the most important conferences and journals in a 5-year time window, we discuss the state of the art in I/O optimization approaches, access pattern extraction techniques, and performance modeling, in addition to general aspects of parallel I/O research. With this approach, we aim at identifying the general characteristics of the field and the main current and future research topics.

Details

ISSN :
15577341 and 03600300
Volume :
51
Database :
OpenAIRE
Journal :
ACM Computing Surveys
Accession number :
edsair.doi.dedup.....ac3894ec0d8d16d07306ef95340cdf4c
Full Text :
https://doi.org/10.1145/3152891