Back to Search
Start Over
A Checkpoint of Research on Parallel I/O for High-Performance Computing
- Source :
- ACM Computing Surveys, ACM Computing Surveys, Association for Computing Machinery, 2018, 51 (2), pp.23:1-23:35. ⟨10.1145/3152891⟩, ACM Computing Surveys, 2018, 51 (2), pp.23:1-23:35. ⟨10.1145/3152891⟩
- Publication Year :
- 2018
- Publisher :
- Association for Computing Machinery (ACM), 2018.
-
Abstract
- We present a comprehensive survey on parallel I/O in the high-performance computing (HPC) context. This is an important field for HPC because of the historic gap between processing power and storage latency, which causes application performance to be impaired when accessing or generating large amounts of data. As the available processing power and amount of data increase, I/O remains a central issue for the scientific community. In this survey article, we focus on a traditional I/O stack, with a POSIX parallel file system. We present background concepts everyone could benefit from. Moreover, through the comprehensive study of publications from the most important conferences and journals in a 5-year time window, we discuss the state of the art in I/O optimization approaches, access pattern extraction techniques, and performance modeling, in addition to general aspects of parallel I/O research. With this approach, we aim at identifying the general characteristics of the field and the main current and future research topics.
- Subjects :
- File system
storage systems
020203 distributed computing
General Computer Science
Computer science
Distributed computing
ACM: D.: Software/D.4: OPERATING SYSTEMS/D.4.2: Storage Management
02 engineering and technology
Supercomputer
computer.software_genre
Parallel I/O
020202 computer hardware & architecture
Theoretical Computer Science
high performance computing
POSIX
Time windows
0202 electrical engineering, electronic engineering, information engineering
Parallel file systems
ACM: D.: Software/D.4: OPERATING SYSTEMS/D.4.3: File Systems Management
[INFO.INFO-DC]Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC]
Latency (engineering)
computer
ComputingMilieux_MISCELLANEOUS
Subjects
Details
- ISSN :
- 15577341 and 03600300
- Volume :
- 51
- Database :
- OpenAIRE
- Journal :
- ACM Computing Surveys
- Accession number :
- edsair.doi.dedup.....ac3894ec0d8d16d07306ef95340cdf4c
- Full Text :
- https://doi.org/10.1145/3152891