Search

Your search keyword '"nonblocking communication"' showing total 2 results
Start Over Descriptor "nonblocking communication"
2 results on '"nonblocking communication"'

1. Two-Stage Column Block Parallel LU Factorization Algorithm

Author

Rongteng Wu and Xiaohong Xie

Subjects
LU factorization, load balancing, nonblocking communication, parallel execution time, scalability, Electrical engineering. Electronics. Nuclear engineering, TK1-9971
Abstract

Parallel computing is increasingly important in computer architectures, parallel architecture has become ubiquitous in our everyday lives. Novel architectures and programming models pose new challenges to algorithm design and system software development. This paper presents a two-stage column block parallel LU factorization algorithm for multiple-processor architectures. Any given matrix is first partitioned into large blocks, and then, every large block is partitioned into a number of small blocks according to the number of processors. Finally, the small column blocks are allocated to processors in an orderly “serpentine arrangement.” Each iteration of the column block parallel LU factorization is separated into two stages of operation. In the first stage, the first-step factorization operation is processed in advance and nonblocking communication is used to reduce the processor idle and waiting time and improve parallelism. In the second stage, the large blocks are used to satisfy more powerful processors, such as GPUs, which require more data to exploit their computing capabilities. Experiments are conducted on a multicore system and multi-GPU system with different configurations to test the algorithm's performance. Compared with other related column block parallel LU factorizations, the two-stage algorithm exhibits better load balancing and parallel execution time performance.

Published
2020
Full Text
View/download PDF

2. PARCOACH Extension for Static MPI Nonblocking and Persistent Communication Validation

Author

Denis Barthou, Patrick Carribault, Julien Jaeger, Emmanuelle Saillard, Van Man Nguyen, Direction des Applications Militaires (DAM), Commissariat à l'énergie atomique et aux énergies alternatives (CEA), STatic Optimizations, Runtime Methods (STORM), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Laboratoire en Informatique Haute Performance pour le Calcul et la simulation (LIHPC), DAM Île-de-France (DAM/DIF), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Direction des Applications Militaires (DAM), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université Paris-Saclay, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)

Subjects
Computer science, Message passing, Static Analysis, Message Passing Interface, 020207 software engineering, 010103 numerical & computational mathematics, 02 engineering and technology, Parallel computing, Persistent Communication, Static analysis, Supercomputer, 01 natural sciences, Blocking (computing), Nonblocking Communication, Parallel programming model, 0202 electrical engineering, electronic engineering, information engineering, Overhead (computing), MPI, [INFO]Computer Science [cs], 0101 mathematics, Latency (engineering), Correctness, [INFO.INFO-DC]Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC]
Abstract

International audience; The Message Passing Interface (MPI) is a parallel programming model used to exchange data between working units in different nodes of a supercomputer. While MPI blocking operations return when the communication is complete, non-blocking and persistent operations return before the communication is complete, enabling a developer to hide communication latency. However the usage of these latter comes with additional rules the user has to abide to. This is error prone, which makes verification tools valuable for MPI program writers. PARCOACH is a framework that detects MPI collective errors using a static/dynamic analysis. The static phase studies the control-and data-flow of a program to detect potential errors while the dynamic phase uses compile-time information to verify the potential errors. In this paper we present an extension of PARCOACH static analysis to detect misuse of MPI nonblocking and persistent communications. Our new analysis adds the detection of four new error classes related to these types of communications.

Published
2020
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results