TU Darmstadt / ULB / TUbiblio

Towards a Hybrid MPI Correctness Benchmark Suite

Jammer, Tim ; Hück, Alexander ; Lehr, Jan-Patrick ; Protze, Joachim ; Schwitanski, Simon ; Bischof, Christian (2022)
Towards a Hybrid MPI Correctness Benchmark Suite.
29th European MPI Users' Group Meeting. Chattanooga, USA (26.09.2022-28.09.2022)
doi: 10.1145/3555819.3555853
Konferenzveröffentlichung, Bibliographie

Kurzbeschreibung (Abstract)

High-performance computing codes often combine the Message-Passing Interface (MPI) with a shared-memory programming model, e.g., OpenMP, for efficient computations. These so-called hybrid models may issue MPI calls concurrently from different threads at the highest level of MPI thread support. The correct use of either MPI or OpenMP can be complex and error-prone. The hybrid model increases this complexity even further. While correctness analysis tools exist for both programming paradigms, for hybrid models, a new set of potential errors exist, whose detection requires combining knowledge of MPI and OpenMP primitives. Unfortunately, correctness tools do not fully support the hybrid model yet, and their current capabilities are also hard to assess. In previous work, to enable structured comparisons of correctness tools and improve their coverage, we proposed the MPI-CorrBench test suite for MPI. Likewise, others proposed the DataRaceBench test suite for OpenMP. However, for the particular error classes of the hybrid model, no such test suite exists. Hence, we propose a hybrid MPI-OpenMP test suite to (1) facilitate the correctness tool development in this area and, subsequently, (2) further encourage the use of the hybrid model at the highest level of MPI thread support. To that end, we discuss issues with this hybrid model and the knowledge correctness tools need to combine w.r.t. MPI and OpenMP to detect these. In our evaluation of two state-of-the-art correctness tools, we see that for most cases of concurrent and conflicting MPI operations, these tools can cope with the added complexity of OpenMP. However, more intricate errors, where user code interferes with MPI, e.g., a data race on a buffer, still evade tool analysis.

Typ des Eintrags: Konferenzveröffentlichung
Erschienen: 2022
Autor(en): Jammer, Tim ; Hück, Alexander ; Lehr, Jan-Patrick ; Protze, Joachim ; Schwitanski, Simon ; Bischof, Christian
Art des Eintrags: Bibliographie
Titel: Towards a Hybrid MPI Correctness Benchmark Suite
Sprache: Englisch
Publikationsjahr: 14 September 2022
Ort: New York, NY
Verlag: ACM
Buchtitel: EuroMPI/USA'22: Proceedings of the 29th European MPI Users' Group Meeting
Veranstaltungstitel: 29th European MPI Users' Group Meeting
Veranstaltungsort: Chattanooga, USA
Veranstaltungsdatum: 26.09.2022-28.09.2022
DOI: 10.1145/3555819.3555853
Kurzbeschreibung (Abstract):

High-performance computing codes often combine the Message-Passing Interface (MPI) with a shared-memory programming model, e.g., OpenMP, for efficient computations. These so-called hybrid models may issue MPI calls concurrently from different threads at the highest level of MPI thread support. The correct use of either MPI or OpenMP can be complex and error-prone. The hybrid model increases this complexity even further. While correctness analysis tools exist for both programming paradigms, for hybrid models, a new set of potential errors exist, whose detection requires combining knowledge of MPI and OpenMP primitives. Unfortunately, correctness tools do not fully support the hybrid model yet, and their current capabilities are also hard to assess. In previous work, to enable structured comparisons of correctness tools and improve their coverage, we proposed the MPI-CorrBench test suite for MPI. Likewise, others proposed the DataRaceBench test suite for OpenMP. However, for the particular error classes of the hybrid model, no such test suite exists. Hence, we propose a hybrid MPI-OpenMP test suite to (1) facilitate the correctness tool development in this area and, subsequently, (2) further encourage the use of the hybrid model at the highest level of MPI thread support. To that end, we discuss issues with this hybrid model and the knowledge correctness tools need to combine w.r.t. MPI and OpenMP to detect these. In our evaluation of two state-of-the-art correctness tools, we see that for most cases of concurrent and conflicting MPI operations, these tools can cope with the added complexity of OpenMP. However, more intricate errors, where user code interferes with MPI, e.g., a data race on a buffer, still evade tool analysis.

Fachbereich(e)/-gebiet(e): 20 Fachbereich Informatik
20 Fachbereich Informatik > Scientific Computing
Hinterlegungsdatum: 19 Okt 2022 12:06
Letzte Änderung: 16 Mär 2023 09:44
PPN: 506074234
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen