TU Darmstadt / ULB / TUbiblio

A Comparison of the Scalability of OpenMP Implementations

Jammer, Tim ; Iwainsky, Christian ; Bischof, Christian
Hrsg.: Malawsk, Maciej ; Krzysztof, Rzadca (2020)
A Comparison of the Scalability of OpenMP Implementations.
26th International Conference on Parallel and Distributed Computing (Euro-Par 2020). Virtual Conference (24.08.2020-28.08.2020)
doi: 10.1007/978-3-030-57675-2_6
Konferenzveröffentlichung, Bibliographie

Kurzbeschreibung (Abstract)

OpenMP implementations must exploit current and upcoming hardware for performance. Overhead must be controlled and kept to a minimum to avoid low performance at scale. Previous work has shown that overheads do not scale favourably in commonly used OpenMP implementations. Focusing on synchronization overhead, this work analyses the overhead of core OpenMP runtime library components for GNU and LLVM compilers, reflecting on the implementation's source code and algorithms. In addition, this work investigates the implementation's capability to handle current CPU-internal NUMA structure observed in recent Intel CPUs. Using a custom benchmark designed to expose synchronization overhead of OpenMP regardless of user code, substantial differences between both implementations are observed. In summary, the LLVM implementation can be considered more scalable than the GNU implementation, but the GNU implementation yields lower overhead for lower threadcounts in some occasions. Neither implementation reacts to the system architecture, although the effects of the internal NUMA structure on the overhead can be observed.

Typ des Eintrags: Konferenzveröffentlichung
Erschienen: 2020
Herausgeber: Malawsk, Maciej ; Krzysztof, Rzadca
Autor(en): Jammer, Tim ; Iwainsky, Christian ; Bischof, Christian
Art des Eintrags: Bibliographie
Titel: A Comparison of the Scalability of OpenMP Implementations
Sprache: Englisch
Publikationsjahr: 18 August 2020
Verlag: Springer
Buchtitel: European Conference on Parallel Processing
Veranstaltungstitel: 26th International Conference on Parallel and Distributed Computing (Euro-Par 2020)
Veranstaltungsort: Virtual Conference
Veranstaltungsdatum: 24.08.2020-28.08.2020
DOI: 10.1007/978-3-030-57675-2_6
URL / URN: https://link.springer.com/chapter/10.1007%2F978-3-030-57675-...
Kurzbeschreibung (Abstract):

OpenMP implementations must exploit current and upcoming hardware for performance. Overhead must be controlled and kept to a minimum to avoid low performance at scale. Previous work has shown that overheads do not scale favourably in commonly used OpenMP implementations. Focusing on synchronization overhead, this work analyses the overhead of core OpenMP runtime library components for GNU and LLVM compilers, reflecting on the implementation's source code and algorithms. In addition, this work investigates the implementation's capability to handle current CPU-internal NUMA structure observed in recent Intel CPUs. Using a custom benchmark designed to expose synchronization overhead of OpenMP regardless of user code, substantial differences between both implementations are observed. In summary, the LLVM implementation can be considered more scalable than the GNU implementation, but the GNU implementation yields lower overhead for lower threadcounts in some occasions. Neither implementation reacts to the system architecture, although the effects of the internal NUMA structure on the overhead can be observed.

Fachbereich(e)/-gebiet(e): 20 Fachbereich Informatik
20 Fachbereich Informatik > Scientific Computing
Zentrale Einrichtungen
Zentrale Einrichtungen > Hochschulrechenzentrum (HRZ)
Zentrale Einrichtungen > Hochschulrechenzentrum (HRZ) > Hochleistungsrechner
Hinterlegungsdatum: 27 Okt 2020 08:52
Letzte Änderung: 21 Jan 2021 13:02
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen