TU Darmstadt / ULB / TUbiblio

Influence of Noisy Environments on Behavior of HPC Applications

Nikitenko, Dmitry A. ; Wolf, Felix ; Mohr, Bernd ; Hoefler, Torsten ; Stefanov, Konstantin S. ; Voevodin, Vadim Vladimirovich ; Antonov, Aleksandr Sergeevich ; Calotoiu, Alexandru (2021)
Influence of Noisy Environments on Behavior of HPC Applications.
In: Lobachevskii Journal of Mathematics, 42 (7)
doi: 10.1134/S1995080221070192
Artikel, Bibliographie

Kurzbeschreibung (Abstract)

Many contemporary HPC systems expose their jobs to substantial amounts of interference, leading to significant run-to-run variation. For example, application runtimes on Theta, a Cray XC40 system at Argonne National Laboratory, vary by up to 70, caused by a mix of node-level and system-level effects, including network and file-system congestion in the presence of concurrently running jobs. This makes performance measurements generally irreproducible, heavily complicating performance analysis and modeling. On noisy systems, performance analysts usually have to repeat performance measurements several times and then apply statistics to capture trends. First, this is expensive and, second, extracting trends from a limited series of experiments is far from trivial, as the noise can follow quite irregular patterns. Attempts to learn from performance data how a program would perform under different execution configurations experience serious perturbation, resulting in models that reflect noise rather than intrinsic application behavior. On the other hand, although noise heavily influences execution time and energy consumption, it does not change the computational effort a program performs. Effort metrics that count how many operations a machine executes on behalf of a program, such as floating-point operations, the exchange of MPI messages, or file reads and writes, remain largely unaffected and—rare non-determinism set aside—reproducible. This paper addresses initial stage of an ExtraNoise project, which is aimed at revealing and tackling key questions of system noise influence on HPC applications.

Typ des Eintrags: Artikel
Erschienen: 2021
Autor(en): Nikitenko, Dmitry A. ; Wolf, Felix ; Mohr, Bernd ; Hoefler, Torsten ; Stefanov, Konstantin S. ; Voevodin, Vadim Vladimirovich ; Antonov, Aleksandr Sergeevich ; Calotoiu, Alexandru
Art des Eintrags: Bibliographie
Titel: Influence of Noisy Environments on Behavior of HPC Applications
Sprache: Englisch
Publikationsjahr: 9 August 2021
Verlag: Springer
Titel der Zeitschrift, Zeitung oder Schriftenreihe: Lobachevskii Journal of Mathematics
Jahrgang/Volume einer Zeitschrift: 42
(Heft-)Nummer: 7
DOI: 10.1134/S1995080221070192
Kurzbeschreibung (Abstract):

Many contemporary HPC systems expose their jobs to substantial amounts of interference, leading to significant run-to-run variation. For example, application runtimes on Theta, a Cray XC40 system at Argonne National Laboratory, vary by up to 70, caused by a mix of node-level and system-level effects, including network and file-system congestion in the presence of concurrently running jobs. This makes performance measurements generally irreproducible, heavily complicating performance analysis and modeling. On noisy systems, performance analysts usually have to repeat performance measurements several times and then apply statistics to capture trends. First, this is expensive and, second, extracting trends from a limited series of experiments is far from trivial, as the noise can follow quite irregular patterns. Attempts to learn from performance data how a program would perform under different execution configurations experience serious perturbation, resulting in models that reflect noise rather than intrinsic application behavior. On the other hand, although noise heavily influences execution time and energy consumption, it does not change the computational effort a program performs. Effort metrics that count how many operations a machine executes on behalf of a program, such as floating-point operations, the exchange of MPI messages, or file reads and writes, remain largely unaffected and—rare non-determinism set aside—reproducible. This paper addresses initial stage of an ExtraNoise project, which is aimed at revealing and tackling key questions of system noise influence on HPC applications.

Freie Schlagworte: DFG|449683531, DFG, 449683531
Fachbereich(e)/-gebiet(e): 20 Fachbereich Informatik
20 Fachbereich Informatik > Parallele Programmierung
Hinterlegungsdatum: 20 Mär 2024 13:33
Letzte Änderung: 06 Jun 2024 10:52
PPN: 518869598
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen