TU Darmstadt / ULB / TUbiblio

Influence of Noisy Environments on Behavior of HPC Applications

Nikitenko, Dmitry A. ; Wolf, Felix ; Mohr, Bernd ; Hoefler, Torsten ; Stefanov, Konstantin S. ; Voevodin, Vadim Vladimirovich ; Antonov, Aleksandr Sergeevich ; Calotoiu, Alexandru (2021)
Influence of Noisy Environments on Behavior of HPC Applications.
In: Lobachevskii Journal of Mathematics, 42 (7)
doi: 10.1134/S1995080221070192
Article, Bibliographie

Abstract

Many contemporary HPC systems expose their jobs to substantial amounts of interference, leading to significant run-to-run variation. For example, application runtimes on Theta, a Cray XC40 system at Argonne National Laboratory, vary by up to 70, caused by a mix of node-level and system-level effects, including network and file-system congestion in the presence of concurrently running jobs. This makes performance measurements generally irreproducible, heavily complicating performance analysis and modeling. On noisy systems, performance analysts usually have to repeat performance measurements several times and then apply statistics to capture trends. First, this is expensive and, second, extracting trends from a limited series of experiments is far from trivial, as the noise can follow quite irregular patterns. Attempts to learn from performance data how a program would perform under different execution configurations experience serious perturbation, resulting in models that reflect noise rather than intrinsic application behavior. On the other hand, although noise heavily influences execution time and energy consumption, it does not change the computational effort a program performs. Effort metrics that count how many operations a machine executes on behalf of a program, such as floating-point operations, the exchange of MPI messages, or file reads and writes, remain largely unaffected and—rare non-determinism set aside—reproducible. This paper addresses initial stage of an ExtraNoise project, which is aimed at revealing and tackling key questions of system noise influence on HPC applications.

Item Type: Article
Erschienen: 2021
Creators: Nikitenko, Dmitry A. ; Wolf, Felix ; Mohr, Bernd ; Hoefler, Torsten ; Stefanov, Konstantin S. ; Voevodin, Vadim Vladimirovich ; Antonov, Aleksandr Sergeevich ; Calotoiu, Alexandru
Type of entry: Bibliographie
Title: Influence of Noisy Environments on Behavior of HPC Applications
Language: English
Date: 9 August 2021
Publisher: Springer
Journal or Publication Title: Lobachevskii Journal of Mathematics
Volume of the journal: 42
Issue Number: 7
DOI: 10.1134/S1995080221070192
Abstract:

Many contemporary HPC systems expose their jobs to substantial amounts of interference, leading to significant run-to-run variation. For example, application runtimes on Theta, a Cray XC40 system at Argonne National Laboratory, vary by up to 70, caused by a mix of node-level and system-level effects, including network and file-system congestion in the presence of concurrently running jobs. This makes performance measurements generally irreproducible, heavily complicating performance analysis and modeling. On noisy systems, performance analysts usually have to repeat performance measurements several times and then apply statistics to capture trends. First, this is expensive and, second, extracting trends from a limited series of experiments is far from trivial, as the noise can follow quite irregular patterns. Attempts to learn from performance data how a program would perform under different execution configurations experience serious perturbation, resulting in models that reflect noise rather than intrinsic application behavior. On the other hand, although noise heavily influences execution time and energy consumption, it does not change the computational effort a program performs. Effort metrics that count how many operations a machine executes on behalf of a program, such as floating-point operations, the exchange of MPI messages, or file reads and writes, remain largely unaffected and—rare non-determinism set aside—reproducible. This paper addresses initial stage of an ExtraNoise project, which is aimed at revealing and tackling key questions of system noise influence on HPC applications.

Uncontrolled Keywords: DFG|449683531, DFG, 449683531
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Parallel Programming
Date Deposited: 20 Mar 2024 13:33
Last Modified: 06 Jun 2024 10:52
PPN: 518869598
Export:
Suche nach Titel in: TUfind oder in Google
Send an inquiry Send an inquiry

Options (only for editors)
Show editorial Details Show editorial Details