TU Darmstadt / ULB / TUbiblio

DFI: The Data Flow Interface for High-Speed Networks

Thostrup, Lasse ; Skrzypczak, Jan ; Jasny, Matthias ; Ziegler, Tobias ; Binnig, Carsten (2021):
DFI: The Data Flow Interface for High-Speed Networks.
In: SIGMOD/PODS '21: Proceedings of the 2021 International Conference on Management of Data, pp. 1825-1837,
ACM, SIGMOD/PODS '21: International Conference on Management of Data, virtual Conference, 20.-25.06.2021, ISBN 978-1-4503-8343-1,
DOI: 10.1145/3448016.3452816,
[Conference or Workshop Item]

Abstract

In this paper, we propose the Data Flow Interface (DFI) as a way to make it easier for data processing systems to exploit high-speed networks without the need to deal with the complexity of RDMA. By lifting the level of abstraction, DFI factors out much of the complexity of network communication and makes it easier for developers to declaratively express how data should be efficiently routed to accomplish a given distributed data processing task. As we show in our experiments, DFI is able to support a wide variety of data-centric applications with high performance at a low complexity for the applications.

Item Type: Conference or Workshop Item
Erschienen: 2021
Creators: Thostrup, Lasse ; Skrzypczak, Jan ; Jasny, Matthias ; Ziegler, Tobias ; Binnig, Carsten
Title: DFI: The Data Flow Interface for High-Speed Networks
Language: English
Abstract:

In this paper, we propose the Data Flow Interface (DFI) as a way to make it easier for data processing systems to exploit high-speed networks without the need to deal with the complexity of RDMA. By lifting the level of abstraction, DFI factors out much of the complexity of network communication and makes it easier for developers to declaratively express how data should be efficiently routed to accomplish a given distributed data processing task. As we show in our experiments, DFI is able to support a wide variety of data-centric applications with high performance at a low complexity for the applications.

Book Title: SIGMOD/PODS '21: Proceedings of the 2021 International Conference on Management of Data
Publisher: ACM
ISBN: 978-1-4503-8343-1
Uncontrolled Keywords: dm, dm_maki, dm_funding_521-15350
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Data Management
TU-Projects: DFG|SFB1053|SFB1053 TPZ Steinmet
Event Title: SIGMOD/PODS '21: International Conference on Management of Data
Event Location: virtual Conference
Event Dates: 20.-25.06.2021
Date Deposited: 13 Jul 2021 08:38
DOI: 10.1145/3448016.3452816
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Send an inquiry Send an inquiry

Options (only for editors)
Show editorial Details Show editorial Details