István, Zsolt ; Sidler, David ; Alonso, Gustavo ; Vukolic, Marko (2016)
Consensus in a Box: Inexpensive Coordination in Hardware.
13th USENIX Symposium on Networked Systems Design and Implementation. Santa Clara, USA (16.-18.03.2016)
Konferenzveröffentlichung, Bibliographie
Kurzbeschreibung (Abstract)
Consensus mechanisms for ensuring consistency are some of the most expensive operations in managing large amounts of data. Often, there is a trade off that involves reducing the coordination overhead at the price of accepting possible data loss or inconsistencies. As the demand for more efficient data centers increases, it is important to provide better ways of ensuring consistency without affecting performance. In this paper we show that consensus (atomic broadcast) can be removed from the critical path of performance by moving it to hardware. As a proof of concept, we implement Zookeeper’s atomic broadcast at the network level using an FPGA. Our design uses both TCP and an application specific network protocol. The design can be used to push more value into the network, e.g., by extending the functionality of middleboxes or adding inexpensive consensus to in-network processing nodes. To illustrate how this hardware consensus can be used in practical systems, we have combined it with a mainmemory key value store running on specialized microservers (built as well on FPGAs). This results in a distributed service similar to Zookeeper that exhibits high and stable performance. This work can be used as a blueprint for further specialized designs.
| Typ des Eintrags: | Konferenzveröffentlichung |
|---|---|
| Erschienen: | 2016 |
| Autor(en): | István, Zsolt ; Sidler, David ; Alonso, Gustavo ; Vukolic, Marko |
| Art des Eintrags: | Bibliographie |
| Titel: | Consensus in a Box: Inexpensive Coordination in Hardware |
| Sprache: | Englisch |
| Publikationsjahr: | 16 März 2016 |
| Verlag: | USENIX Association |
| Buchtitel: | Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI ’16) |
| Veranstaltungstitel: | 13th USENIX Symposium on Networked Systems Design and Implementation |
| Veranstaltungsort: | Santa Clara, USA |
| Veranstaltungsdatum: | 16.-18.03.2016 |
| URL / URN: | https://www.usenix.org/conference/nsdi16/technical-sessions/... |
| Kurzbeschreibung (Abstract): | Consensus mechanisms for ensuring consistency are some of the most expensive operations in managing large amounts of data. Often, there is a trade off that involves reducing the coordination overhead at the price of accepting possible data loss or inconsistencies. As the demand for more efficient data centers increases, it is important to provide better ways of ensuring consistency without affecting performance. In this paper we show that consensus (atomic broadcast) can be removed from the critical path of performance by moving it to hardware. As a proof of concept, we implement Zookeeper’s atomic broadcast at the network level using an FPGA. Our design uses both TCP and an application specific network protocol. The design can be used to push more value into the network, e.g., by extending the functionality of middleboxes or adding inexpensive consensus to in-network processing nodes. To illustrate how this hardware consensus can be used in practical systems, we have combined it with a mainmemory key value store running on specialized microservers (built as well on FPGAs). This results in a distributed service similar to Zookeeper that exhibits high and stable performance. This work can be used as a blueprint for further specialized designs. |
| Fachbereich(e)/-gebiet(e): | 20 Fachbereich Informatik 20 Fachbereich Informatik > Distributed and Networked Systems |
| Hinterlegungsdatum: | 23 Jan 2023 12:12 |
| Letzte Änderung: | 23 Jan 2023 12:12 |
| PPN: | |
| Export: | |
| Suche nach Titel in: | TUfind oder in Google |
 |
Frage zum Eintrag |
Optionen (nur für Redakteure)
 |
Redaktionelle Details anzeigen |
Drucken
Impressum