TU Darmstadt / ULB / TUbiblio

Unconstrained workout activity recognition on unmodified commercial off-the-shelf smartphones

Fu, Biying ; Kirchbuchner, Florian ; Kuijper, Arjan (2020)
Unconstrained workout activity recognition on unmodified commercial off-the-shelf smartphones.
13th ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA'20). Corfu, Greece (June 2020)
doi: 10.1145/3389189.3389195
Konferenzveröffentlichung, Bibliographie

Kurzbeschreibung (Abstract)

Smartphones have become an essential part of our lives. Especially its computing power and its current specifications make a modern smartphone even more powerful than the computers NASA used to send astronauts to the moon. Equipped with various integrated sensors, a modern smartphone can be leveraged for lots of smart applications. In this paper, we investigate the possibility of using a unmodified commercial off-the-shelf (COTS) smartphone to recognize 8 different workout exercises. App-based workout has become popular in the last few years. People do not need to go to the gym to practice. The advantage of using a mobile device is, that you can practice anywhere at anytime. In this work, we turned a COTS smartphone to an active sonar device to leverage the echo reflected from exercising movement close to the device. By conducting a test study with 14 participants performing these eight exercises, we show first results for cross person evaluation and the generalization ability of our inference models on unseen participants. A bidirectional LSTM model achieved an overall F1 score of 88.86 % for the cross subject case and 79.52 % for the holdout participants evaluation. Similar good results can be achieved by a VGG16 fine-tuned model in comparison to a 2D-CNN architecture trained from scratch.

Typ des Eintrags: Konferenzveröffentlichung
Erschienen: 2020
Autor(en): Fu, Biying ; Kirchbuchner, Florian ; Kuijper, Arjan
Art des Eintrags: Bibliographie
Titel: Unconstrained workout activity recognition on unmodified commercial off-the-shelf smartphones
Sprache: Englisch
Publikationsjahr: 2020
Verlag: ACM
Veranstaltungstitel: 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA'20)
Veranstaltungsort: Corfu, Greece
Veranstaltungsdatum: June 2020
DOI: 10.1145/3389189.3389195
Kurzbeschreibung (Abstract):

Smartphones have become an essential part of our lives. Especially its computing power and its current specifications make a modern smartphone even more powerful than the computers NASA used to send astronauts to the moon. Equipped with various integrated sensors, a modern smartphone can be leveraged for lots of smart applications. In this paper, we investigate the possibility of using a unmodified commercial off-the-shelf (COTS) smartphone to recognize 8 different workout exercises. App-based workout has become popular in the last few years. People do not need to go to the gym to practice. The advantage of using a mobile device is, that you can practice anywhere at anytime. In this work, we turned a COTS smartphone to an active sonar device to leverage the echo reflected from exercising movement close to the device. By conducting a test study with 14 participants performing these eight exercises, we show first results for cross person evaluation and the generalization ability of our inference models on unseen participants. A bidirectional LSTM model achieved an overall F1 score of 88.86 % for the cross subject case and 79.52 % for the holdout participants evaluation. Similar good results can be achieved by a VGG16 fine-tuned model in comparison to a 2D-CNN architecture trained from scratch.

Freie Schlagworte: Sensor data exploration, Mobile applications, Assistive technologies, Human action recognition
Fachbereich(e)/-gebiet(e): 20 Fachbereich Informatik
20 Fachbereich Informatik > Mathematisches und angewandtes Visual Computing
Hinterlegungsdatum: 26 Okt 2020 12:15
Letzte Änderung: 26 Okt 2020 12:15
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen