Lyra, Simon ; Mayer, Leon ; Ou, Liyang ; Chen, David ; Timms, Paddy ; Tay, Andrew ; Chan, Peter Y. ; Ganse, Bergita ; Leonhardt, Steffen ; Hoog Antink, Christoph (2024)
A Deep Learning-Based Camera Approach for Vital Sign Monitoring Using Thermography Images for ICU Patients.
In: Sensors, 2021, 21 (4)
doi: 10.26083/tuprints-00017784
Artikel, Zweitveröffentlichung, Verlagsversion
 | Es ist eine neuere Version dieses Eintrags verfügbar. |
Kurzbeschreibung (Abstract)
Infrared thermography for camera-based skin temperature measurement is increasingly used in medical practice, e.g., to detect fevers and infections, such as recently in the COVID-19 pandemic. This contactless method is a promising technology to continuously monitor the vital signs of patients in clinical environments. In this study, we investigated both skin temperature trend measurement and the extraction of respiration-related chest movements to determine the respiratory rate using low-cost hardware in combination with advanced algorithms. In addition, the frequency of medical examinations or visits to the patients was extracted. We implemented a deep learning-based algorithm for real-time vital sign extraction from thermography images. A clinical trial was conducted to record data from patients on an intensive care unit. The YOLOv4-Tiny object detector was applied to extract image regions containing vital signs (head and chest). The infrared frames were manually labeled for evaluation. Validation was performed on a hold-out test dataset of 6 patients and revealed good detector performance (0.75 intersection over union, 0.94 mean average precision). An optical flow algorithm was used to extract the respiratory rate from the chest region. The results show a mean absolute error of 2.69 bpm. We observed a computational performance of 47 fps on an NVIDIA Jetson Xavier NX module for YOLOv4-Tiny, which proves real-time capability on an embedded GPU system. In conclusion, the proposed method can perform real-time vital sign extraction on a low-cost system-on-module and may thus be a useful method for future contactless vital sign measurements.
| Typ des Eintrags: | Artikel |
|---|---|
| Erschienen: | 2024 |
| Autor(en): | Lyra, Simon ; Mayer, Leon ; Ou, Liyang ; Chen, David ; Timms, Paddy ; Tay, Andrew ; Chan, Peter Y. ; Ganse, Bergita ; Leonhardt, Steffen ; Hoog Antink, Christoph |
| Art des Eintrags: | Zweitveröffentlichung |
| Titel: | A Deep Learning-Based Camera Approach for Vital Sign Monitoring Using Thermography Images for ICU Patients |
| Sprache: | Englisch |
| Publikationsjahr: | 15 Januar 2024 |
| Ort: | Darmstadt |
| Publikationsdatum der Erstveröffentlichung: | 2021 |
| Ort der Erstveröffentlichung: | Basel |
| Verlag: | MDPI |
| Titel der Zeitschrift, Zeitung oder Schriftenreihe: | Sensors |
| Jahrgang/Volume einer Zeitschrift: | 21 |
| (Heft-)Nummer: | 4 |
| Kollation: | 18 Seiten |
| DOI: | 10.26083/tuprints-00017784 |
| URL / URN: | https://tuprints.ulb.tu-darmstadt.de/17784 |
| Zugehörige Links: | |
| Herkunft: | Zweitveröffentlichung DeepGreen |
| Kurzbeschreibung (Abstract): | Infrared thermography for camera-based skin temperature measurement is increasingly used in medical practice, e.g., to detect fevers and infections, such as recently in the COVID-19 pandemic. This contactless method is a promising technology to continuously monitor the vital signs of patients in clinical environments. In this study, we investigated both skin temperature trend measurement and the extraction of respiration-related chest movements to determine the respiratory rate using low-cost hardware in combination with advanced algorithms. In addition, the frequency of medical examinations or visits to the patients was extracted. We implemented a deep learning-based algorithm for real-time vital sign extraction from thermography images. A clinical trial was conducted to record data from patients on an intensive care unit. The YOLOv4-Tiny object detector was applied to extract image regions containing vital signs (head and chest). The infrared frames were manually labeled for evaluation. Validation was performed on a hold-out test dataset of 6 patients and revealed good detector performance (0.75 intersection over union, 0.94 mean average precision). An optical flow algorithm was used to extract the respiratory rate from the chest region. The results show a mean absolute error of 2.69 bpm. We observed a computational performance of 47 fps on an NVIDIA Jetson Xavier NX module for YOLOv4-Tiny, which proves real-time capability on an embedded GPU system. In conclusion, the proposed method can perform real-time vital sign extraction on a low-cost system-on-module and may thus be a useful method for future contactless vital sign measurements. |
| Freie Schlagworte: | camera-based vital sign measurement, infrared thermography, IRT, object detection, deep learning, optical flow, ICU monitoring |
| Status: | Verlagsversion |
| URN: | urn:nbn:de:tuda-tuprints-177840 |
| Zusätzliche Informationen: | This article belongs to the Special Issue Sensors and Methods for the Measurement of Cardiovascular and Respiratory Systems |
| Sachgruppe der Dewey Dezimalklassifikatin (DDC): | 600 Technik, Medizin, angewandte Wissenschaften > 610 Medizin, Gesundheit 600 Technik, Medizin, angewandte Wissenschaften > 621.3 Elektrotechnik, Elektronik |
| Fachbereich(e)/-gebiet(e): | 18 Fachbereich Elektrotechnik und Informationstechnik 18 Fachbereich Elektrotechnik und Informationstechnik > Künstlich intelligente Systeme der Medizin (KISMED) |
| Hinterlegungsdatum: | 15 Jan 2024 13:41 |
| Letzte Änderung: | 26 Feb 2024 16:18 |
| PPN: | |
| Export: | |
| Suche nach Titel in: | TUfind oder in Google |
Verfügbare Versionen dieses Eintrags
- A Deep Learning-Based Camera Approach for Vital Sign Monitoring Using Thermography Images for ICU Patients. (deposited 15 Jan 2024 13:41) [Gegenwärtig angezeigt]
 |
Frage zum Eintrag |
Optionen (nur für Redakteure)
 |
Redaktionelle Details anzeigen |
Drucken
Impressum