Your browser doesn't support javascript.
A Deep Learning-Based Camera Approach for Vital Sign Monitoring Using Thermography Images for ICU Patients.
Lyra, Simon; Mayer, Leon; Ou, Liyang; Chen, David; Timms, Paddy; Tay, Andrew; Chan, Peter Y; Ganse, Bergita; Leonhardt, Steffen; Hoog Antink, Christoph.
  • Lyra S; Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany.
  • Mayer L; Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany.
  • Ou L; Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany.
  • Chen D; Eastern Health Clinical School, Monash University Melbourne, Box Hill, VIC 3128, Australia.
  • Timms P; Eastern Health Clinical School, Monash University Melbourne, Box Hill, VIC 3128, Australia.
  • Tay A; Eastern Health Clinical School, Monash University Melbourne, Box Hill, VIC 3128, Australia.
  • Chan PY; Eastern Health Clinical School, Monash University Melbourne, Box Hill, VIC 3128, Australia.
  • Ganse B; Research Centre for Musculoskeletal Science and Sports Medicine, Manchester Metropolitan University, Manchester M1 5GD, UK.
  • Leonhardt S; Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany.
  • Hoog Antink C; Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany.
Sensors (Basel) ; 21(4)2021 Feb 21.
Article in English | MEDLINE | ID: covidwho-1112769
ABSTRACT
Infrared thermography for camera-based skin temperature measurement is increasingly used in medical practice, e.g., to detect fevers and infections, such as recently in the COVID-19 pandemic. This contactless method is a promising technology to continuously monitor the vital signs of patients in clinical environments. In this study, we investigated both skin temperature trend measurement and the extraction of respiration-related chest movements to determine the respiratory rate using low-cost hardware in combination with advanced algorithms. In addition, the frequency of medical examinations or visits to the patients was extracted. We implemented a deep learning-based algorithm for real-time vital sign extraction from thermography images. A clinical trial was conducted to record data from patients on an intensive care unit. The YOLOv4-Tiny object detector was applied to extract image regions containing vital signs (head and chest). The infrared frames were manually labeled for evaluation. Validation was performed on a hold-out test dataset of 6 patients and revealed good detector performance (0.75 intersection over union, 0.94 mean average precision). An optical flow algorithm was used to extract the respiratory rate from the chest region. The results show a mean absolute error of 2.69 bpm. We observed a computational performance of 47 fps on an NVIDIA Jetson Xavier NX module for YOLOv4-Tiny, which proves real-time capability on an embedded GPU system. In conclusion, the proposed method can perform real-time vital sign extraction on a low-cost system-on-module and may thus be a useful method for future contactless vital sign measurements.
Subject(s)
Keywords

Full text: Available Collection: International databases Database: MEDLINE Main subject: Thermography / Vital Signs / Deep Learning / Intensive Care Units Type of study: Experimental Studies / Prognostic study / Randomized controlled trials Limits: Humans Language: English Year: 2021 Document Type: Article Affiliation country: S21041495

Similar

MEDLINE

...
LILACS

LIS


Full text: Available Collection: International databases Database: MEDLINE Main subject: Thermography / Vital Signs / Deep Learning / Intensive Care Units Type of study: Experimental Studies / Prognostic study / Randomized controlled trials Limits: Humans Language: English Year: 2021 Document Type: Article Affiliation country: S21041495