Learning Activities of Daily Living from Unobtrusive Multimodal Wearables: Towards Monitoring Outpatient Rehabilitation.

Monitoring activities of daily living (ADLs) for wheelchair users, particularly spinal cord injury individuals is important for understanding the rehabilitation progress, customizing treatment plans, and observing the onset of secondary health conditions. This work proposes an innovative sensory system for measuring and classifying ADLs relevant to secondary health conditions. We systematically evaluated multiple wearable sensors such as pressure distribution mats on the wheelchair seat, accelerometer data from the ear and wrists, and IMU data from the wheelchair wheels to achieve the best unobtrusive combination of sensors that successfully distinguished ADLs. Our work resulted in an XGBoost classifier with a 20-second window size and extracted features in statistical, time, frequency, and wavelet domains, with an average class-wise F1 score of 82% (with only 3 out of 12 classes being mislabeled). Our study results demonstrate that the newly investigated modality of the bottom pressure mat emerges as the most relevant information source for recognizing ADLs, while heart and respiratory rates did not provide added value for the selected set of ADLs. The proposed sensory system and methodology proved high quality in most classes and easily extendable for long-term monitoring in outpatient rehabilitation, with the need for an extended database of activities.

Machine-Learning-Based Methodology for Estimation of Shoulder Load in Wheelchair-Related Activities Using Wearables.

There is a high prevalence of shoulder problems in manual wheelchair users (MWUs) with a spinal cord injury. How shoulder load relates to shoulder problems remains unclear. This study aimed to develop a machine-learning-based methodology to estimate the shoulder load in wheelchair-related activities of daily living using wearable sensors. Ten able-bodied participants equipped with five inertial measurement units (IMU) on their thorax, right arm, and wheelchair performed activities exemplary of daily life of MWUs. Electromyography (EMG) was recorded from the long head of the biceps and medial part of the deltoid. A neural network was trained to predict the shoulder load based on IMU and EMG data. Different cross-validation strategies, sensor setups, and model architectures were examined. The predicted shoulder load was compared to the shoulder load determined with musculoskeletal modeling. A subject-specific biLSTM model trained on a sparse sensor setup yielded the most promising results (mean correlation coefficient = 0.74 ± 0.14, relative root-mean-squared error = 8.93% ± 2.49%). The shoulder-load profiles had a mean similarity of 0.84 ± 0.10 over all activities. This study demonstrates the feasibility of using wearable sensors and neural networks to estimate the shoulder load in wheelchair-related activities of daily living.

Classification of Wheelchair Related Shoulder Loading Activities from Wearable Sensor Data: A Machine Learning Approach.

Shoulder problems (pain and pathology) are highly prevalent in manual wheelchair users with spinal cord injury. These problems lead to limitations in activities of daily life (ADL), labor- and leisure participation, and increase the health care costs. Shoulder problems are often associated with the long-term reliance on the upper limbs, and the accompanying "shoulder load". To make an estimation of daily shoulder load, it is crucial to know which ADL are performed and how these are executed in the free-living environment (in terms of magnitude, frequency, and duration). The aim of this study was to develop and validate methodology for the classification of wheelchair related shoulder loading ADL (SL-ADL) from wearable sensor data. Ten able bodied participants equipped with five Shimmer sensors on a wheelchair and upper extremity performed eight relevant SL-ADL. Deep learning networks using bidirectional long short-term memory networks were trained on sensor data (acceleration, gyroscope signals and EMG), using video annotated activities as the target. Overall, the trained algorithm performed well, with an accuracy of 98% and specificity of 99%. When reducing the input for training the network to data from only one sensor, the overall performance decreased to around 80% for all performance measures. The use of only forearm sensor data led to a better performance than the use of the upper arm sensor data. It can be concluded that a generalizable algorithm could be trained by a deep learning network to classify wheelchair related SL-ADL from the wearable sensor data.