Binary Sensors-Based Privacy-Preserved Activity Recognition of Elderly Living Alone Using an RNN.

The recent growth of the elderly population has led to the requirement for constant home monitoring as solitary living becomes popular. This protects older people who live alone from unwanted instances such as falling or deterioration caused by some diseases. However, although wearable devices and camera-based systems can provide relatively precise information about human motion, they invade the privacy of the elderly. One way to detect the abnormal behavior of elderly residents under the condition of maintaining privacy is to equip the resident's house with an Internet of Things system based on a non-invasive binary motion sensor array. We propose to concatenate external features (previous activity and begin time-stamp) along with extracted features with a bi-directional long short-term memory (Bi-LSTM) neural network to recognize the activities of daily living with a higher accuracy. The concatenated features are classified by a fully connected neural network (FCNN). The proposed model was evaluated on open dataset from the Center for Advanced Studies in Adaptive Systems (CASAS) at Washington State University. The experimental results show that the proposed method outperformed state-of-the-art models with a margin of more than 6.25% of the F1 score on the same dataset.

Haptic Adaptive Feedback to Promote Motor Learning With a Robotic Ankle Exoskeleton Integrated With a Video Game.

Background: Robotic devices have been used to rehabilitate walking function after stroke. Although results suggest that post-stroke patients benefit from this non-conventional therapy, there is no agreement on the optimal robot-assisted approaches to promote neurorecovery. Here we present a new robotic therapy protocol using a grounded exoskeleton perturbing the ankle joint based on tacit learning control. Method: Ten healthy individuals and a post-stroke patient participated in the study and were enrolled in a pilot intervention protocol that involved performance of ankle movements following different trajectories via video game visual feedback. The system autonomously modulated task difficulty according to the performance to increase the challenge. We hypothesized that motor learning throughout training sessions would lead to increased corticospinal excitability of dorsi-plantarflexor muscles. Transcranial Magnetic Stimulation was used to assess the effects on corticospinal excitability. Results: Improvements have been observed on task performance and motor outcomes in both healthy individuals and post-stroke patient case study. Tibialis Anterior corticospinal excitability increased significantly after the training; however no significant changes were observed on Soleus corticospinal excitability. Clinical scales showed functional improvements in the stroke patient. Discussion and Significance: Our findings both in neurophysiological and performance assessment suggest improved motor learning. Some limitations of the study include treatment duration and intensity, as well as the non-significant changes in corticospinal excitability obtained for Soleus. Nonetheless, results suggest that this robotic training framework is a potentially interesting approach that can be explored for gait rehabilitation in post-stroke patients.

Motor Control System for Adaptation of Healthy Individuals and Recovery of Poststroke Patients: A Case Study on Muscle Synergies.

Understanding the complex neuromuscular strategies underlying behavioral adaptation in healthy individuals and motor recovery after brain damage is essential for gaining fundamental knowledge on the motor control system. Relying on the concept of muscle synergy, which indicates the number of coordinated muscles needed to accomplish specific movements, we investigated behavioral adaptation in nine healthy participants who were introduced to a familiar environment and unfamiliar environment. We then compared the resulting computed muscle synergies with those observed in 10 moderate-stroke survivors throughout an 11-week motor recovery period. Our results revealed that computed muscle synergy characteristics changed after healthy participants were introduced to the unfamiliar environment, compared with those initially observed in the familiar environment, and exhibited an increased neural response to unpredictable inputs. The altered neural activities dramatically adjusted through behavior training to suit the unfamiliar environment requirements. Interestingly, we observed similar neuromuscular behaviors in patients with moderate stroke during the follow-up period of their motor recovery. This similarity suggests that the underlying neuromuscular strategies for adapting to an unfamiliar environment are comparable to those used for the recovery of motor function after stroke. Both mechanisms can be considered as a recall of neural pathways derived from preexisting muscle synergies, already encoded by the brain's internal model. Our results provide further insight on the fundamental principles of motor control and thus can guide the future development of poststroke therapies.

Organization of functional modularity in sitting balance response and gait performance after stroke.

BACKGROUND: Recovery of postural adjustment, especially when seated, is important for performing activities of daily living after stroke. However, conventional clinical measures provide little insight into a common strategy for dynamic sitting balance and gait. We aimed to evaluate functional re-organization of posture and ambulatory performance after stroke. METHODS: The subjects of the study included 5 healthy men and 21 post-stroke patients. The spatiotemporal modular organization of ground reaction forces during a balance task in which the leg on the non-affected side was lifted off the ground while seated was quantified by using complex principal component analysis. FINDINGS: A 3% decrease in the temporal strength of the primary module in post-stroke patients was an independent predictor of gait performance in the hospital setting with high sensitivity and specificity. Tuning of the temporal strength was accompanied by the recovery of sitting and ambulation. INTERPRETATION: Our findings suggest that evaluation of the modular characteristics of ground reaction forces during a sitting balance task allows us to predict recovery and functional adaptation through daily physical rehabilitation.

Unobtrusive Activity Recognition of Elderly People Living Alone Using Anonymous Binary Sensors and DCNN.

Elderly population (over the age of 60) is predicted to be 1.2 billion by 2025. Most of the elderly people would like to stay alone in their own house due to the high eldercare cost and privacy invasion. Unobtrusive activity recognition is the most preferred solution for monitoring daily activities of the elderly people living alone rather than the camera and wearable devices based systems. Thus, we propose an unobtrusive activity recognition classifier using deep convolutional neural network (DCNN) and anonymous binary sensors that are passive infrared motion sensors and door sensors. We employed Aruba annotated open data set that was acquired from a smart home where a voluntary single elderly woman was living inside for eight months. First, ten basic daily activities, namely, Eating, Bed_to_Toilet, Relax, Meal_Preparation, Sleeping, Work, Housekeeping, Wash_Dishes, Enter_Home, and Leave_Home are segmented with different sliding window sizes, and then converted into binary activity images. Next, the activity images are employed as the ground truth for the proposed DCNN model. The 10-fold cross-validation evaluation results indicated that our proposed DCNN model outperforms the existing models with F1-score of 0.79 and 0.951 for all ten activities and eight activities (excluding Leave_Home and Wash_Dishes), respectively.

Generation of Human-Like Movement from Symbolized Information.

An important function missing from current robotic systems is a human-like method for creating behavior from symbolized information. This function could be used to assess the extent to which robotic behavior is human-like because it distinguishes human motion from that of human-made machines created using currently available techniques. The purpose of this research is to clarify the mechanisms that generate automatic motor commands to achieve symbolized behavior. We design a controller with a learning method called tacit learning, which considers system-environment interactions, and a transfer method called mechanical resonance mode, which transfers the control signals into a mechanical resonance mode space (MRM-space). We conduct simulations and experiments that involve standing balance control against disturbances with a two-degree-of-freedom inverted pendulum and bipedal walking control with humanoid robots. In the simulations and experiments on standing balance control, the pendulum can become upright after a disturbance by adjusting a few signals in MRM-space with tacit learning. In the simulations and experiments on bipedal walking control, the robots realize a wide variety of walking by manually adjusting a few signals in MRM-space. The results show that transferring the signals to an appropriate control space is the key process for reducing the complexity of the signals from the environment and achieving diverse behavior.

Biomechanical Reconstruction Using the Tacit Learning System: Intuitive Control of Prosthetic Hand Rotation.

Background: For mechanically reconstructing human biomechanical function, intuitive proportional control, and robustness to unexpected situations are required. Particularly, creating a functional hand prosthesis is a typical challenge in the reconstruction of lost biomechanical function. Nevertheless, currently available control algorithms are in the development phase. The most advanced algorithms for controlling multifunctional prosthesis are machine learning and pattern recognition of myoelectric signals. Despite the increase in computational speed, these methods cannot avoid the requirement of user consciousness and classified separation errors. "Tacit Learning System" is a simple but novel adaptive control strategy that can self-adapt its posture to environment changes. We introduced the strategy in the prosthesis rotation control to achieve compensatory reduction, as well as evaluated the system and its effects on the user. Methods: We conducted a non-randomized study involving eight prosthesis users to perform a bar relocation task with/without Tacit Learning System support. Hand piece and body motions were recorded continuously with goniometers, videos, and a motion-capture system. Findings: Reduction in the participants' upper extremity rotatory compensation motion was monitored during the relocation task in all participants. The estimated profile of total body energy consumption improved in five out of six participants. Interpretation: Our system rapidly accomplished nearly natural motion without unexpected errors. The Tacit Learning System not only adapts human motions but also enhances the human ability to adapt to the system quickly, while the system amplifies compensation generated by the residual limb. The concept can be extended to various situations for reconstructing lost functions that can be compensated.