EEG-based BCI for the linear control of an upper-limb neuroprosthesis.

Assistive technologies help patients to reacquire interacting capabilities with the environment and improve their quality of life. In this manuscript we present a feasibility study in which healthy users were able to use a non-invasive Motor Imagery (MI)-based brain computer interface (BCI) to achieve linear control of an upper-limb functional electrical stimulation (FES) controlled neuro-prosthesis. The linear control allowed the real-time computation of a continuous control signal that was used by the FES system to physically set the stimulation parameters to control the upper-limb position. Even if the nature of the task makes the operation very challenging, the participants achieved a mean selection accuracy of 82.5% in a target selection experiment. An analysis of limb kinematics as well as the positioning precision was performed, showing the viability of using a BCI-FES system to control upper-limb reaching movements. The results of this study constitute an accurate use of an online non-invasive BCI to operate a FES-neuroprosthesis setting a step toward the recovery of the control of an impaired limb with the sole use of brain activity.

Feedback control of arm movements using Neuro-Muscular Electrical Stimulation (NMES) combined with a lockable, passive exoskeleton for gravity compensation.

Within the European project MUNDUS, an assistive framework was developed for the support of arm and hand functions during daily life activities in severely impaired people. This contribution aims at designing a feedback control system for Neuro-Muscular Electrical Stimulation (NMES) to enable reaching functions in people with no residual voluntary control of the arm and shoulder due to high level spinal cord injury. NMES is applied to the deltoids and the biceps muscles and integrated with a three degrees of freedom (DoFs) passive exoskeleton, which partially compensates gravitational forces and allows to lock each DOF. The user is able to choose the target hand position and to trigger actions using an eyetracker system. The target position is selected by using the eyetracker and determined by a marker-based tracking system using Microsoft Kinect. A central controller, i.e., a finite state machine, issues a sequence of basic movement commands to the real-time arm controller. The NMES control algorithm sequentially controls each joint angle while locking the other DoFs. Daily activities, such as drinking, brushing hair, pushing an alarm button, etc., can be supported by the system. The robust and easily tunable control approach was evaluated with five healthy subjects during a drinking task. Subjects were asked to remain passive and to allow NMES to induce the movements. In all of them, the controller was able to perform the task, and a mean hand positioning error of less than five centimeters was achieved. The average total time duration for moving the hand from a rest position to a drinking cup, for moving the cup to the mouth and back, and for finally returning the arm to the rest position was 71 s.

A myocontrolled neuroprosthesis integrated with a passive exoskeleton to support upper limb activities.

This work aimed at designing a myocontrolled arm neuroprosthesis for both assistive and rehabilitative purposes. The performance of an adaptive linear prediction filter and a high-pass filter to estimate the volitional EMG was evaluated on healthy subjects (N=10) and neurological patients (N=8) during dynamic hybrid biceps contractions. A significant effect of filter (p=0.017 for healthy; p<0.001 for patients) was obtained. The post hoc analysis revealed that for both groups only the adaptive filter was able to reliably detect the presence of a small volitional contribution. An on/off non-linear controller integrated with an exoskeleton for weight support was developed. The controller allowed the patient to activate/deactivate the stimulation intensity based on the residual EMG estimated by the adaptive filter. Two healthy subjects and 3 people with Spinal Cord Injury were asked to flex the elbow while tracking a trapezoidal target with and without myocontrolled-NMES support. Both healthy subjects and patients easily understood how to use the controller in a single session. Two patients reduced their tracking error by more than 60% with NMES support, while the last patient obtained a tracking error always comparable to the healthy subjects performance (<4°). This study proposes a reliable and feasible solution to combine NMES with voluntary effort.

MUNDUS project: MUltimodal neuroprosthesis for daily upper limb support.

BACKGROUND: MUNDUS is an assistive framework for recovering direct interaction capability of severely motor impaired people based on arm reaching and hand functions. It aims at achieving personalization, modularity and maximization of the user's direct involvement in assistive systems. To this, MUNDUS exploits any residual control of the end-user and can be adapted to the level of severity or to the progression of the disease allowing the user to voluntarily interact with the environment. MUNDUS target pathologies are high-level spinal cord injury (SCI) and neurodegenerative and genetic neuromuscular diseases, such as amyotrophic lateral sclerosis, Friedreich ataxia, and multiple sclerosis (MS). The system can be alternatively driven by residual voluntary muscular activation, head/eye motion, and brain signals. MUNDUS modularly combines an antigravity lightweight and non-cumbersome exoskeleton, closed-loop controlled Neuromuscular Electrical Stimulation for arm and hand motion, and potentially a motorized hand orthosis, for grasping interactive objects. METHODS: The definition of the requirements and of the interaction tasks were designed by a focus group with experts and a questionnaire with 36 potential end-users. RESULTS: The functionality of all modules has been successfully demonstrated. User's intention was detected with a 100% success. Averaging all subjects and tasks, the minimum evaluation score obtained was 1.13 ± 0.99 for the release of the handle during the drinking task, whilst all the other sub-actions achieved a mean value above 1.6. All users, but one, subjectively perceived the usefulness of the assistance and could easily control the system. Donning time ranged from 6 to 65 minutes, scaled on the configuration complexity. CONCLUSIONS: The MUNDUS platform provides functional assistance to daily life activities; the modules integration depends on the user's need, the functionality of the system have been demonstrated for all the possible configurations, and preliminary assessment of usability and acceptance is promising.

An EMG-controlled neuroprosthesis for daily upper limb support: a preliminary study.

MUNDUS is an assistive platform for recovering direct interaction capability of severely impaired people based on upper limb motor functions. Its main concept is to exploit any residual control of the end-user, thus being suitable for long term utilization in daily activities. MUNDUS integrates multimodal information (EMG, eye tracking, brain computer interface) to control different actuators, such as a passive exoskeleton for weight relief, a neuroprosthesis for arm motion and small motors for grasping. Within this project, the present work integreted a commercial passive exoskeleton with an EMG-controlled neuroprosthesis for supporting hand-to-mouth movements. Being the stimulated muscle the same from which the EMG was measured, first it was necessary to develop an appropriate digital filter to separate the volitional EMG and the stimulation response. Then, a control method aimed at exploiting as much as possible the residual motor control of the end-user was designed. The controller provided a stimulation intensity proportional to the volitional EMG. An experimental protocol was defined to validate the filter and the controller operation on one healthy volunteer. The subject was asked to perform a sequence of hand-to-mouth movements holding different loads. The movements were supported by both the exoskeleton and the neuroprosthesis. The filter was able to detect an increase of the volitional EMG as the weight held by the subject increased. Thus, a higher stimulation intensity was provided in order to support a more intense exercise. The study demonstrated the feasibility of an EMG-controlled neuroprosthesis for daily upper limb support on healthy subjects, providing a first step forward towards the development of the final MUNDUS platform.