Swing-phase detection of locomotive mode transitions for smooth multi-functional robotic lower-limb prosthesis control.

Robotic lower-limb prostheses, with their actively powered joints, may significantly improve amputee users' mobility and enable them to obtain healthy-like gait in various modes of locomotion in daily life. However, timely recognition of the amputee users' locomotive mode and mode transition still remains a major challenge in robotic lower-limb prosthesis control. In the paper, the authors present a new multi-dimensional dynamic time warping (mDTW)-based intent recognizer to provide high-accuracy recognition of the locomotion mode/mode transition sufficiently early in the swing phase, such that the prosthesis' joint-level motion controller can operate in the correct locomotive mode and assist the user to complete the desired (and often power-demanding) motion in the stance phase. To support the intent recognizer development, the authors conducted a multi-modal gait data collection study to obtain the related sensor signal data in various modes of locomotion. The collected data were then segmented into individual cycles, generating the templates used in the mDTW classifier. Considering the large number of sensor signals available, we conducted feature selection to identify the most useful sensor signals as the input to the mDTW classifier. We also augmented the standard mDTW algorithm with a voting mechanism to make full use of the data generated from the multiple subjects. To validate the proposed intent recognizer, we characterized its performance using the data cumulated at different percentages of progression into the gait cycle (starting from the beginning of the swing phase). It was shown that the mDTW classifier was able to recognize three locomotive mode/mode transitions (walking, walking to stair climbing, and walking to stair descending) with 99.08% accuracy at 30% progression into the gait cycle, well before the stance phase starts. With its high performance, low computational load, and easy personalization (through individual template generation), the proposed mDTW intent recognizer may become a highly useful building block of a prosthesis control system to facilitate the robotic prostheses' real-world use among lower-limb amputees.

Smart Lacelock Sensor for the Balance Assessment of Community-Dwelling Older People.

This paper introduces a novel wearable shoe sensor named the Smart Lacelock Sensor. The sensor can be securely attached to the top of a shoe with laces and incorporates a loadcell to measure the force applied by the shoelace, providing valuable information related to ankle movement and foot loading. As the first step towards the automated balance assessment, this paper investigates the correlations between various levels of physical performance measured by the wearable Smart Lacelock Sensor and the SPPB clinical method in community-living older persons. 19 adults (age 76.84 ± 3.45 years), including those with and without recent fall history and SPPB score ranging from 4 to 12, participated in the study. The Smart Lacelock Sensor was attached to both shoes of each participant by skilled research staff, who then led them through the SPPB evaluation. The data obtained from the Smart Lacelock Sensors after the SPPB assessment were used to evaluate the deviation between the SPPB scores assigned by the research staff and the signals generated by the sensors for various participants. Results demonstrate that the standard deviation of the Smart Lacelock Sensor's loadcell response (both feet) for the side-by-side balance testing is significantly correlated (R2 = 0.68) with the SPPB score, demonstrating the capability of the Smart Lacelock Sensor in balance assessment.

Vision-Based Recognition of Human Motion Intent during Staircase Approaching.

Walking in real-world environments involves constant decision-making, e.g., when approaching a staircase, an individual decides whether to engage (climbing the stairs) or avoid. For the control of assistive robots (e.g., robotic lower-limb prostheses), recognizing such motion intent is an important but challenging task, primarily due to the lack of available information. This paper presents a novel vision-based method to recognize an individual's motion intent when approaching a staircase before the potential transition of motion mode (walking to stair climbing) occurs. Leveraging the egocentric images from a head-mounted camera, the authors trained a YOLOv5 object detection model to detect staircases. Subsequently, an AdaBoost and gradient boost (GB) classifier was developed to recognize the individual's intention of engaging or avoiding the upcoming stairway. This novel method has been demonstrated to provide reliable (97.69%) recognition at least 2 steps before the potential mode transition, which is expected to provide ample time for the controller mode transition in an assistive robot in real-world use.

Force-Moment Sensor for Prosthesis Structural Load Measurement.

Measurement of prosthesis structural load, as an important way to quantify the interaction of the amputee user with the environment, may serve important purposes in the control of smart lower-limb prosthetic devices. However, the majority of existing force sensors used in protheses are developed based on strain measurement and thus may suffer from multiple issues such as weak signals and signal drifting. To address these limitations, this paper presents a novel Force-Moment Prosthesis Load Sensor (FM-PLS) to measure the axial force and bending moment in the structure of a lower-limb prosthesis. Unlike strain gauge-based force sensors, the FM-PLS is developed based on the magnetic sensing of small (millimeter-scale) deflection of an elastic element, and it may provide stronger signals that are more robust against interferences and drifting since such physical deflection is several orders of magnitude greater than the strain of a typical load-bearing structure. The design of the sensor incorporates uniquely curved supporting surfaces such that the measurement is sensitive to light load but the sensor structure is robust enough to withstand heavy load without damage. To validate the sensor performance, benchtop testing of the FM-PLS and walking experiments of a FM-PLS-embedded robotic lower-limb prosthesis were conducted. Benchtop testing results displayed good linearity and a good match to the numerical simulation results. Results from the prosthesis walking experiments showed that the sensor signals can be used to detect important gaits events such as heel strike and toe-off, facilitating the reliable motion control of lower-limb prostheses.

A Lightweight Exoskeleton-Based Portable Gait Data Collection System.

For the controller of wearable lower-limb assistive devices, quantitative understanding of human locomotion serves as the basis for human motion intent recognition and joint-level motion control. Traditionally, the required gait data are obtained in gait research laboratories, utilizing marker-based optical motion capture systems. Despite the high accuracy of measurement, marker-based systems are largely limited to laboratory environments, making it nearly impossible to collect the desired gait data in real-world daily-living scenarios. To address this problem, the authors propose a novel exoskeleton-based gait data collection system, which provides the capability of conducting independent measurement of lower limb movement without the need for stationary instrumentation. The basis of the system is a lightweight exoskeleton with articulated knee and ankle joints. To minimize the interference to a wearer's natural lower-limb movement, a unique two-degrees-of-freedom joint design is incorporated, integrating a primary degree of freedom for joint motion measurement with a passive degree of freedom to allow natural joint movement and improve the comfort of use. In addition to the joint-embedded goniometers, the exoskeleton also features multiple positions for the mounting of inertia measurement units (IMUs) as well as foot-plate-embedded force sensing resistors to measure the foot plantar pressure. All sensor signals are routed to a microcontroller for data logging and storage. To validate the exoskeleton-provided joint angle measurement, a comparison study on three healthy participants was conducted, which involves locomotion experiments in various modes, including overground walking, treadmill walking, and sit-to-stand and stand-to-sit transitions. Joint angle trajectories measured with an eight-camera motion capture system served as the benchmark for comparison. Experimental results indicate that the exoskeleton-measured joint angle trajectories closely match those obtained through the optical motion capture system in all modes of locomotion (correlation coefficients of 0.97 and 0.96 for knee and ankle measurements, respectively), clearly demonstrating the accuracy and reliability of the proposed gait measurement system.

A Human-assistive Robotic Platform with Quadrupedal Locomotion.

Mobility impairment is becoming a challenging issue around the world with a rapid increase on aging population. Existing tools of walking assistance for mobility-impaired people include passive canes or wheeled rollators which increase energy consumption on the users and disturb the users' walking rhythm, and powered wheeled chairs which could preclude the muscle activities and accelerate the degeneration of the lower limbs. The research in this paper aiming at helping mobility-impaired people proposes a novel robotic platform with quadrupedal locomotion. With motorized actuation, the quadruped robotic platform could accompany the user at the center and provide protection and possible walking assistance if needed. As the robotic platform is equipped with a leg locomotion, it can enlarge the user's activity environments, such as both indoor flat floor and outdoor uneven terrain. It can even assist the user to involve in some mobility challenging activities, such as climbing stairs. In this paper, we illustrate the mechanical design of the robotic platform. A continuous gait planning is proposed to create a smooth locomotion for the robot. To quantify the performance, a system-level walking experimentation was conducted, and the results showed that quadruped robotic platform can maintain a statically stability which demonstrate the feasibility and capability of the robotic application for walking assistance.

Obtaining Natural Sit-to-Stand Motion with a Biomimetic Controller for Powered Knee Prostheses.

Standing up from a seated position is a common activity in people's daily life. However, for transfemoral (i.e., above-knee) amputees fitted with traditional passive prostheses, the sit-to-stand (STS) transition is highly challenging, due to the inability of the prosthetic joints in generating torque and power output. In this paper, the authors present a new STS control approach for powered lower limb prostheses, which is able to regulate the power delivery of the prosthetic knee joint to obtain natural STS motion similar to that displayed by healthy subjects. Mimicking the dynamic behavior of the knee in the STS, a unified control structure provides the desired control actions by combining an impedance function with a time-based ramp-up function. The former provides the gradual energy release behavior desired in the rising phase, while the latter provides the gradual energy injection behavior desired in the loading phase. This simple and intuitive control structure automates the transition between the two phases, eliminating the need for explicit phase transition and facilitating the implementation in powered prostheses. Human testing results demonstrated that this new control approach is able to generate a natural standing-up motion, which is well coordinated with the user's healthy-side motion in the STS process.