A Comparison of Approaches for Segmenting the Reaching and Targeting Motion Primitives in Functional Upper Extremity Reaching Tasks.

There is growing interest in the kinematic analysis of human functional upper extremity movement (FUEM) for applications such as health monitoring and rehabilitation. Deconstructing functional movements into activities, actions, and primitives is a necessary procedure for many of these kinematic analyses. Advances in machine learning have led to progress in human activity and action recognition. However, their utility for analyzing the FUEM primitives of reaching and targeting during reach-to-grasp and reach-to-point tasks remains limited. Domain experts use a variety of methods for segmenting the reaching and targeting motion primitives, such as kinematic thresholds, with no consensus on what methods are best to use. Additionally, current studies are small enough that segmentation results can be manually inspected for correctness. As interest in FUEM kinematic analysis expands, such as in the clinic, the amount of data needing segmentation will likely exceed the capacity of existing segmentation workflows used in research laboratories, requiring new methods and workflows for making segmentation less cumbersome. This paper investigates five reaching and targeting motion primitive segmentation methods in two different domains (haptics simulation and real world) and how to evaluate these methods. This work finds that most of the segmentation methods evaluated perform reasonably well given current limitations in our ability to evaluate segmentation results. Furthermore, we propose a method to automatically identify potentially incorrect segmentation results for further review by the human evaluator. Clinical impact: This work supports efforts to automate aspects of processing upper extremity kinematic data used to evaluate reaching and grasping, which will be necessary for more widespread usage in clinical settings.

Computer-assisted approaches for measuring, segmenting, and analyzing functional upper extremity movement: a narrative review of the current state, limitations, and future directions.

The analysis of functional upper extremity (UE) movement kinematics has implications across domains such as rehabilitation and evaluating job-related skills. Using movement kinematics to quantify movement quality and skill is a promising area of research but is currently not being used widely due to issues associated with cost and the need for further methodological validation. Recent developments by computationally-oriented research communities have resulted in potentially useful methods for evaluating UE function that may make kinematic analyses easier to perform, generally more accessible, and provide more objective information about movement quality, the importance of which has been highlighted during the COVID-19 pandemic. This narrative review provides an interdisciplinary perspective on the current state of computer-assisted methods for analyzing UE kinematics with a specific focus on how to make kinematic analyses more accessible to domain experts. We find that a variety of methods exist to more easily measure and segment functional UE movement, with a subset of those methods being validated for specific applications. Future directions include developing more robust methods for measurement and segmentation, validating these methods in conjunction with proposed kinematic outcome measures, and studying how to integrate kinematic analyses into domain expert workflows in a way that improves outcomes.

A comparison of compensatory movements between body-powered and myoelectric prosthesis users during activities of daily living.

BACKGROUND: People with upper limb absence use compensatory movements to accommodate lack of motion in the prosthetic hand. The purpose of this study was to determine if the type of prosthesis used (i.e. body-powered or myoelectric) affects compensatory movements during activities of daily living. METHODS: Twelve transradial body-powered and/or myoelectric prosthesis users performed up to six unimanual and bimanual activities of daily living. Trunk range of motion and peak upper limb angles for each task were compared between prostheses. FINDINGS: Compensatory movement generally did not differ based on prosthesis type. However, body-powered users had increased trunk lateral lean compared to myoelectric users during a deodorant application task (P = 0.025). Body-powered users also had increased trunk axial rotation (P = 0.048) and decreased shoulder elevation (P = 0.046) when transferring a box between shelves. Compensatory movements were not systematically correlated with duration of prosthesis ownership, socket comfort, or terminal device type. INTERPRETATION: A prosthesis user's compensatory movements may depend on other factors beyond whether the prosthesis terminal device is actuated through body-powered or myoelectric mechanisms. Further exploration of the factors that influence joint kinematics in prosthesis users may inform future prosthesis prescription practices and help patients become successful users.

First Demonstration of Functional Task Performance Using a Sonomyographic Prosthesis: A Case Study.

Ultrasound-based sensing of muscle deformation, known as sonomyography, has shown promise for accurately classifying the intended hand grasps of individuals with upper limb loss in offline settings. Building upon this previous work, we present the first demonstration of real-time prosthetic hand control using sonomyography to perform functional tasks. An individual with congenital bilateral limb absence was fitted with sockets containing a low-profile ultrasound transducer placed over forearm muscle tissue in the residual limbs. A classifier was trained using linear discriminant analysis to recognize ultrasound images of muscle contractions for three discrete hand configurations (rest, tripod grasp, index finger point) under a variety of arm positions designed to cover the reachable workspace. A prosthetic hand mounted to the socket was then controlled using this classifier. Using this real-time sonomyographic control, the participant was able to complete three functional tasks that required selecting different hand grasps in order to grasp and move one-inch wooden blocks over a broad range of arm positions. Additionally, these tests were successfully repeated without retraining the classifier across 3 hours of prosthesis use and following simulated donning and doffing of the socket. This study supports the feasibility of using sonomyography to control upper limb prostheses in real-world applications.

Classification Performance and Feature Space Characteristics in Individuals With Upper Limb Loss Using Sonomyography.

Objective: Sonomyography, or ultrasound-based sensing of muscle deformation, is an emerging modality for upper limb prosthesis control. Although prior studies have shown that individuals with upper limb loss can achieve successful motion classification with sonomyography, it is important to better understand the time-course over which proficiency develops. In this study, we characterized user performance during their initial and subsequent exposures to sonomyography. Method: Ultrasound images corresponding to a series of hand gestures were collected from individuals with transradial limb loss under three scenarios: during their initial exposure to sonomyography (Experiment 1), during a subsequent exposure to sonomyography where they were provided biofeedback as part of a training protocol (Experiment 2), and during testing sessions held on different days (Experiment 3). User performance was characterized by offline classification accuracy, as well as metrics describing the consistency and separability of the sonomyography signal patterns in feature space. Results: Classification accuracy was high during initial exposure to sonomyography (96.2 ± 5.9%) and did not systematically change with the provision of biofeedback or on different days. Despite this stable classification performance, some of the feature space metrics changed. Conclusions: User performance was strong upon their initial exposure to sonomyography and did not improve with subsequent exposure. Clinical Impact: Prosthetists may be able to quickly assess if a patient will be successful with sonomyography without submitting them to an extensive training protocol, leading to earlier socket fabrication and delivery.

Recommendations for the Successful Implementation of Upper Limb Prosthetic Technology.

Despite the numerous prosthetic hand designs that are commercially available, people with upper limb loss still frequently report dissatisfaction and abandonment. Over the past decade there have been numerous advances in prosthetic design, control, sensation, and device attachment. Each offers the potential to enhance function and satisfaction, but most come at high costs and involve surgical risks. Here, we discuss potential barriers and solutions to promote the widespread use of novel prosthetic technology. With appropriate reimbursement, multidisciplinary care teams, device-specific rehabilitation, and patient and clinician education, such technology has the potential to revolutionize the field and improve patient outcomes.

Differences in quality of movements made with body-powered and myoelectric prostheses during activities of daily living.

BACKGROUND: Upper limb prostheses likely do not enable movements having the same kinematic characteristics as anatomical limbs. The quality of movements made using body-powered and myoelectric prostheses may further differ based on the availability of sensory feedback and method of terminal device actuation. The purpose of this work was to compare the quality of movements made with body-powered and myoelectric prostheses during activities of daily living. METHODS: Nine transradial body-powered and/or myoelectric prosthesis users and nine controls without limb loss performed six activities of daily living. Movement quality, defined as duration, straightness, and smoothness, for the reaching and manipulation phases was compared between prostheses, as well as prostheses and anatomical limbs. FINDINGS: The quality of reaching movements were generally similar between prostheses. However, movements with body-powered prostheses were slower (P = 0.007) and less smooth (P < 0.001) when reaching to a deodorant stick and movements with myoelectric prostheses were slower when reaching to place a pin on a corkboard (P = 0.023). Movements with myoelectric prostheses were slower (P ≤ 0.021) and less smooth (P ≤ 0.012) than those with body-powered prostheses during object manipulation, but these differences were not present for all tasks. Movements with prostheses were slower, more curved, and less smooth compared to those with anatomical limbs. INTERPRETATION: Differences in the quality of movements made with body-powered and myoelectric prostheses primarily occur during object manipulation, rather than reaching. These differences do not exist for all tasks, suggesting that neither prosthesis type offers an absolute advantage in terms of movement quality.

Characterizing Functional Upper Extremity Movement in Haptic Virtual Environments.

Haptic virtual environments have been used to assess cognitive and fine motor function. For tasks performed in physical environments, upper extremity movement is usually separated into reaching and object manipulation phases using fixed velocity thresholds. However, these thresholds can result in premature segmentation due to additional trajectory adjustments common in virtual environments. In this work, we address the issues of premature segmentation and the lack of a measure to characterize the spatial distribution of a trajectory while targeting an object. We propose a combined relative distance and velocity segmentation procedure and use principal component analysis (PCA) to capture the spatial distribution of the participant's targeting phase. Synthetic data and 3D motion data from twenty healthy adults were used to evaluate the methods with positive results. We found that these methods quantify motor skill improvement of healthy participants performing repeated trials of a haptic virtual environment task.

Sonomyography Combined with Vibrotactile Feedback Enables Precise Target Acquisition Without Visual Feedback.

Upper limb prosthesis users currently lack haptic feedback from their terminal devices, which significantly limits their ability to meaningfully interact with their environment. Users therefore rely heavily on visual feedback when using terminal devices. Previously, it has been shown that force-related feedback from an end-effector or virtual environment can help the user minimize errors and improve performance. Currently, myoelectric control systems enable the user to control the velocity of terminal devices. We have developed a novel control method using ultrasound sensing, called sonomyography, that enables position control based on mechanical deformation of muscles. In this paper, we investigated whether the proprioceptive feedback from muscle deformation combined with vibrotactile haptic feedback can minimize the need for visual feedback. Able bodied subjects used sonomyography to control a virtual cursor, and performed a target acquisition task. The effect of visual and haptic feedback on performance of a target acquisition task was systematically tested. We found that subjects made large errors when they tried to reacquire a target without visual feedback, but in the presence of real-time haptic feedback, the precision of the target position improved, and were similar to when visual feedback was used for target acquisition. This result has implications for improving the performance of prosthetic control systems.

Electrophysiological Evidence of Early Cortical Sensitivity to Human Conspecific Mimic Voice as a Distinct Category of Natural Sound.

Purpose From an anthropological perspective of hominin communication, the human auditory system likely evolved to enable special sensitivity to sounds produced by the vocal tracts of human conspecifics whether attended or passively heard. While numerous electrophysiological studies have used stereotypical human-produced verbal (speech voice and singing voice) and nonverbal vocalizations to identify human voice-sensitive responses, controversy remains as to when (and where) processing of acoustic signal attributes characteristic of "human voiceness" per se initiate in the brain. Method To explore this, we used animal vocalizations and human-mimicked versions of those calls ("mimic voice") to examine late auditory evoked potential responses in humans. Results Here, we revealed an N1b component (96-120 ms poststimulus) during a nonattending listening condition showing significantly greater magnitude in response to mimics, beginning as early as primary auditory cortices, preceding the time window reported in previous studies that revealed species-specific vocalization processing initiating in the range of 147-219 ms. During a sound discrimination task, a P600 (500-700 ms poststimulus) component showed specificity for accurate discrimination of human mimic voice. Distinct acoustic signal attributes and features of the stimuli were used in a classifier model, which could distinguish most human from animal voice comparably to behavioral data-though none of these single features could adequately distinguish human voiceness. Conclusions These results provide novel ideas for algorithms used in neuromimetic hearing aids, as well as direct electrophysiological support for a neurocognitive model of natural sound processing that informs both neurodevelopmental and anthropological models regarding the establishment of auditory communication systems in humans. Supplemental Material https://doi.org/10.23641/asha.12903839.

Differential experiences of embodiment between body-powered and myoelectric prosthesis users.

Prosthesis embodiment, the perception of a prosthesis as part of one's body, may be an important component of functional recovery for individuals with upper limb absence. This work determined whether embodiment differs between body-powered and myoelectric prosthesis users. In a sample of nine individuals with transradial limb absence, embodiment was quantified using a survey regarding prosthesis ownership and agency. The extent to which the prosthesis affected the body schema, the representation of the body's dimensions, was assessed using limb length estimation. Because body-powered prostheses offer proprioceptive feedback that myoelectric prostheses do not, it was hypothesized that both measures would reveal stronger embodiment of body-powered prostheses. However, our results did not show differences across the two prosthesis designs. Instead, body schema was influenced by several patient-specific characteristics, including the cause of limb absence (acquired or congenital) and hours of daily prosthesis wear. These results indicate that regular prosthesis wear and embodiment are connected, regardless of the actual prosthesis design. Identifying whether embodiment is a direct consequence of regular prosthesis use would offer insight on how individuals with limb absence could modify their behavior to more fully embody their prosthesis.

Identifying the benefits and risks of emerging integration methods for upper limb prosthetic devices in the United States: an environmental scan.

Objectives: Novel connective and control methods between an upper limb prosthetic device and end-user have large potential rewards and risks, making economic evaluation difficult. Methods: We conducted an environmental scan to assess user perspectives on advancements in upper limb prosthetic device integration. The environmental scan consisted of a PubMed literature search, grey literature review, formation of a community advisory board (CAB) and key informant interviews. The CAB guided the study and was comprised of adults with personal or professional experiences with upper limb prostheses. Results: The environmental scan highlights 4 main types of integration in upper-limb prostheses: osseointegration, targeted muscle reinnervation, cortical integration and peripheral nerve/muscle integration. The PubMed literature search resulted in the greatest number of matches for 'targeted muscle reinnervation upper limb' (N = 65) and 'upper limb osseointegration' (N = 54). The grey literature review found targeted muscle reinnervation and peripheral nerve/muscle integration to be most discussed amongst end-users and regulators. Of these four methods, greater device control versus invasiveness of implant is a clear benefit-risk tradeoff. Conclusion: This scan highlights a gap in user-centered research in upper limb prosthetic devices. Future directions include the development of a stated-preference instrument incorporating these methods of integration. Expert opinion: Upper limb loss greatly impacts one's productivity and quality of life. Despite a variety of prosthetic device options, high user dissatisfaction and rejection rates persist. Using community-based participatory research practices, we engaged end-users and identified the importance of option value. Many individuals said they would forego a present-day option to maintain the opportunity to adopt a device in the future, a point not addressed in the literature. Of the four emerging integration methods identified, targeted muscle reinnervation and peripheral nerve/muscle integration are highly promising, yet a better understanding of end-user preferences for these methods is still needed.

Reliability of upper limb movement quality metrics during everyday tasks.

BACKGROUND: Quantitative assessments of an individual's functional status commonly involve the use of movement quality metrics. RESEARCH QUESTION: The purpose of this work was to quantify the reliability of movement quality metrics in healthy adults during a variety of unconstrained activities of daily living (ADLs). METHODS: Nineteen participants performed six ADLs (lifting a laundry basket, applying deodorant, turning a doorknob, placing a pill in a pillbox, placing a pushpin in a bulletin board, and drinking water from a glass) during two separate sessions. The ADLs were divided into reaching and object manipulation phases. Movement quality for each phase was assessed using three measures of smoothness (log dimensionless jerk, spectral arc length, and number of submovements) and one measure of straightness (index of curvature). Within- and between-session reliability was quantified using intraclass correlation coefficients (ICCs) and minimum detectable changes in measured units and as a percentage of their mean value (MDC%). RESULTS: Reliability was generally lower within-session than between-session and for object manipulation tasks compared to reaching tasks. The ICCs exceeded 0.75 for 5% of the within-session metrics and 73% of the between-session metrics. The average MDC% was 35% for the within-session metrics and 20% for the between-session metrics. Reliability was similar for most metrics when averaged across the tasks, but the number of submovements consistently indicated much lower reliability. SIGNIFICANCE: Unconstrained ADLs can reliably be used to assess movement quality in functional settings that mimic real-world challenges. However, the specific movement quality metrics used in the assessment should be chosen carefully since some metrics perform dissimilarly when applied to the same data. In particular, it may be advisable to use the number of submovements in combination with other metrics, if it is to be used at all.

Reliability of upper limb and trunk joint angles in healthy adults during activities of daily living.

Assessments of upper limb performance should require participants to perform tasks that challenge the limits of their ability. In order to select appropriate tasks, it is important to know which joints are used to perform the movement and how reliably those movements can be measured. The purpose of this work was to quantify the reliability of upper limb and trunk joint angles in healthy adults during common activities of daily living (ADLs). Nineteen participants performed six ADLs with the right arm (applying deodorant, turning a doorknob, answering a desk telephone, placing a pushpin in a bulletin board, wiping a plate with a towel, and pouring water from a pitcher) during two separate sessions. Within- and between-session reliability was quantified using intraclass correlation coefficients (ICCs) and minimum detectable change values (MDCs). Reliability was generally better within-session than between-session. The ICCs exceeded 0.75 for 88% of the joint angles and exceeded 0.90 for 32% of the angles. All MDCs were less than 25° and 61% were also less than 10°. The MDCs represented a larger percent of the average angles for the trunk (61%) and wrist (62%) compared to the shoulder (18%) and elbow (26%). Although these results show that most angles can be measured reliably for these six ADLs, reliability varied considerably between joints. It is therefore important to select tasks for assessing of upper limb performance based on which specific joints need to be evaluated.

Factors associated with interest in novel interfaces for upper limb prosthesis control.

BACKGROUND: Surgically invasive interfaces for upper limb prosthesis control may allow users to operate advanced, multi-articulated devices. Given the potential medical risks of these invasive interfaces, it is important to understand what factors influence an individual's decision to try one. METHODS: We conducted an anonymous online survey of individuals with upper limb loss. A total of 232 participants provided personal information (such as age, amputation level, etc.) and rated how likely they would be to try noninvasive (myoelectric) and invasive (targeted muscle reinnervation, peripheral nerve interfaces, cortical interfaces) interfaces for prosthesis control. Bivariate relationships between interest in each interface and 16 personal descriptors were examined. Significant variables from the bivariate analyses were then entered into multiple logistic regression models to predict interest in each interface. RESULTS: While many of the bivariate relationships were significant, only a few variables remained significant in the regression models. The regression models showed that participants were more likely to be interested in all interfaces if they had unilateral limb loss (p ≤ 0.001, odds ratio ≥ 2.799). Participants were more likely to be interested in the three invasive interfaces if they were younger (p < 0.001, odds ratio ≤ 0.959) and had acquired limb loss (p ≤ 0.012, odds ratio ≥ 3.287). Participants who used a myoelectric device were more likely to be interested in myoelectric control than those who did not (p = 0.003, odds ratio = 24.958). CONCLUSIONS: Novel prosthesis control interfaces may be accepted most readily by individuals who are young, have unilateral limb loss, and/or have acquired limb loss However, this analysis did not include all possible factors that may have influenced participant's opinions on the interfaces, so additional exploration is warranted.

Surveying the interest of individuals with upper limb loss in novel prosthetic control techniques.

BACKGROUND: Novel techniques for the control of upper limb prostheses may allow users to operate more complex prostheses than those that are currently available. Because many of these techniques are surgically invasive, it is important to understand whether individuals with upper limb loss would accept the associated risks in order to use a prosthesis. METHODS: An online survey of individuals with upper limb loss was conducted. Participants read descriptions of four prosthetic control techniques. One technique was noninvasive (myoelectric) and three were invasive (targeted muscle reinnervation, peripheral nerve interfaces, cortical interfaces). Participants rated how likely they were to try each technique if it offered each of six different functional features. They also rated their general interest in each of the six features. A two-way repeated measures analysis of variance with Greenhouse-Geisser corrections was used to examine the effect of the technique type and feature on participants' interest in each technique. RESULTS: Responses from 104 individuals were analyzed. Many participants were interested in trying the techniques - 83 % responded positively toward myoelectric control, 63 % toward targeted muscle reinnervation, 68 % toward peripheral nerve interfaces, and 39 % toward cortical interfaces. Common concerns about myoelectric control were weight, cost, durability, and difficulty of use, while the most common concern about the invasive techniques was surgical risk. Participants expressed greatest interest in basic prosthesis features (e.g., opening and closing the hand slowly), as opposed to advanced features like fine motor control and touch sensation. CONCLUSIONS: The results of these investigations may be used to inform the development of future prosthetic technologies that are appealing to individuals with upper limb loss.

Implanted electrodes for multi-month EEG.

An implanted electroencephalogram (EEG) recorder would help diagnose infrequent seizure-like events. A proof-of-concept study quantified the electrical characteristics of the electrodes planned for the proposed recorder. The electrodes were implanted in an ovine model for eight weeks. Electrode impedance was less than 800 Ohms throughout the study. A frequency-domain determination of sedation performed similarly for surface versus implanted electrodes throughout the study. The time-domain correlation between an implanted electrode and a surface electrode was almost as high as between two surface electrodes (0.86 versus 0.92). EEG-certified clinicians judged that the implanted electrode quality was adequate to excellent and that the implanted electrodes provided the same clinical information as surface electrodes except for a noticeable amplitude difference. No significant issues were found that would stop development of the EEG recorder.