Perception and control of low cable operation forces in voluntary closing body-powered upper-limb prostheses.

Operating a body-powered prosthesis can be painful and tiring due to high cable operation forces, illustrating that low cable operation forces are a desirable design property for body-powered prostheses. However, lower operation forces might negatively affect controllability and force perception, which is plausible but not known. This study aims to quantify the accuracy of cable force perception and control for body-powered prostheses in a low cable operation force range by utilizing isometric and dynamic force reproduction experiments. Twenty-five subjects with trans-radial absence conducted two force reproduction tasks; first an isometric task of reproducing 10, 15, 20, 25, 30 or 40 N and second a force reproduction task of 10 and 20 N, for cable excursions of 10, 20, 40, 60 and 80 mm. Task performance was quantified by the force reproduction error and the variability in the generated force. The results of the isometric experiment demonstrated that increasing force levels enlarge the force variability, but do not influence the force reproduction error for the tested force range. The second experiment showed that increased cable excursions resulted in a decreased force reproduction error, for both tested force levels, whereas the force variability remained unchanged. In conclusion, the design recommendations for voluntary closing body-powered prostheses suggested by this study are to minimize cable operation forces: this does not affect force reproduction error but does reduce force variability. Furthermore, increased cable excursions facilitate users with additional information to meet a target force more accurately.

Haptic Assistance Improves Tele-Manipulation With Two Asymmetric Slaves.

Tele-manipulation of heavy loads typically requires the simultaneous use of two asymmetric slaves: a crane for vertical weight support and a robot for accurate lateral positioning. The industrial standard prescribes a pair of operators for such tasks (one operator to control each slave), although in principle one operator might control both slaves with a single, hybrid interface. Accurate and safe co-operative handling of the expensive and fragile heavy components is difficult, presumably due to problems in the coordination of the subtasks and the lack of mutual awareness between the two operators. This study proposes a novel haptic assistance system to improve subtask coordination and task performance. Its novelty consists of haptically linking operators/interfaces through the joint task environment. The system's efficacy is evaluated with 15 pairs of co-operators and 15 individual uni-manual operators who maneuvered a heavy load through a bounded path in Virtual Reality. Haptic assistance improves task completion time for both groups. It also reduces control activity and self-reported workload without affecting a number of critical errors made by the operators. Moreover, without haptic assistance, uni-manual operators perform worse than co-operators, but this difference between the interfaces was not found with haptic assistance.

Reliance on Haptic Assistance Reflected in Haptic Cue Weighting.

When using an automated system, user trust in the automation is an important factor influencing performance. Prior studies have analyzed trust duringsupervisory control of automation, and how trust influences reliance: the behavioral correlate of trust. Here, we investigated how reliance on haptic assistance affects performance during shared control with an automated system. Subjects made reaches towards a hidden target using a visual cue and haptic cue (assistance from the automation). We sought to influence reliance by changing the variability of trial-by-trial random errors in the haptic assistance. Reliance was quantified in terms of the subject's position at the end of the reach relative to the two cues. Our results show that subjects aimed more towards the visual cue when the variability of the haptic cue errors increased, resembling cue weighting behavior. Similar behavior was observed both when subjects had explicit knowledge about the haptic cue error variability, as well as when they had only implicit knowledge (from experience). However, the group with explicit knowledge was able to more quickly adapt their reliance on the haptic assistance. The method we introduce here provides a quantitative way to study user reliance on the information provided by automated systems with shared control.

What determines drivers' speed? A replication of three behavioural adaptation experiments in a single driving simulator study.

We conceptually replicated three highly cited experiments on speed adaptation, by measuring drivers' experienced risk (galvanic skin response; GSR), experienced task difficulty (self-reported task effort; SRTE) and safety margins (time-to-line-crossing; TLC) in a single experiment. The three measures were compared using a nonparametric index that captures the criteria of constancy during self-paced driving and sensitivity during forced-paced driving. In a driving simulator, 24 participants completed two forced-paced and one self-paced run. Each run held four different lane width conditions. Results showed that participants drove faster on wider lanes, thus confirming the expected speed adaptation. None of the three measures offered persuasive evidence for speed adaptation because they failed either the sensitivity criterion (GSR) or the constancy criterion (TLC, SRTE). An additional measure, steering reversal rate, outperformed the other three measures regarding sensitivity and constancy, prompting a further evaluation of the role of control activity in speed adaptation. Practitioner Summary: Results from a driving simulator experiment suggest that it is not experienced risk, experienced effort or safety margins that govern drivers' choice of speed. Rather, our findings suggest that steering reversal rate has an explanatory role in speed adaptation.

Feel-Good Robotics: Requirements on Touch for Embodiment in Assistive Robotics.

The feeling of embodiment, i.e., experiencing the body as belonging to oneself and being able to integrate objects into one's bodily self-representation, is a key aspect of human self-consciousness and has been shown to importantly shape human cognition. An extension of such feelings toward robots has been argued as being crucial for assistive technologies aiming at restoring, extending, or simulating sensorimotor functions. Empirical and theoretical work illustrates the importance of sensory feedback for the feeling of embodiment and also immersion; we focus on the the perceptual level of touch and the role of tactile feedback in various assistive robotic devices. We critically review how different facets of tactile perception in humans, i.e., affective, social, and self-touch, might influence embodiment. This is particularly important as current assistive robotic devices - such as prostheses, orthoses, exoskeletons, and devices for teleoperation-often limit touch low-density and spatially constrained haptic feedback, i.e., the mere touch sensation linked to an action. Here, we analyze, discuss, and propose how and to what degree tactile feedback might increase the embodiment of certain robotic devices, e.g., prostheses, and the feeling of immersion in human-robot interaction, e.g., in teleoperation. Based on recent findings from cognitive psychology on interactive processes between touch and embodiment, we discuss technical solutions for specific applications, which might be used to enhance embodiment, and facilitate the study of how embodiment might alter human-robot interactions. We postulate that high-density and large surface sensing and stimulation are required to foster embodiment of such assistive devices.

Tele-Manipulation with Two Asymmetric Slaves: Two Operators Perform Better Than One.

Certain tele-manipulation tasks require manipulation by two asymmetric slaves, for example, a crane for hoisting and a dexterous robotic arm for fine manipulation. It is unclear how to best design human-in-the-loop control over two asymmetric slaves. The goal of this paper is to quantitatively compare the standard approach of two co-operating operators that each control a single subtask, to a single operator performing bi-manual control over the two subtasks, and a uni-manual control approach. In a human factors experiment, participants performed a heavy load maneuvering and mounting task using a vertical crane and a robotic arm. We hypothesize that bi-manual control yields worse task performance and control activity compared to co-operation, because of conflicting spatial and temporal constraints. Literature suggests that uni-manual operators should perform better than co-operation, as co-operators critically depend on each other's actions. However, other literature provides evidence that individual operators have limited capabilities in controlling asymmetric axes of two dynamic systems. The results show that the two co-operators perform the maneuvering and mounting task faster than either bi- or uni-manual operators. Compared to co-operators, uni-manual operators required more control activity for the vertical crane and less for the robotic arm. In conclusion, this study suggests that when controlling two asymmetric slaves, a co-operating pair of operators performs better than a single operator.

Trust in haptic assistance: weighting visual and haptic cues based on error history.

To effectively interpret and interact with the world, humans weight redundant estimates from different sensory cues to form one coherent, integrated estimate. Recent advancements in physical assistance systems, where guiding forces are computed by an intelligent agent, enable the presentation of augmented cues. It is unknown, however, if cue weighting can be extended to augmented cues. Previous research has shown that cue weighting is determined by the reliability (inversely related to uncertainty) of cues within a trial, yet augmented cues may also be affected by errors that vary over trials. In this study, we investigate whether people can learn to appropriately weight a haptic cue from an intelligent assistance system based on its error history. Subjects held a haptic device and reached to a hidden target using a visual (Gaussian distributed dots) and haptic (force channel) cue. The error of the augmented haptic cue varied from trial to trial based on a Gaussian distribution. Subjects learned to estimate the target location by weighting the visual and augmented haptic cues based on their perceptual uncertainty and experienced errors. With both cues available, subjects were able to find the target with an improved or equal performance compared to what was possible with one cue alone. Our results show that the brain can learn to reweight augmented cues from intelligent agents, akin to previous observations of the reweighting of naturally occurring cues. In addition, these results suggest that the weighting of a cue is not only affected by its within-trial reliability but also the history of errors.

High Cable Forces Deteriorate Pinch Force Control in Voluntary-Closing Body-Powered Prostheses.

BACKGROUND: It is generally asserted that reliable and intuitive control of upper-limb prostheses requires adequate feedback of prosthetic finger positions and pinch forces applied to objects. Body-powered prostheses (BPPs) provide the user with direct proprioceptive feedback. Currently available BPPs often require high cable operation forces, which complicates control of the forces at the terminal device. The aim of this study is to quantify the influence of high cable forces on object manipulation with voluntary-closing prostheses. METHOD: Able-bodied male subjects were fitted with a bypass-prosthesis with low and high cable force settings for the prehensor. Subjects were requested to grasp and transfer a collapsible object as fast as they could without dropping or breaking it. The object had a low and a high breaking force setting. RESULTS: Subjects conducted significantly more successful manipulations with the low cable force setting, both for the low (33% more) and high (50%) object's breaking force. The time to complete the task was not different between settings during successful manipulation trials. CONCLUSION: High cable forces lead to reduced pinch force control during object manipulation. This implies that low cable operation forces should be a key design requirement for voluntary-closing BPPs.

Admittance-Adaptive Model-Based Approach to Mitigate Biodynamic Feedthrough.

Biodynamic feedthrough (BDFT) refers to the feedthrough of vehicle accelerations through the human body, leading to involuntary control device inputs. BDFT impairs control performance in a large range of vehicles under various circumstances. Research shows that BDFT strongly depends on adaptations in the neuromuscular admittance dynamics of the human body. This paper proposes a model-based approach of BDFT mitigation that accounts for these neuromuscular adaptations. The method was tested, as proof-of-concept, in an experiment where participants inside a motion simulator controlled a simulated vehicle through a virtual tunnel. Through evaluating tracking performance and control effort with and without motion disturbance active and with and without cancellation active, the effectiveness of the cancellation was evaluated. Results show that the cancellation approach is successful: the detrimental effects of BDFT were largely removed.

Movement Strategy Discovery during Training via Haptic Guidance.

Haptic guidance has previously been investigated to facilitate motor skill training, whereupon a robotic device assists a trainee in executing the desired movement. However, many studies have reported a null or even detrimental effect of haptic guidance on training compared to unassisted practice. While prior studies have focused on using haptic guidance to refine a movement strategy, our study explores its effect on the discovery of a new strategy. Subjects learned to manipulate a virtual under-actuated system via a haptic device either with or without haptic guidance (and without haptic feedback of system dynamics). The guidance enabled subjects to experience a range of successful movements, rather than strictly enforcing one trajectory. Subjects who trained with guidance adopted a strategy that involved faster reaches, required greater control of the system's degrees of freedom, and increased the potential for faster task completion. However, overall improvement of task performance was limited with the new strategy.

The Effect of Trial-by-Trial Adaptation on Conflicts in Haptic Shared Control for Free-Air Teleoperation Tasks.

Haptic shared control can improve execution of teleoperation and driving tasks. However, shared control designs may suffer from conflicts between individual human operators and constant haptic assistance when their desired trajectories differ, leading to momentarily increased forces, discomfort, or even deteriorated performance. This study investigates ways to reduce conflicts between individual human operators and a haptic shared controller by modifying supported trajectories. Subjects (n=12) performed a repetitive movement task in an abstract environment with varying spatio-temporal constraints, both during manual control and while supported by haptic shared control. Four types of haptic shared control were compared, combining two design properties: the initial supported trajectory (either the centerline of the environment or an individualized trajectory based on manual control trials), and trial-by-trial adaptation of guidance towards previously performed trajectories (either present or absent). Trial-by-trial adaptation of guidance reduced conflicts compared to non-adaptive guidance, whether the initial trajectory was individualized or not. Without trial-by-trial adaptation, individualized trajectories also reduced conflicts, but not completely: when guided, operators adapt their preferred trajectories. In conclusion, trial-by-trial adaptation is the most promising approach to mitigate conflicts during repetitive motion tasks.

The Effect of Haptic Support Systems on Driver Performance: A Literature Survey.

A large number of haptic driver support systems have been described in the scientific literature. However, there is little consensus regarding the design, evaluation methods, and effectiveness of these systems. This literature survey aimed to investigate: (1) what haptic systems (in terms of function, haptic signal, channel, and supported task) have been experimentally tested, (2) how these haptic systems have been evaluated, and (3) their reported effects on driver performance and behaviour. We reviewed empirical research in which participants had to drive a vehicle in a real or simulated environment, were able to control the heading and/or speed of the vehicle, and a haptic signal was provided to them. The results indicated that a clear distinction can be made between warning systems (using vibrations) and guidance systems (using continuous forces). Studies typically used reaction time measures for evaluating warning systems and vehicle-centred performance measures for evaluating guidance systems. In general, haptic warning systems reduced the reaction time of a driver compared to no warnings, although these systems may cause annoyance. Guidance systems generally improved the performance of drivers compared to non-aided driving, but these systems may suffer from after-effects. Longitudinal research is needed to investigate the transfer and retention of effects caused by haptic support systems.

Haptic Shared Control in Tele-Manipulation: Effects of Inaccuracies in Guidance on Task Execution.

Haptic shared control is a promising approach to improve tele-manipulated task execution, by making safe and effective control actions tangible through guidance forces. In current research, these guidance forces are most often generated based on pre-generated, errorless models of the remote environment. Hence such guidance forces are exempt from the inaccuracies that can be expected in practical implementations. The goal of this research is to quantify the extent to which task execution is degraded by inaccuracies in the model on which haptic guidance forces are based. In a human-in-the-loop experiment, subjects (n = 14) performed a realistic tele-manipulated assembly task in a virtual environment. Operators were provided with various levels of haptic guidance, namely no haptic guidance (conventional tele-manipulation), haptic guidance without inaccuracies, and haptic guidance with translational inaccuracies (one large inaccuracy, in the order of magnitude of the task, and a second smaller inaccuracy). The quality of natural haptic feedback (i.e., haptic transparency) was varied between high and low to identify the operator's ability to detect and cope with inaccuracies in haptic guidance. The results indicate that haptic guidance is beneficial for task execution when no inaccuracies are present in the guidance. When inaccuracies are present, this may degrade task execution, depending on the magnitude and the direction of the inaccuracy. The effect of inaccuracies on overall task performance is dominated by effects found for the Constrained Translational Movement, due to its potential for jamming. No evidence was found that a higher quality of haptic transparency helps operators to detect and cope with inaccuracies in the haptic guidance.

Should drivers be operating within an automation-free bandwidth? Evaluating haptic steering support systems with different levels of authority.

OBJECTIVE: The aim of this study was to compare continuous versus bandwidth haptic steering guidance in terms of lane-keeping behavior, aftereffects, and satisfaction. BACKGROUND: An important human factors question is whether operators should be supported continuously or only when tolerance limits are exceeded. We aimed to clarify this issue for haptic steering guidance by investigating costs and benefits of both approaches in a driving simulator. METHODS: Thirty-two participants drove five trials, each with a different level of haptic support: no guidance (Manual); guidance outside a 0.5-m bandwidth (Band1); a hysteresis version of Band1, which guided back to the lane center once triggered (Band2); continuous guidance (Cont); and Cont with double feedback gain (ContS). Participants performed a reaction time task while driving. Toward the end of each trial, the guidance was unexpectedly disabled to investigate aftereffects. RESULTS: All four guidance systems prevented large lateral errors (>0.7 m). Cont and especially ContS yielded smaller lateral errors and higher time to line crossing than Manual, Band1, and Band2. Cont and ContS yielded short-lasting aftereffects, whereas Band1 and Band2 did not. Cont yielded higher self-reported satisfaction and faster reaction times than Band1. CONCLUSIONS: Continuous and bandwidth guidance both prevent large driver errors. Continuous guidance yields improved performance and satisfaction over bandwidth guidance at the cost of aftereffects and variability in driver torque (indicating human-automation conflicts). APPLICATION: The presented results are useful for designers of haptic guidance systems and support critical thinking about the costs and benefits of automation support systems.

A framework for biodynamic feedthrough analysis--part II: validation and application.

Biodynamic feedthrough (BDFT) is a complex phenomenon, that has been studied for several decades. However, there is little consensus on how to approach the BDFT problem in terms of definitions, nomenclature, and mathematical descriptions. In this paper, the framework for BDFT analysis, as presented in Part I of this dual publication, is validated and applied. The goal of this framework is twofold. First of all, it provides some common ground between the seemingly large range of different approaches existing in BDFT literature. Secondly, the framework itself allows for gaining new insights into BDFT phenomena. Using recently obtained measurement data, parts of the framework that were not already addressed elsewhere, are validated. As an example of a practical application of the framework, it will be demonstrated how the effects of control device dynamics on BDFT can be understood and accurately predicted. Other ways of employing the framework are illustrated by interpreting the results of three selected studies from the literature using the BDFT framework. The presentation of the BDFT framework is divided into two parts. This paper, Part II, addresses the validation and application of the framework. Part I, which is also published in this journal issue, addresses the theoretical foundations of the framework. The work is presented in two separate papers to allow for a detailed discussion of both the framework's theoretical background and its validation.

A framework for biodynamic feedthrough analysis--part I: theoretical foundations.

Biodynamic feedthrough (BDFT) is a complex phenomenon, which has been studied for several decades. However, there is little consensus on how to approach the BDFT problem in terms of definitions, nomenclature, and mathematical descriptions. In this paper, a framework for biodynamic feedthrough analysis is presented. The goal of this framework is two-fold. First, it provides some common ground between the seemingly large range of different approaches existing in the BDFT literature. Second, the framework itself allows for gaining new insights into BDFT phenomena. It will be shown how relevant signals can be obtained from measurement, how different BDFT dynamics can be derived from them, and how these different dynamics are related. Using the framework, BDFT can be dissected into several dynamical relationships, each relevant in understanding BDFT phenomena in more detail. The presentation of the BDFT framework is divided into two parts. This paper, Part I, addresses the theoretical foundations of the framework. Part II, which is also published in this issue, addresses the validation of the framework. The work is presented in two separate papers to allow for a detailed discussion of both the framework's theoretical background and its validation.

A biodynamic feedthrough model based on neuromuscular principles.

A biodynamic feedthrough (BDFT) model is proposed that describes how vehicle accelerations feed through the human body, causing involuntary limb motions and so involuntary control inputs. BDFT dynamics strongly depend on limb dynamics, which can vary between persons (between-subject variability), but also within one person over time, e.g., due to the control task performed (within-subject variability). The proposed BDFT model is based on physical neuromuscular principles and is derived from an established admittance model-describing limb dynamics-which was extended to include control device dynamics and account for acceleration effects. The resulting BDFT model serves primarily the purpose of increasing the understanding of the relationship between neuromuscular admittance and biodynamic feedthrough. An added advantage of the proposed model is that its parameters can be estimated using a two-stage approach, making the parameter estimation more robust, as the procedure is largely based on the well documented procedure required for the admittance model. To estimate the parameter values of the BDFT model, data are used from an experiment in which both neuromuscular admittance and biodynamic feedthrough are measured. The quality of the BDFT model is evaluated in the frequency and time domain. Results provide strong evidence that the BDFT model and the proposed method of parameter estimation put forward in this paper allows for accurate BDFT modeling across different subjects (accounting for between-subject variability) and across control tasks (accounting for within-subject variability).

Mathematical biodynamic feedthrough model applied to rotorcraft.

Biodynamic feedthrough (BDFT) occurs when vehicle accelerations feed through the human body and cause involuntary control inputs. This paper proposes a model to quantitatively predict this effect in rotorcraft. This mathematical BDFT model aims to fill the gap between the currently existing black box BDFT models and physical BDFT models. The model structure was systematically constructed using asymptote modeling, a procedure described in detail in this paper. The resulting model can easily be implemented in many typical rotorcraft BDFT studies, using the provided model parameters. The model's performance was validated in both the frequency and time domain. Furthermore, it was compared with several recent BDFT models. The results show that the proposed mathematical model performs better than typical black box models and is easier to parameterize and implement than a recent physical model.

Force control in the absence of visual and tactile feedback.

Motor control tasks like stance or object handling require sensory feedback from proprioception, vision and touch. The distinction between tactile and proprioceptive sensors is not frequently made in dynamic motor control tasks, and if so, mostly based on signal latency. We previously found that force control tasks entail more compliant behavior than a passive, relaxed condition and by neuromuscular modeling we were able to attribute this to adaptations in proprioceptive force feedback from Golgi tendon organs. This required the assumption that both tactile and visual feedback are too slow to explain the measured adaptations in face of unpredictable force perturbations. Although this assumption was shown to hold using model simulations, so far no experimental data is available to validate it. Here we applied a systematic approach using continuous perturbations and engineering analyses to provide experimental evidence for the hypothesis that motor control adaptation in force control tasks can be achieved using proprioceptive feedback only. Varying task instruction resulted in substantial adaptations in neuromuscular behavior, which persisted after eliminating visual and/or tactile feedback by a nerve block of the nervus plantaris medialis. It is concluded that proprioception adapts dynamic human ankle motor control even in the absence of visual and tactile feedback.

A New View on Biodynamic Feedthrough Analysis: Unifying the Effects on Forces and Positions.

When performing a manual control task, vehicle accelerations can cause involuntary limb motions, which can result in unintentional control inputs. This phenomenon is called biodynamic feedthrough (BDFT). In the past decades, many studies into BDFT have been performed, but its fundamentals are still only poorly understood. What has become clear, though, is that BDFT is a highly complex process, and its occurrence is influenced by many different factors. A particularly challenging topic in BDFT research is the role of the human operator, which is not only a very complex but also a highly adaptive system. In literature, two different ways of measuring and analyzing BDFT are reported. One considers the transfer of accelerations to involuntary forces applied to the control device (CD); the other considers the transfer of accelerations to involuntary CD deflections or positions. The goal of this paper is to describe an approach to unify these two methods. It will be shown how the results of the two methods relate and how this knowledge may aid in understanding BDFT better as a whole. The approach presented is based on the notion that BDFT dynamics can be described by the combination of two transfer dynamics: 1) the transfer dynamics from body accelerations to involuntary forces and 2) the transfer dynamics from forces to CD deflections. The approach was validated using experimental results.