Soft Robotics: A Route to Equality, Diversity, and Inclusivity in Robotics.

Robotics is entering our daily lives. The discipline is increasingly crucial in fields such as agriculture, medicine, and rescue operations, impacting our food, health, and planet. At the same time, it is becoming evident that robotic research must embrace and reflect the diversity of human society to address these broad challenges effectively. In recent years, gender inclusivity has received increasing attention, but it still remains a distant goal. In addition, awareness is rising around other dimensions of diversity, including nationality, religion, and politics. Unfortunately, despite the efforts, empirical evidence shows that the field has still a long way to go before achieving a sufficient level of equality, diversity, and inclusion across these spectra. This study focuses on the soft robotics community-a growing and relatively recent subfield-and it outlines the present state of equality and diversity panorama in this discipline. The article argues that its high interdisciplinary and accessibility make it a particularly welcoming branch of robotics. We discuss the elements that make this subdiscipline an example for the broader robotic field. At the same time, we recognize that the field should still improve in several ways and become more inclusive and diverse. We propose concrete actions that we believe will contribute to achieving this goal, and provide metrics to monitor its evolution.

Does enforcing glenohumeral joint stability matter? A new rapid muscle redundancy solver highlights the importance of non-superficial shoulder muscles.

The complexity of the human shoulder girdle enables the large mobility of the upper extremity, but also introduces instability of the glenohumeral (GH) joint. Shoulder movements are generated by coordinating large superficial and deeper stabilizing muscles spanning numerous degrees-of-freedom. How shoulder muscles are coordinated to stabilize the movement of the GH joint remains widely unknown. Musculoskeletal simulations are powerful tools to gain insights into the actions of individual muscles and particularly of those that are difficult to measure. In this study, we analyze how enforcement of GH joint stability in a musculoskeletal model affects the estimates of individual muscle activity during shoulder movements. To estimate both muscle activity and GH stability from recorded shoulder movements, we developed a Rapid Muscle Redundancy (RMR) solver to include constraints on joint reaction forces (JRFs) from a musculoskeletal model. The RMR solver yields muscle activations and joint forces by minimizing the weighted sum of squared-activations, while matching experimental motion. We implemented three new features: first, computed muscle forces include active and passive fiber contributions; second, muscle activation rates are enforced to be physiological, and third, JRFs are efficiently formulated as linear functions of activations. Muscle activity from the RMR solver without GH stability was not different from the computed muscle control (CMC) algorithm and electromyography of superficial muscles. The efficiency of the solver enabled us to test over 3600 trials sampled within the uncertainty of the experimental movements to test the differences in muscle activity with and without GH joint stability enforced. We found that enforcing GH stability significantly increases the estimated activity of the rotator cuff muscles but not of most superficial muscles. Therefore, a comparison of shoulder model muscle activity to EMG measurements of superficial muscles alone is insufficient to validate the activity of rotator cuff muscles estimated from musculoskeletal models.

Prescribing Cartesian Stiffness of Soft Robots by Co-Optimization of Shape and Segment-Level Stiffness.

Soft robots aim to revolutionize how robotic systems interact with the environment thanks to their inherent compliance. Some of these systems are even able to modulate their physical softness. However, simply equipping a robot with softness will not generate intelligent behaviors. Indeed, most interaction tasks require careful specification of the compliance at the interaction point; some directions must be soft and others firm (e.g., while drawing, entering a hole, tracing a surface, assembling components). On the contrary, without careful planning, the preferential directions of deformation of a soft robot are not aligned with the task. With this work, we propose a strategy to prescribe variations of the physical stiffness and the robot's posture so to implement a desired Cartesian stiffness and location of the contact point. We validate the algorithm in simulation and with experiments. To perform the latter, we also present a new tendon-driven soft manipulator, equipped with variable-stiffness segments and proprioceptive sensing and capable to move in three dimensional. We show that, combining the intelligent hardware with the proposed algorithm, we can obtain the desired stiffness at the end-effector over the workspace.

Learning 3D shape proprioception for continuum soft robots with multiple magnetic sensors.

Sensing the shape of continuum soft robots without obstructing their movements and modifying their natural softness requires innovative solutions. This letter proposes to use magnetic sensors fully integrated into the robot to achieve proprioception. Magnetic sensors are compact, sensitive, and easy to integrate into a soft robot. We also propose a neural architecture to make sense of the highly nonlinear relationship between the perceived intensity of the magnetic field and the shape of the robot. By injecting a priori knowledge from the kinematic model, we obtain an effective yet data-efficient learning strategy. We first demonstrate in simulation the value of this kinematic prior by investigating the proprioception behavior when varying the sensor configuration, which does not require us to re-train the neural network. We validate our approach in experiments involving one soft segment containing a cylindrical magnet and three magnetoresistive sensors. During the experiments, we achieve mean relative errors of 4.5%.

Estimating the state of epidemics spreading with graph neural networks.

When an epidemic spreads into a population, it is often impractical or impossible to continuously monitor all subjects involved. As an alternative, we propose using algorithmic solutions that can infer the state of the whole population from a limited number of measures. We analyze the capability of deep neural networks to solve this challenging task. We base our proposed architecture on Graph Convolutional Neural Networks. As such, it can reason on the effect of the underlying social network structure, which is recognized as the main component in spreading an epidemic. The proposed architecture can reconstruct the entire state with accuracy above 70%, as proven by two scenarios modeled on the CoVid-19 pandemic. The first is a generic homogeneous population, and the second is a toy model of the Boston metropolitan area. Note that no retraining of the architecture is necessary when changing the model.

Scaling Up Soft Robotics: A Meter-Scale, Modular, and Reconfigurable Soft Robotic System.

Today's use of large-scale industrial robots is enabling extraordinary achievement on the assembly line, but these robots remain isolated from the humans on the factory floor because they are very powerful, and thus dangerous to be around. In contrast, the soft robotics research community has proposed soft robots that are safe for human environments. The current state of the art enables the creation of small-scale soft robotic devices. In this article we address the gap between small-scale soft robots and the need for human-sized safe robots by introducing a new soft robotic module and multiple human-scale robot configurations based on this module. We tackle large-scale soft robots by presenting a modular and reconfigurable soft robotic platform that can be used to build fully functional and untethered meter-scale soft robots. These findings indicate that a new wave of human-scale soft robots can be an alternative to classic rigid-bodied robots in tasks and environments where humans and machines can work side by side with capabilities that include, but are not limited to, autonomous legged locomotion and grasping.

Covid-19 and Flattening the Curve: A Feedback Control Perspective.

Many of the policies that were put into place during the Covid-19 pandemic had a common goal: to flatten the curve of the number of infected people so that its peak remains under a critical threshold. This letter considers the challenge of engineering a strategy that enforces such a goal using control theory. We introduce a simple formulation of the optimal flattening problem, and provide a closed form solution. This is augmented through nonlinear closed loop tracking of the nominal solution, with the aim of ensuring close-to-optimal performance under uncertain conditions. A key contribution of this letter is to provide validation of the method with extensive and realistic simulations in a Covid-19 scenario, with particular focus on the case of Codogno - a small city in Northern Italy that has been among the most harshly hit by the pandemic.

Exploiting upper-limb functional principal components for human-like motion generation of anthropomorphic robots.

BACKGROUND: Human-likeliness of robot movements is a key component to enable a safe and effective human-robot interaction, since it contributes to increase acceptance and motion predictability of robots that have to closely interact with people, e.g. for assistance and rehabilitation purposes. Several parameters have been used to quantify how much a robot behaves like a human, which encompass aspects related to both the robot appearance and motion. The latter point is fundamental to allow the operator to interpret robotic actions, and plan a meaningful reactions. While different approaches have been presented in literature, which aim at devising bio-aware control guidelines, a direct implementation of human actions for robot planning is not straightforward, still representing an open issue in robotics. METHODS: We propose to embed a synergistic representation of human movements for robot motion generation. To do this, we recorded human upper-limb motions during daily living activities. We used functional Principal Component Analysis (fPCA) to extract principal motion patterns. We then formulated the planning problem by optimizing the weights of a reduced set of these components. For free-motions, our planning method results into a closed form solution which uses only one principal component. In case of obstacles, a numerical routine is proposed, incrementally enrolling principal components until the problem is solved with a suitable precision. RESULTS: Results of fPCA show that more than 80% of the observed variance can be explained by only three functional components. The application of our method to different meaningful movements, with and without obstacles, show that our approach is able to generate complex motions with a very reduced number of functional components. We show that the first synergy alone accounts for the 96% of cost reduction and that three components are able to achieve a satisfactory motion reconstruction in all the considered cases. CONCLUSIONS: In this work we moved from the analysis of human movements via fPCA characterization to the design of a novel human-like motion generation algorithm able to generate, efficiently and with a reduced set of basis elements, several complex movements in free space, both in free motion and in case of obstacle avoidance tasks.

Control Architecture for Human-Like Motion With Applications to Articulated Soft Robots.

Human beings can achieve a high level of motor performance that is still unmatched in robotic systems. These capabilities can be ascribed to two main enabling factors: (i) the physical proprieties of human musculoskeletal system, and (ii) the effectiveness of the control operated by the central nervous system. Regarding point (i), the introduction of compliant elements in the robotic structure can be regarded as an attempt to bridge the gap between the animal body and the robot one. Soft articulated robots aim at replicating the musculoskeletal characteristics of vertebrates. Yet, substantial advancements are still needed under a control point of view, to fully exploit the new possibilities provided by soft robotic bodies. This paper introduces a control framework that ensures natural movements in articulated soft robots, implementing specific functionalities of the human central nervous system, i.e., learning by repetition, after-effect on known and unknown trajectories, anticipatory behavior, its reactive re-planning, and state covariation in precise task execution. The control architecture we propose has a hierarchical structure composed of two levels. The low level deals with dynamic inversion and focuses on trajectory tracking problems. The high level manages the degree of freedom redundancy, and it allows to control the system through a reduced set of variables. The building blocks of this novel control architecture are well-rooted in the control theory, which can furnish an established vocabulary to describe the functional mechanisms underlying the motor control system. The proposed control architecture is validated through simulations and experiments on a bio-mimetic articulated soft robot.

Design and Assessment of Control Maps for Multi-Channel sEMG-Driven Prostheses and Supernumerary Limbs.

Proportional and simultaneous control algorithms are considered as one of the most effective ways of mapping electromyographic signals to an artificial device. However, the applicability of these methods is limited by the high number of electromyographic features that they require to operate-typically twice as many the actuators to be controlled. Indeed, extracting many independent electromyographic signals is challenging for a number of reasons-ranging from technological to anatomical. On the contrary, the number of actively moving parts in classic prostheses or extra-limbs is often high. This paper faces this issue, by proposing and experimentally assessing a set of algorithms which are capable of proportionally and simultaneously control as many actuators as there are independent electromyographic signals available. Two sets of solutions are considered. The first uses as input electromyographic signals only, while the second adds postural measurements to the sources of information. At first, all the proposed algorithms are experimentally tested in terms of precision, efficiency, and usability on twelve able-bodied subjects, in a virtual environment. A state-of-the-art controller using twice the amount of electromyographic signals as input is adopted as benchmark. We then performed qualitative tests, where the maps are used to control a prototype of upper limb prosthesis. The device is composed of a robotic hand and a wrist implementing active prono-supination movement. Eight able-bodied subjects participated to this second round of testings. Finally, the proposed strategies were tested in exploratory experiments involving two subjects with limb loss. Results coming from the evaluations in virtual and realistic settings show encouraging results and suggest the effectiveness of the proposed approach.

DeepDynamicHand: A Deep Neural Architecture for Labeling Hand Manipulation Strategies in Video Sources Exploiting Temporal Information.

Humans are capable of complex manipulation interactions with the environment, relying on the intrinsic adaptability and compliance of their hands. Recently, soft robotic manipulation has attempted to reproduce such an extraordinary behavior, through the design of deformable yet robust end-effectors. To this goal, the investigation of human behavior has become crucial to correctly inform technological developments of robotic hands that can successfully exploit environmental constraint as humans actually do. Among the different tools robotics can leverage on to achieve this objective, deep learning has emerged as a promising approach for the study and then the implementation of neuro-scientific observations on the artificial side. However, current approaches tend to neglect the dynamic nature of hand pose recognition problems, limiting the effectiveness of these techniques in identifying sequences of manipulation primitives underpinning action generation, e.g., during purposeful interaction with the environment. In this work, we propose a vision-based supervised Hand Pose Recognition method which, for the first time, takes into account temporal information to identify meaningful sequences of actions in grasping and manipulation tasks. More specifically, we apply Deep Neural Networks to automatically learn features from hand posture images that consist of frames extracted from grasping and manipulation task videos with objects and external environmental constraints. For training purposes, videos are divided into intervals, each associated to a specific action by a human supervisor. The proposed algorithm combines a Convolutional Neural Network to detect the hand within each video frame and a Recurrent Neural Network to predict the hand action in the current frame, while taking into consideration the history of actions performed in the previous frames. Experimental validation has been performed on two datasets of dynamic hand-centric strategies, where subjects regularly interact with objects and environment. Proposed architecture achieved a very good classification accuracy on both datasets, reaching performance up to 94%, and outperforming state of the art techniques. The outcomes of this study can be successfully applied to robotics, e.g., for planning and control of soft anthropomorphic manipulators.

Postural Hand Synergies during Environmental Constraint Exploitation.

Humans are able to intuitively exploit the shape of an object and environmental constraints to achieve stable grasps and perform dexterous manipulations. In doing that, a vast range of kinematic strategies can be observed. However, in this work we formulate the hypothesis that such ability can be described in terms of a synergistic behavior in the generation of hand postures, i.e., using a reduced set of commonly used kinematic patterns. This is in analogy with previous studies showing the presence of such behavior in different tasks, such as grasping. We investigated this hypothesis in experiments performed by six subjects, who were asked to grasp objects from a flat surface. We quantitatively characterized hand posture behavior from a kinematic perspective, i.e., the hand joint angles, in both pre-shaping and during the interaction with the environment. To determine the role of tactile feedback, we repeated the same experiments but with subjects wearing a rigid shell on the fingertips to reduce cutaneous afferent inputs. Results show the persistence of at least two postural synergies in all the considered experimental conditions and phases. Tactile impairment does not alter significantly the first two synergies, and contact with the environment generates a change only for higher order Principal Components. A good match also arises between the first synergy found in our analysis and the first synergy of grasping as quantified by previous work. The present study is motivated by the interest of learning from the human example, extracting lessons that can be applied in robot design and control. Thus, we conclude with a discussion on implications for robotics of our findings.

Design, control and validation of the variable stiffness exoskeleton FLExo.

In this paper we present the design of a one degree of freedom assistive platform to augment the strength of upper limbs. The core element is a variable stiffness actuator, closely reproducing the behavior of a pair of antagonistic muscles. The novelty introduced by this device is the analogy of its control parameters with those of the human muscle system, the threshold lengths. The analogy can be obtained from a proper tuning of the mechanical system parameters. Based on this, the idea is to control inputs by directly mapping the estimation of the muscle activations, e.g. via ElectroMyoGraphic(EMG) sensors, on the exoskeleton. The control policy resulting from this mapping acts in feedforward in a way to exploit the muscle-like dynamics of the mechanical device. Thanks to the particular structure of the actuator, the exoskeleton joint stiffness naturally results from that mapping. The platform as well as the novel control idea have been experimentally validated and the results show a substantial reduction of the subject muscle effort.

Preliminary results toward a naturally controlled multi-synergistic prosthetic hand.

Robotic hands embedding human motor control principles in their mechanical design are getting increasing interest thanks to their simplicity and robustness, combined with good performance. Another key aspect of these hands is that humans can use them very effectively thanks to the similarity of their behavior with real hands. Nevertheless, controlling more than one degree of actuation remains a challenging task. In this paper, we take advantage of these characteristics in a multi-synergistic prosthesis. We propose an integrated setup composed of Pisa/IIT SoftHand 2 and a control strategy which simultaneously and proportionally maps the human hand movements to the robotic hand. The control technique is based on a combination of non-negative matrix factorization and linear regression algorithms. It also features a real-time continuous posture compensation of the electromyographic signals based on an IMU. The algorithm is tested on five healthy subjects through an experiment in a virtual environment. In a separate experiment, the efficacy of the posture compensation strategy is evaluated on five healthy subjects and, finally, the whole setup is successfully tested in performing realistic daily life activities.