Real-time motion force-feedback system with predictive-vision for improving motor accuracy.

Many haptic guidance systems have been studied over the years; however, most of them have been limited to predefined guidance methods. Calculating guidance according to the operator's motion is important for efficient human motor adaptation and learning. In this study, we developed a system that haptically provides guidance trajectory by sequential weighting between the operator's trajectory and the ideal trajectory calculated from a predictive-vision system. We investigated whether motion completion with a predictive-vision system affects human motor accuracy and adaptation in time-constrained goal-directed reaching and ball-hitting tasks through subject experiments. The experiment was conducted with 12 healthy participants, and all participants performed ball-hitting tasks. Half of the participants get forceful guidance from the proposed system in the middle of the experiment. We found that the use of the proposed system improved the operator's motor performance. Furthermore, we observed a trend in which the improvement in motor performance using this system correlated with that after the washout of this system. These results suggest that the predictive-vision system effectively enhances motor accuracy to the target error in dynamic and time-constrained reaching and hitting tasks and may contribute to facilitating motor learning.

Intuitive Cell Manipulation Microscope System with Haptic Device for Intracytoplasmic Sperm Injection Simplification.

In recent years, the demand for effective intracytoplasmic sperm injection (ICSI) for the treatment of male infertility has increased. The ICSI operation is complicated as it involves delicate organs and requires a high level of skill. Several cell manipulation systems that do not require such skills have been proposed; notably, several automated methods are available for cell rotation. However, these methods are unfeasible for the delicate ICSI medical procedure because of safety issues. Thus, this study proposes a microscopic system that enables intuitive micropipette manipulation using a haptic device that safely and efficiently performs the entire ICSI procedure. The proposed system switches between field-of-view expansion and three-dimensional image presentation to present images according to the operational stage. In addition, the system enables intuitive pipette manipulation using a haptic device. Experiments were conducted on microbeads instead of oocytes. The results confirmed that the time required for the experimental task was improved by 52.6%, and the injection error was improved by 75.3% compared to those observed in the conventional system.

Auditory Feedback for Enhanced Sense of Agency in Shared Control.

There is a growing need for robots that can be remotely controlled to perform tasks of one's own choice. However, the SoA (Sense of Agency: the sense of recognizing that the motion of an observed object is caused by oneself) is reduced because the subject of the robot motion is identified as external due to shared control. To address this issue, we aimed to suppress the decline in SoA by presenting auditory feedback that aims to blur the distinction between self and others. We performed the tracking task in a virtual environment under four different auditory feedback conditions, with varying levels of automation to manipulate the virtual robot gripper. Experimental results showed that the proposed auditory feedback suppressed the decrease in the SoA at a medium level of automation. It is suggested that our proposed auditory feedback could blur the distinction between self and others, and that the operator attributes the subject of the motion of the manipulated object to himself.

A Wirelessly Powered 4-Channel Neurostimulator for Reconstructing Walking Trajectory.

A wirelessly powered four-channel neurostimulator was developed for applying selective Functional Electrical Stimulation (FES) to four peripheral nerves to control the ankle and knee joints of a rat. The power of the neurostimulator was wirelessly supplied from a transmitter device, and the four nerves were connected to the receiver device, which controlled the ankle and knee joints in the rat. The receiver device had functions to detect the frequency of the transmitter signal from the transmitter coil. The stimulation site of the nerves was selected according to the frequency of the transmitter signal. The rat toe position was controlled by changing the angles of the ankle and knee joints. The joint angles were controlled by the stimulation current applied to each nerve independently. The stimulation currents were adjusted by the Proportional Integral Differential (PID) and feed-forward control method through a visual feedback control system, and the walking trajectory of a rat's hind leg was reconstructed. This study contributes to controlling the multiple joints of a leg and reconstructing functional motions such as walking using the robotic control technology.

Visual Sensing System to Investigate Self-Propelled Motion and Internal Color of Multiple Aqueous Droplets.

This study proposes a visual sensing system to investigate the self-propelled motions of droplets. In the visual sensing of self-propelled droplets, large field-of-view and high-resolution images are both required to investigate the behaviors of multiple droplets as well as chemical reactions in the droplets. Therefore, we developed a view-expansive microscope system using a color camera head to investigate these chemical reactions; in the system, we implemented an image processing algorithm to detect the behaviors of droplets over a large field of view. We conducted motion tracking and color identification experiments on the self-propelled droplets to verify the effectiveness of the proposed system. The experimental results demonstrate that the proposed system is able to detect the location and color of each self-propelled droplet in a large-area image.

A Therapeutic Strategy for Lower Motor Neuron Disease and Injury Integrating Neural Stem Cell Transplantation and Functional Electrical Stimulation in a Rat Model.

Promising treatments for upper motor neuron disease are emerging in which motor function is restored by brain-computer interfaces and functional electrical stimulation. At present, such technologies and procedures are not applicable to lower motor neuron disease. We propose a novel therapeutic strategy for lower motor neuron disease and injury integrating neural stem cell transplantation with our new functional electrical stimulation control system. In a rat sciatic nerve transection model, we transplanted embryonic spinal neural stem cells into the distal stump of the peripheral nerve to reinnervate denervated muscle, and subsequently demonstrated that highly responsive limb movement similar to that of a healthy limb could be attained with a wirelessly powered two-channel neurostimulator that we developed. This unique technology, which can reinnervate and precisely move previously denervated muscles that were unresponsive to electrical stimulation, contributes to improving the condition of patients suffering from intractable diseases of paralysis and traumatic injury.

Head-Mounted Display-Based Microscopic Imaging System with Customizable Field Size and Viewpoint.

In recent years, the use of microinjections has increased in life science and biotechnology fields; specific examples include artificial insemination and gene manipulation. Microinjections are mainly performed based on visual information; thus, the operator needs high-level skill because of the narrowness of the visual field. Additionally, microinjections are performed as the operator views a microscopic image on a display; the position of the display requires the operator to maintain an awkward posture throughout the procedure. In this study, we developed a microscopic image display apparatus for microinjections based on a view-expansive microscope. The prototype of the view-expansive microscope has problems related to the variations in brightness and focal blur that accompany changes in the optical path length and amount of reflected light. Therefore, we propose the use of a variable-focus device to expand the visual field and thus circumvent the above-mentioned problems. We evaluated the observable area of the system using this variable-focus device. We confirmed that the observable area is 261.4 and 13.9 times larger than that of a normal microscope and conventional view-expansive microscopic system, respectively. Finally, observations of mouse embryos were carried out by using the developed system. We confirmed that the microscopic images can be displayed on a head-mounted display in real time with the desired point and field sizes.

Visual Feedback Control of a Rat Ankle Angle Using a Wirelessly Powered Two-Channel Neurostimulator.

Peripheral nerve disconnections cause severe muscle atrophy and consequently, paralysis of limbs. Reinnervation of denervated muscle by transplanting motor neurons and applying Functional Electrical Stimulation (FES) onto peripheral nerves is an important procedure for preventing irreversible degeneration of muscle tissues. After the reinnervation of denervated muscles, multiple peripheral nerves should be stimulated independently to control joint motion and reconstruct functional movements of limbs by the FES. In this study, a wirelessly powered two-channel neurostimulator was developed with the purpose of applying selective FES to two peripheral nerves-the peroneal nerve and the tibial nerve in a rat. The neurostimulator was designed in such a way that power could be supplied wirelessly, from a transmitter coil to a receiver coil. The receiver coil was connected, in turn, to the peroneal and tibial nerves in the rat. The receiver circuit had a low pass filter to allow detection of the frequency of the transmitter signal. The stimulation of the nerves was switched according to the frequency of the transmitter signal. Dorsal/plantar flexion of the rat ankle joint was selectively induced by the developed neurostimulator. The rat ankle joint angle was controlled by changing the stimulation electrode and the stimulation current, based on the Proportional Integral (PI) control method using a visual feedback control system. This study was aimed at controlling the leg motion by stimulating the peripheral nerves using the neurostimulator.

Pixel-Level and Robust Vibration Source Sensing in High-Frame-Rate Video Analysis.

We investigate the effect of appearance variations on the detectability of vibration feature extraction with pixel-level digital filters for high-frame-rate videos. In particular, we consider robust vibrating object tracking, which is clearly different from conventional appearance-based object tracking with spatial pattern recognition in a high-quality image region of a certain size. For 512 × 512 videos of a rotating fan located at different positions and orientations and captured at 2000 frames per second with different lens settings, we verify how many pixels are extracted as vibrating regions with pixel-level digital filters. The effectiveness of dynamics-based vibration features is demonstrated by examining the robustness against changes in aperture size and the focal condition of the camera lens, the apparent size and orientation of the object being tracked, and its rotational frequency, as well as complexities and movements of background scenes. Tracking experiments for a flying multicopter with rotating propellers are also described to verify the robustness of localization under complex imaging conditions in outside scenarios.