Real-Time Shape Estimation of Hyper-Redundant Flexible Manipulator Using Coiled Fiber Sensors.

The shape of flexible endoscopic surgical robot should be obtained to increase control accuracy and prevent unwanted tissue damage. To estimate the shape of flexible manipulator, space efficiency, cost-effectiveness, system complexity, and ease of calibration should be considered to integrate sensors into the manipulator. In this article, we propose a real-time method to estimate the shape of a hyper-redundant manipulator having embedded coiled fiber sensors. The main advantage of this method is guaranteeing shape recognition even when the manipulator is subjected to an external load. The fiber sensors are highly flexible, compact, and inexpensive, as well as they can functionally measure both compressive and tensile strain of hyper-redundant manipulator. The sensor design was optimized to achieve durability and sensitivity. The numbers of sensor and the placements were determined by the analysis of the kinematics and moment distribution of the manipulator. The accuracy of shape estimation was validated experimentally under both free-loading and loading conditions. The proposed method achieved real-time estimating capability with a mean maximum error of each joint position smaller than 3.54% in free-loading condition and 5.47% in loading condition.

Soft Polymer-Actuated Compliant Microgripper with Adaptive Vibration-Controlled Grasp and Release.

Microgrippers that incorporate soft actuators are appropriate for micromanipulation or microsurgery owing to their ability to grasp objects without causing damage. However, developing a microgripper with a large gripping range that can produce a large force with high speed remains challenging in soft actuation mechanisms. Herein, we introduce a compliant microgripper driven by a soft dielectric elastomer actuator (DEA) called a spiral flexure cone DEA (SFCDEA). The submillimeter-scale SFCDEA exhibited a controllable linear displacement over a high bandwidth and the capability of lifting 100.9 g, which was 670 times higher than its mass. Subsequently, we developed a compliant microgripper based on the SFCDEA using smart composite microstructure technology to fabricate three-dimensional gripper linkages. We demonstrated that the microgripper was able to grasp various millimeter-scale objects with different shapes, sizes, and weights without a complex feedback control owing to its compliance. We proved the versatility of our gripper in robotic manipulation by demonstrating adaptive grasping and releasing of small objects using vibrations owing to its high bandwidth.

Multi-Degree-of-Freedom Force Sensor Incorporated into Soft Robotic Gripper for Improved Grasping Stability.

In recent years, soft robotic grippers have emerged as a promising solution for versatile and safe manipulation of objects in various fields. However, precise force control is critical, especially when handling delicate or fragile objects, to avoid excessive grip force application or to prevent object slippage. Herein, we propose a novel three-degree-of-freedom force sensor incorporated within a soft robotic gripper to realize stable grasping with force feedback. The proposed optical sensor employs lightweight and compact optical fibers, thereby allowing for cost-effective fabrication, and a robust sensing system that is immune to electromagnetic fields. By innervating the soft gripper with optical fibers, a durable system is achieved with the fibers functioning as a strengthening layer, thereby eliminating the need for embedding an external stiffening structure for efficient bending actuation. The innovative contact-based light loss sensing mechanism allows for a robust and stable sensing mechanism with low drift (<0.1% over 9000 cycles) that can be applied to soft pneumatic bending grippers. We used the developed sensor-incorporated soft gripper to grasp various objects, including magnetic materials, and achieved slip detection along with grip force feedback without any signal interference. Overall, this study proposes a robust measuring multi-degree-of-freedom force sensor that can be incorporated into grippers for improved grasping stability.

Soft Artificial Muscle Based on Pre-Detwinned Shape Memory Alloy Spring Actuator Achieving High Passive Assistive Torque for Wearable Robot.

For designing the assistive wearable rehabilitation robots, it is challenging to design the robot as energy efficient because the actuators have to be capable of overcoming human loads such as gravity of the body and spastic torque continuously during the assistance. To address these challenges, we propose a novel design of soft artificial muscle that utilizes shape memory alloy (SMA) spring actuators with pre-detwinning process. The SMA spring was fabricated through a process called pre-detwinning, which enhances the linearity of the SMA spring in martensite phase and unpowered restoring force, which is called passive force. The fabricated SMA spring can contract >60%. Finally, the soft wearable robot that can assist not only the gravitational torque exerted on the elbow by passive force, but also the elbow movements with active force was designed with a soft artificial muscle. A soft artificial muscle consists of the bundles of pre-detwinned SMA springs integrated with the stretchable coolant vessel. The stiffness of the muscle was measured as 1125 N/m in martensite phase and 1732 N/m in austenite phase. In addition, the muscle showed great actuation frequency performances, the bandwidth of which was measured as 0.5 Hz. The proposed wearable mechanism can fully compensate the gravitational torque for all the angles in passive mode. In addition, the proposed mechanism can produce high torque up to 3.5 Nm and movements in active mode.

Modeling dynamic behavior of dielectric elastomer muscle for robotic applications.

Recently, as a strong candidate for artificial muscle, dielectric elastomer actuators (DEAs) have been given the spotlight due to their attractive benefits from fast, large, and reversible electrically-controllable actuation in ultra-lightweight structures. Meanwhile, for practical use in mechanical systems such as robotic manipulators, the DEAs are facing challenges in their non-linear response, time-varying strain, and low load-bearing capability due to their soft viscoelastic nature. Moreover, the presence of an interrelation among the time-varying viscoelasticity, dielectric, and conductive relaxations causes difficulty in the estimation of their actuation performance. Although a rolled configuration of a multilayer stack DEA opens up a promising route to enhance mechanical properties, the use of multiple electromechanical elements inevitably causes the estimation of the actuation response to be more complex. In this paper, together with widely used strategies to construct DE muscles, we introduce adoptable models that have been developed to estimate their electro-mechanical response. Moreover, we propose a new model that combines both non-linear and time-dependent energy-based modeling theories for predicting the long-term electro-mechanical dynamic response of the DE muscle. We verified that the model could accurately estimate the long-term dynamic response for as long as 20 min only with small errors as compared with experimental results. Finally, we present future perspectives and challenges with respect to the performance and modeling of the DE muscles for their practical use in various applications including robotics, haptics, and collaborative devices.

Sigmoidal Auxiliary Tendon-Driven Mechanism Reinforcing Structural Stiffness of Hyper-Redundant Manipulator for Endoscopic Surgery.

The overtube of an endoscopic surgery robot is fixed when performing tasks, unlike those of commercial endoscopes, and this overtube should have high structural stiffness after reaching the target lesion so that sufficient tension can be applied to the lesion tissue with the surgical tool and there are fewer changes in the field of view of the endoscopic camera from this reaction force. Various methods have been proposed to reinforce the structural stiffnesses of hyper-redundant manipulators. However, the safety, rapid response, space efficiency, and cost-effectiveness of these methods should be considered for use in actual clinical environments, such as the gastrointestinal tract. This study proposed a method to minimize the positional changes of the overtube end tip due to external forces using only auxiliary tendons in the optimized path without additional mechanical structures. Overall, the proposed method involved moving the overtube to the target lesion through the main driving tendon and applying tension to the auxiliary tendons to reinforce the structural stiffness. The complete system was analyzed in terms of energy, and the sigmoidal auxiliary tendons were verified to effectively reinforce the structural stiffness of the overtube consisting of rolling joints. In addition, the design guidelines of the overtube for actual endoscopic surgery were proposed considering hollowness, retroflexion, and high structural stiffness. The positional changes due to external forces were confirmed to be reduced by 60% over the entire workspace.

Endoscopic surgery robot that facilitates insertion of the curved colon and ensures positional stability against external forces: K-COLON.

BACKGROUND: Although various endoscopic surgery robots developed in previous studies are versatile and have high lesion accessibility, they have limitations in terms of reaching the target lesion through the curved path in the large intestine and providing a stable tasking environment for the operator. METHODS: An endoscopic surgery robot was developed for performing surgery in the large intestine. The robot was easily inserted into the target lesion in the curved colon through the mounted soft actuator and demonstrated high structural stiffness through the insertion of the sigmoidal auxiliary tendons. RESULTS: The robot was able to access the target lesion in the curved colon through teleoperation alone. Further, it was confirmed that the high structural stiffness overtube improved the overall task performance in the user test. CONCLUSIONS: The proposed robotic system demonstrated the possibility and potential of performing advanced endoscopic surgery in the large intestine.

A Robust Soft Lens for Tunable Camera Application Using Dielectric Elastomer Actuators.

Developing tunable lenses, an expansion-based mechanism for dynamic focus adjustment can provide a larger focal length tuning range than a contraction-based mechanism. Here, we develop an expansion-tunable soft lens module using a disk-type dielectric elastomer actuator (DEA) that creates axially symmetric pulling forces on a soft lens. Adopted from a biological accommodation mechanism in human eyes, a soft lens at the annular center of a disk-type DEA pair is efficiently stretched to change the focal length in a highly reliable manner. A soft lens with a diameter of 3 mm shows a 65.7% change in the focal length (14.3-23.7 mm) under a dynamic driving voltage signal control. We confirm a quadratic relation between lens expansion and focal length that leads to large focal length tunability obtainable in the proposed approach. The fabricated tunable lens module can be used for soft, lightweight, and compact vision components in robots, drones, vehicles, and so on.

Electro-Active Polymer Based Soft Tactile Interface for Wearable Devices.

This paper reports soft actuator based tactile stimulation interfaces applicable to wearable devices. The soft actuator is prepared by multi-layered accumulation of thin electro-active polymer (EAP) films. The multi-layered actuator is designed to produce electrically-induced convex protrusive deformation, which can be dynamically programmable for wide range of tactile stimuli. The maximum vertical protrusion is and the output force is up to 255 mN. The soft actuators are embedded into the fingertip part of a glove and front part of a forearm band, respectively. We have conducted two kinds of experiments with 15 subjects. Perceived magnitudes of actuator's protrusion and vibrotactile intensity were measured with frequency of 1 Hz and 191 Hz, respectively. Analysis of the user tests shows participants perceive variation of protrusion height at the finger pad and modulation of vibration intensity through the proposed soft actuator based tactile interface.

Electrically tunable binary phase Fresnel lens based on a dielectric elastomer actuator.

We propose and demonstrate an all-solid-state tunable binary phase Fresnel lens with electrically controllable focal length. The lens is composed of a binary phase Fresnel zone plate, a circular acrylic frame, and a dielectric elastomer (DE) actuator which is made of a thin DE layer and two compliant electrodes using silver nanowires. Under electric potential, the actuator produces in-plane deformation in a radial direction that can compress the Fresnel zones. The electrically-induced deformation compresses the Fresnel zones to be contracted as high as 9.1% and changes the focal length, getting shorter from 20.0 cm to 14.5 cm. The measured change in the focal length of the fabricated lens is consistent with the result estimated from numerical simulation.

Flexible transparent displays based on core/shell upconversion nanophosphor-incorporated polymer waveguides.

Core/shell (C/S)-structured upconversion nanophosphor (UCNP)-incorporated polymer waveguide-based flexible transparent displays are demonstrated. Bright green- and blue-emitting Li(Gd,Y)F4:Yb,Er and Li(Gd,Y)F4:Yb,Tm UCNPs are synthesized via solution chemical route. Their upconversion luminescence (UCL) intensities are enhanced by the formation of C/S structure with LiYF4 shell. The Li(Gd,Y)F4:Yb,Er/LiYF4 and Li(Gd,Y)F4:Yb,Tm/LiYF4 C/S UCNPs exhibit 3.3 and 2.0 times higher UCL intensities than core counterparts, respectively. In addition, NaGdF4:Yb,Tm/NaGdF4:Eu C/S UCNPs are synthesized and they show red emission via energy transfer and migration of Yb3+ → Tm3+ → Gd3+ → Eu3+. The C/S UCNPs are incorporated into bisphenol A ethoxylate diacrylate which is used as a core material of polymer waveguides. The fabricated stripe-type polymer waveguides are highly flexible and transparent (transmittance > 90% in spectral range of 443-900 nm). The polymer waveguides exhibit bright blue, green, and red luminescence, depending on the incorporated UCNPs into the polymer core, under coupling with a near infrared (NIR) laser. Moreover, patterned polymer waveguide-based display devices are fabricated by reactive ion etching process and they realize bright blue-, green-, and red-colored characters under coupling with an NIR laser.

Perspective and Potential of Smart Optical Materials.

The increasing requirements of hyperspectral imaging optics, electro/photo-chromic materials, negative refractive index metamaterial optics, and miniaturized optical components from micro-scale to quantum-scale optics have all contributed to new features and advancements in optics technology. Development of multifunctional capable optics has pushed the boundaries of optics into new fields that require new disciplines and materials to maximize the potential benefits. The purpose of this study is to understand and show the fundamental materials and fabrication technology for field-controlled spectrally active optics (referred to as smart optics) that are essential for future industrial, scientific, military, and space applications, such as membrane optics, light detection and ranging (LIDAR) filters, windows for sensors and probes, telescopes, spectroscopes, cameras, light valves, light switches, and flat-panel displays. The proposed smart optics are based on the Stark and Zeeman effects in materials tailored with quantum dot arrays and thin films made from readily polarizable materials via ferroelectricity or ferromagnetism. Bound excitonic states of organic crystals are also capable of optical adaptability, tunability, and reconfigurability. To show the benefits of smart optics, this paper reviews spectral characteristics of smart optical materials and device technology. Experiments testing the quantum-confined Stark effect, arising from rare earth element doping effects in semiconductors, and applied electric field effects on spectral and refractive index are discussed. Other bulk and dopant materials were also discovered to have the same aspect of shifts in spectrum and refractive index. Other efforts focus on materials for creating field-controlled spectrally smart active optics (FCSAO) on a selected spectral range. Surface plasmon polariton transmission of light through apertures is also discussed, along with potential applications. New breakthroughs in micro scale multiple zone plate optics as a micro convex lens are reviewed, along with the newly discovered pseudo-focal point not predicted with conventional optics modeling. Micron-sized solid state beam scanner chips for laser waveguides are reviewed as well.

Structure modulated electrostatic deformable mirror for focus and geometry control.

We suggest a way to electrostatically control deformed geometry of an electrostatic deformable mirror (EDM) based on geometric modulation of a basement. The EDM is composed of a metal coated elastomeric membrane (active mirror) and a polymeric basement with electrode (ground). When an electrical voltage is applied across the components, the active mirror deforms toward the stationary basement responding to electrostatic attraction force in an air gap. Since the differentiated gap distance can induce change in electrostatic force distribution between the active mirror and the basement, the EDMs are capable of controlling deformed geometry of the active mirror with different basement structures (concave, flat, and protrusive). The modulation of the deformed geometry leads to significant change in the range of the focal length of the EDMs. Even under dynamic operations, the EDM shows fairly consistent and large deformation enough to change focal length in a wide frequency range (1~175 Hz). The geometric modulation of the active mirror with dynamic focus tunability can allow the EDM to be an active mirror lens for optical zoom devices as well as an optical component controlling field of view.

Thin film display based on polymer waveguides.

This paper reports thin, transparent, and soft displays based on polymer waveguides that are compliant with curvilinear interfaces. In order to prove a feasibility of optical waveguide for a flexible display, we suggest the waveguide fabricated by a multi-step lithography process using two photo-curable pre-polymers with different refractive index. The displays are composed of light sources, polymer waveguides, and scatter patterns. The light signal propagating through the waveguides forms images of the scatter patterns by deflecting the light signals to outer surface. The scatter patterns are configured to a seven-segment. The seven-segment design with a switching methodology of the light sources contributes to selectively representing all decimal numbers from 0 to 9 by combination of activated segments. For a large area display based on the proposed methodology, a single light source interconnected to multi-waveguide section is integrated with a QWERTY key pad design. The display shows high transparency and flexibility without visual distortion.

Polymer-waveguide-based flexible tactile sensor array for dynamic response.

A polymer-waveguide-based transparent and flexible force sensor array is proposed, which satisfies the principal requirements for a tactile sensor working on curvilinear surfaces, such as thinfilm architecture (thickness < 150 µm), localized force sensing (ca. 0-3 N), multiple-point re cognition (27 points), bending robustness (10.8% degradation at R = 1.5 mm), and fast response (bandwidth > 16 Hz).

Transparent and flexible force sensor array based on optical waveguide.

This paper suggests a force sensor array measuring contact force based on intensity change of light transmitted throughout optical waveguide. For transparency and flexibility of the sensor, two soft prepolymers with different refractive index have been developed. The optical waveguide consists of two cladding layers and a core layer. The top cladding layer is designed to allow light scattering at the specific area in response to finger contact. The force sensor shows a distinct tendency that output intensity decreases with input force and measurement range is from 0 to -13.2 dB.

Effect of frequency difference on sensitivity of beats perception.

Two vibrations with slightly different frequencies induce the beats phenomenon. In tactile perception, when two pins of different frequencies stimulate the fingertips, an individual perceives a beats caused by a summation stimulus of the two vibrations. The present study demonstrates experimentally that humans can perceive another vibration based on the beats phenomenon when two tactile stimuli with slightly different frequencies are stimulated on the finger pad with a small contactor in different locations at the same time. Moreover, we examined the amplitude of the detection threshold to be able to perceive beats phenomenon on the index finger with 5 carrier frequency (63.1, 100, 158.5, 251.2, and 398.1 Hz) and 4 beats frequency (2.5, 3.98, 6.31, and 10 Hz) when two stimuli 1 mm distance apart are vibrated at a slightly different frequency. From the experiments, it is concluded that the amplitude threshold to be able to perceive beats decreases as the standard frequency increases under 398 Hz. Furthermore, from comparing the absolute detection threshold and beats detection threshold, as the carrier frequency increases, the required amplitude at two pins for the detection of beats decreases compared to absolute vibration.

Ubi-Pen: a haptic interface with texture and vibrotactile display.

The Ubi-Pen is a pen-like haptic interface incorporating a compact tactile display and a vibrating module. It can represent tactile patterns and provide feedback with the click of a button. It's also applicable to combined force- and tactile-feedback display.

Haptic stylus and empirical studies on braille, button, and texture display.

This paper presents a haptic stylus interface with a built-in compact tactile display module and an impact module as well as empirical studies on Braille, button, and texture display. We describe preliminary evaluations verifying the tactile display's performance indicating that it can satisfactorily represent Braille numbers for both the normal and the blind. In order to prove haptic feedback capability of the stylus, an experiment providing impact feedback mimicking the click of a button has been conducted. Since the developed device is small enough to be attached to a force feedback device, its applicability to combined force and tactile feedback display in a pen-held haptic device is also investigated. The handle of pen-held haptic interface was replaced by the pen-like interface to add tactile feedback capability to the device. Since the system provides combination of force, tactile and impact feedback, three haptic representation methods for texture display have been compared on surface with 3 texture groups which differ in direction, groove width, and shape. In addition, we evaluate its capacity to support touch screen operations by providing tactile sensations when a user rubs against an image displayed on a monitor.