A fully autonomous robotic ultrasound system for thyroid scanning.

The current thyroid ultrasound relies heavily on the experience and skills of the sonographer and the expertise of the radiologist, and the process is physically and cognitively exhausting. In this paper, we report a fully autonomous robotic ultrasound system, which is able to scan thyroid regions without human assistance and identify malignant nod- ules. In this system, human skeleton point recognition, reinforcement learning, and force feedback are used to deal with the difficulties in locating thyroid targets. The orientation of the ultrasound probe is adjusted dynamically via Bayesian optimization. Experimental results on human participants demonstrated that this system can perform high-quality ultrasound scans, close to manual scans obtained by clinicians. Additionally, it has the potential to detect thyroid nodules and provide data on nodule characteristics for American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) calculation.

Adaptive Fixed-Time Control for High-Order Stochastic Nonlinear Time-Delay Systems: An Improved Lyapunov-Krasovskii Function.

In this article, the adaptive tracking control problem is considered for high-order stochastic nonlinear time-delay systems in fixed-time. Being different from existing results, an improved Lyapunov-Krasovskii function is designed, which can not only compensate for the time-delay term but also remove the obstacle from the high-order term. Due to the introduction of the Lyapunov-Krasovskii function into the total Lyapunov function, it makes it difficult to stabilize the controlled system within a fixed-time interval. L'Hopital's rule is used to determine the boundedness of the Lyapunov-Krasovskii function, and the fixed-time boundedness of the integral functions can be inferred. By utilizing the fixed-time Lyapunov stability theorem, it is proved that the controlled system is semi-globally practical fixed-time stable (SGPFS), all the closed-loop signals (CLSs) are bounded within the fixed-time interval, and the tracking error converges into a small region around zero. The validity of the designed scheme is substantiated via simulation results.

Design and Psychophysical Evaluation of a Novel Wearable Upper-Arm Tactile Display Device.

A novel wearable upper arm tactile display device, which can simultaneously provide three types of tactile stimuli (i.e., squeezing, stretching, and vibration) is presented. The squeezing and stretching stimulation of the skin is generated by two motors simultaneously driving the nylon belt in the opposite and the same direction, respectively. In addition, four evenly spaced vibration motors are fixed around the user's arm by an elastic nylon band. There is also a unique structural design for assembling the control module and actuator, powered by two lithium batteries, making it portable and wearable. Psychophysical experiments are conducted to investigate the effect of interference on the perception of squeezing and stretching stimulation by this device. Results show that (1) different tactile stimuli actually interfere with the user's perception compared to the case where only one stimulus is applied to the user; (2) the squeezing has a considerable impact on the stretch just noticeable difference (JND) values when both stimuli are exerted on the user, and when the squeezing is strong, while the impact of stretch on the squeezing JND values is negligible.

Modeling fibrous soft tissue dissection with elastic-plastic deformation for simulation of brain tumor removal.

BACKGROUND AND OBJECTIVE: Realistic modeling the dissection of brain tissue is of key importance for simulation of brain tumor removal in virtual neurosurgery systems. However, existing methods are unable to characterize inelastic behaviors of brain tissue, such as plastic deformation and dissection evolution, making it ineffective in simulating brain tumor removal procedures. METHODS: In this paper, a model of fibrous soft tissue dissection for the simulation of brain tumor removal is proposed. A dissection variable of representative volume element is used to characterize the dissection state of the fibrous soft tissue. The evolution of dissection with elastic-plastic deformation under the effects of external loads is presented. RESULTS: Simulation results show that the proposed model provides realistic, stable and intuitive results in the simulation of fracture in fibrous soft tissues. As the external load increases, the fibrous soft tissue begins to crack, with the cracks growing and multiplying until they eventually merge to form a fracture. The proposed model is incorporated into the simulation of brain tumor removal. CONCLUSIONS: The experimental results demonstrate the feasibility of modeling fibrous soft tissue dissection with elastic-plastic deformation. A relative high degree of realistic visual feedback is achieved.

Command filter-based adaptive fuzzy decentralized control for stochastic nonlinear large-scale systems with saturation constraints and unknown disturbance.

In this article, the problem of decentralized fuzzy adaptive control is addressed for a class of stochastic interconnected nonlinear large-scale systems including saturation and unknown disturbance. Fuzzy logic systems (FLSs) are used to estimate packaged nonlinear uncertainties. The command filter technique is presented to eliminate the "explosion of complexity" obstacle associated with the backstepping procedures and the corresponding error compensation mechanism is constructed to alleviate the effect of the errors generated by command filters. The influence of input saturation is compensated by introducing an auxiliary system. Meanwhile, an improved adaptive fuzzy decentralized controller is developed and it is able to minimize calculation time since there is no need for repeated differentiation for the virtual control laws. The presented control scheme not only assures the semi-global boundedness of all the signals in the closed-loop system, but also makes the output tracking errors reach a small neighborhood around the origin. Finally, both numerical and practical examples are provided to illustrate the efficiency and effectiveness of our theoretic result.

Fast Finite-Time Control for Nonaffine Stochastic Nonlinear Systems Against Multiple Actuator Constraints via Output Feedback.

This research addresses the finite-time control problem for nonaffine stochastic nonlinear systems with actuator faults and input saturation. Specifically, a new finite-time control scheme is constructed based on the adaptive backstepping framework, with the usage of a state observer and taking advantage of the universal approximation capability of the fuzzy-logic system (FLS). The novelty of this work is that it considers the output feedback problem of a completely nonaffine stochastic system and incorporates the idea of the dynamic surface control (DSC) design. By using the Lyapunov stability theory, all the signals of the controlled system can be semiglobal finite-time stable in probability (SGFSP) while the system is imposed with multiple actuator constraints. In the meantime, the problem of "complexity explosion" is avoided. Two simulation examples are given to demonstrate the validity of the presented strategy.

Input-to-State Stability for Time-Delay Systems With Large Delays.

In this article, we consider the input-to-state stability (ISS) problem for a class of time-delay systems with intermittent large delays, which may cause the invalidation of traditional delay-dependent stability criteria. The topic of this article features that it proposes a novel kind of stability criterion for time-delay systems, which is delay dependent if the time delay is smaller than a prescribed allowable size. While if the time delay is larger than the allowable size, the ISS can be preserved as well provided that the large-delay periods satisfy the kind of duration condition. Different from existing results on similar topics, we present the main result based on a unified Lyapunov-Krasovskii function (LKF). In this way, the frequency restriction can be removed and the analysis complexity can be simplified. A numerical example is provided to verify the proposed results.

Neural-Network-Based Adaptive Fixed-Time Control for Nonlinear Multiagent Non-Affine Systems.

In this research, the adaptive neural network consensus control problem is addressed for a class of non-affine multiagent systems (MASs) with actuator faults and stochastic disturbances. To overcome difficulties associated with actuator faults and uncertain functions of the designed MAS, a neural network fault-tolerant control scheme is developed. Moreover, an adaptive backstepping controller is developed to solve the non-affine appearance in multiagent stochastic non-affine systems using the mean value theorem. Being different from the existing control methods, the developed adaptive fixed-time control approach can ensure that the outputs of all followers track the reference signal synchronously in the fixed time, and all signals of the controlled system are semi-globally uniformly fixed-time stable. The simulation results confirm that the presented control strategy is effective in achieving control goals.

Stabilization and Data-Rate Condition for Stability of Networked Control Systems With Denial-of-Service Attacks.

This article investigates the stabilization control and stabilizing data-rate condition problems for networked control systems, which transmit signals from the sensor to the controller over the communication network with denial-of-service (DoS) attacks. Considering a class of DoS attacks that only constrain its frequency and duration, we aim to explore the constraint condition for stabilization and minimum stabilizing data rate of the networked control systems. The framework consists of two main parts. The first part considers the stabilizing control by the state-feedback approach under ideal bandwidth capacity. While the second part characterizes the average stabilizing data rate in terms of the eigenvalues of system matrix and DoS constraint functions to explicitly reveal the relationship between the attacks and the network bandwidth capacity. The stabilizing result is novel in the sense that the DoS-attack intensity, which is characterized by its frequency and duration, can vary for different time intervals. With this feature, the minimum average data-rate condition can vary for different time intervals according to the intensity of DoS attacks.

Fuzzy adaptive finite-time output feedback control of stochastic nonlinear systems.

An adaptive finite-time approach to the feedback control of stochastic nonlinear systems is presented. The fuzzy logic system (FLS) and a state observer are used to estimate the uncertain function and unmeasured state of the controlled system, respectively. A dynamic surface control (DSC) scheme is employed to deal with the "computational explosion" problem, which is inherent in traditional backstepping methods since the repetitive calculation of the derivatives of virtual control signals is avoided. A new output feedback controller is developed to guarantee that all the signals of the controlled system are bounded within a finite time range and the tracking deviation can converge to an arbitrarily small residual set within finite time. Simulations confirm the analytical and theoretical results of the presented algorithm.

Finite-Time-Prescribed Performance-Based Adaptive Fuzzy Control for Strict-Feedback Nonlinear Systems With Dynamic Uncertainty and Actuator Faults.

In this article, finite-time-prescribed performance-based adaptive fuzzy control is considered for a class of strict-feedback systems in the presence of actuator faults and dynamic disturbances. To deal with the difficulties associated with the actuator faults and external disturbance, an adaptive fuzzy fault-tolerant control strategy is introduced. Different from the existing controller design methods, a modified performance function, which is called the finite-time performance function (FTPF), is presented. It is proved that the presented controller can ensure all the signals of the closed-loop system are bounded and the tracking error converges to a predetermined region in finite time. The effectiveness of the presented control scheme is verified through the simulation results.

Classification of Imbalanced Electrocardiosignal Data using Convolutional Neural Network.

BACKGROUND AND OBJECTIVE: In the application of wearable heart-monitors, it is of great significance to analyze electrocardiogram (ECG) signals for anomaly detection. ECG arrhythmia classification remains an open problem in that it cannot easily recognize data from minority classes due to the imbalanced dataset and particular characteristic of the time series signal. In this study, a novel method is presented as a possible solution to imbalanced classification problems. METHODS: An improved data augmentation method based on variational auto-encoder (VAE) and auxiliary classifier generative adversarial network (ACGAN) is implemented to address the difficulties resulting from the imbalanced dataset. Based on the augmented dataset, convolutional neural network (CNN) classifiers are employed to automatically recognize arrhythmias using two-dimensional ECG images. RESULTS: In experimental studies conducted with the MIT-BIH arrhythmia database, the proposed method achieves 98.45% accuracy and 97.03% sensitivity. The sensitivities of two minority classes achieve 95.83% and 97.37%, respectively. CONCLUSION: In imbalanced classification, the sensitivity of minority class is a key evaluation indicator. One of the significant contributions of this study is that the proposed method can obtain higher sensitivity of minority class. The experimental results demonstrate that the proposed method for ECG arrhythmia calssification under imbalanced data has better performance compared with traditional cropping augmentation methods and traditional classifiers.

Guaranteed Synchronization Performance Control of Nonlinear Time-Delay MIMO Multiagent Systems With Actuator Faults.

This paper addresses the synchronization control problem of leader-follower multiagent systems with each follower described by a class of high-order nonlinear multiple-input-multiple-output (MIMO) dynamics in the presence of time delays and actuator faults. A distributed synchronization scheme with guaranteed synchronization performance based on the radial basis function neural network (RBF NN) is introduced. We propose an augmented quadratic Lyapunov function by incorporating the lower bounds of control gain matrices and the actuator healthy indicator, and the problems caused by the unknown time-varying control gain matrices, actuator faults, and coupling terms among agents are solved. Meanwhile, the output of followers can track that of the leader and the steady state, and the transient performance of synchronization can be guaranteed, while all the other signals in the closed-loop system are guaranteed to be bounded. Finally, numerical analysis has been carried out to verify the effectiveness of the proposed controller.

A morphing-Based 3D point cloud reconstruction framework for medical image processing.

BACKGROUND AND OBJECTIVE: In the virtual surgery simulation system, the reconstruction of a highly precise soft tissue 3D model is an effective method to improve the user's visual telepresence. However, the traditional point cloud generation method based on subdivision and filling is unsatisfactory due to its low accuracy and slow speed. METHODS: To address this problem, we present a novel 3D point cloud reconstructing model based on Morphing. The 3D surface model of soft tissue (live) is obtained from a series of 2D CT images using Mimics. The 3D voxel model of soft tissue is reconstructed through a sequential change of the 3D surface model by utilizing Morphing. A nonlinear interpolation method is used to fit the irregular shape of the model and improve simulation accuracy. RESULTS: The point cloud model builds from discrete points, avoiding the problems of instability and computational complexity, which are inherent in both the surface and volume models for soft tissue. Compared with the volumetric subdividing and voxel filling method, the simulation results show that the 3D cloud model reconstructed based on Morphing is more fast, accurate and consistent with the real soft tissue. CONCLUSIONS: The simulating experiment of soft tissue deformation using 3D point cloud model which reconstructed using moprhing proved our method is effective and correct.

A diffeomorphic unsupervised method for deformable soft tissue image registration.

BACKGROUND AND OBJECTIVES: The image registration methods for deformable soft tissues utilize nonlinear transformations to align a pair of images precisely. In some situations, when there is huge gray scale difference or large deformation between the images to be registered, the deformation field tends to fold at some local voxels, which will result in the breakdown of the one-to-one mapping between images and the reduction of invertibility of the deformation field. In order to address this issue, a novel registration approach based on unsupervised learning is presented for deformable soft tissue image registration. METHODS: A novel unsupervised learning based registration approach, which consists of a registration network, a velocity field integration module and a grid sampling module, is presented for deformable soft tissue image registration. The main contributions are: (1) A novel encoder-decoder network is presented for the evaluation of stationary velocity field. (2) A Jacobian determinant based penalty term (Jacobian loss) is developed to reduce the folding voxels and to improve the invertibility of the deformation field. RESULTS AND CONCLUSIONS: The experimental results show that a new pair of images can be accurately registered using the trained registration model. In comparison with the conventional state-of-the-art method, SyN, the invertibility of the deformation field, accuracy and speed are all improved. Compared with the deep learning based method, VoxelMorph, the proposed method improves the invertibility of the deformation field.

Adaptive Fuzzy Finite-Time Control of Nonlinear Systems With Actuator Faults.

This paper addresses the trajectory tracking control problem of a class of nonstrict-feedback nonlinear systems with the actuator faults. The functional relationship in the affine form between the nonlinear functions with whole state and error variables is established by using the structure consistency of intermediate control signals and the variable-partition technique. The fuzzy control and adaptive backstepping schemes are applied to construct an improved fault-tolerant controller without requiring the specific knowledge of control gains and actuator faults, including both stuck constant value and loss of effectiveness. The proposed fault-tolerant controller ensures that all signals in the closed-loop system are semiglobally practically finite-time stable and the tracking error remains in a small neighborhood of the origin after a finite period of time. The developed control method is verified through two numerical examples.

Adaptive Neural Output-Feedback Decentralized Control for Large-Scale Nonlinear Systems With Stochastic Disturbances.

This paper addresses the problem of adaptive neural output-feedback decentralized control for a class of strongly interconnected nonlinear systems suffering stochastic disturbances. An state observer is designed to approximate the unmeasurable state signals. Using the approximation capability of radial basis function neural networks (NNs) and employing classic adaptive control strategy, an observer-based adaptive backstepping decentralized controller is developed. In the control design process, NNs are applied to model the uncertain nonlinear functions, and adaptive control and backstepping are combined to construct the controller. The developed control scheme can guarantee that all signals in the closed-loop systems are semiglobally uniformly ultimately bounded in fourth-moment. The simulation results demonstrate the effectiveness of the presented control scheme.

Distributed Synchronization Control of Nonaffine Multiagent Systems With Guaranteed Performance.

This paper deals with the synchronization control problem in the leader-follower format of a class of high-order nonaffine nonlinear multiagent systems under a directed communication protocol. A novel adaptive neural distributed synchronization scheme with guaranteed performance is proposed. The main contribution lies in the fact that both nonaffine agent dynamics, which basically makes most existing agent dynamics as special cases, and guaranteed synchronization performance are taken into account. The difficulty lies mainly in the nonaffine terms and coupling terms due to the interactions of agents. To overcome this challenge, an augmented quadratic Lyapunov function by incorporating the lower bounds of control gains is proposed. The problems resulting from the nonaffine dynamics and the coupling terms among agents are solved by incorporating the special property of radial basis function neural network into the derivative of the augmented quadratic Lyapunov function. The unknown nonaffine terms are addressed by using an indirected neural network approach. A nonlinear mapping is built to relate the local consensus error to a new one, which is subsequently stabilized via Lyapunov synthesis. As a result, the proposed approach can ensure the outputs of all follower agents to track the outputs of the leader, while the synchronization performance bounds can be quantified on both transient and steady-state stages. All other signals in the closed loop are ensured to be semiglobally, uniformly, and ultimately bounded. Finally, the effectiveness of the proposed controller is verified through a heterogeneous four-agent example.

Cutting procedures with improved visual effects and haptic interaction for surgical simulation systems.

BACKGROUND AND OBJECTIVES: Surface rendering and physical models with constant parameters are often employed for cutting procedures in conventional surgical simulators. As a consequence, the internal structures of soft tissues cannot be rendered properly and haptic interaction is unrealistic. In order to improve both the visual and force feedback, a new volumetric geometric model is introduced. METHODS: In this paper, we introduce a new volumetric geometric model, for which multidimensional parameters are derived from the gray values to map the color and transparency of the 3D soft tissues. In the meantime, the biomechanical properties of soft tissues are described by a meshless physical model and the model parameters are closely correlated to the multidimensional parameters of the developed volumetric geometric model. As a beneficial result, the force feedback changes according to the physical properties of different soft tissue structures, which reflects better the real-life scenarios during the course of cutting procedures. RESULTS AND CONCLUSIONS: Simulation results show that both the surface and internal structures of soft tissues can be rendered properly and the boundaries between different tissue structures are visually distinct in incision. The curves of feedback force change according to the different structures of soft tissue, improving haptic interaction. Compared with the conventional cutting model, both visual effect and haptic interaction are improved in the proposed volumetric geometric model.

A new volumetric geometric model for cutting procedures in surgical simulation.

BACKGROUND AND OBJECTIVES: Cutting procedures are the most common operations in surgical simulation. In order to provide realistic visual feedback with the details of the internal structures of soft tissue to the operator, a novel volumetric geometric model is presented for cutting procedures in surgical simulation. METHODS: A novel volumetric geometric model, which is based on volume rendering and the Bézier curve, is presented for cutting procedures. The Bézier curve is used to optimize the physical model of cutting simulation, making the edge of incision smooth without increasing the computational load of the physical model. Volume rendering is used to render the cutting process, which improves significantly the realism of simulation since both surface textures and the details of the internal structures of soft tissues are rendered. RESULTS AND CONCLUSIONS: The simulation results show that the edges of the incision optimized by using the proposed geometric model are smooth and the details of internal structures of soft tissue can be rendered. In comparison with other volumetric models, the computational efficiency is much improved. Compared with conventional cutting simulation methods, the proposed volumetric geometric model improves the effects of visual feedback since both surface and internal structures are rendered according to the optimized physical model.