An improved contrastive learning network for semi-supervised multi-structure segmentation in echocardiography.

Cardiac diseases have high mortality rates and are a significant threat to human health. Echocardiography is a commonly used imaging technique to diagnose cardiac diseases because of its portability, non-invasiveness and low cost. Precise segmentation of basic cardiac structures is crucial for cardiologists to efficiently diagnose cardiac diseases, but this task is challenging due to several reasons, such as: (1) low image contrast, (2) incomplete structures of cardiac, and (3) unclear border between the ventricle and the atrium in some echocardiographic images. In this paper, we applied contrastive learning strategy and proposed a semi-supervised method for echocardiographic images segmentation. This proposed method solved the above challenges effectively and made use of unlabeled data to achieve a great performance, which could help doctors improve the accuracy of CVD diagnosis and screening. We evaluated this method on a public dataset (CAMUS), achieving mean Dice Similarity Coefficient (DSC) of 0.898, 0.911, 0.916 with 1/4, 1/2 and full labeled data on two-chamber (2CH) echocardiography images, and of 0.903, 0.921, 0.928 with 1/4, 1/2 and full labeled data on four-chamber (4CH) echocardiography images. Compared with other existing methods, the proposed method had fewer parameters and better performance. The code and models are available at https://github.com/gpgzy/CL-Cardiac-segmentation.

Towards real-time finite-strain anisotropic thermo-visco-elastodynamic analysis of soft tissues for thermal ablative therapy.

BACKGROUND AND OBJECTIVES: Accurate and efficient prediction of soft tissue temperatures is essential to computer-assisted treatment systems for thermal ablation. It can be used to predict tissue temperatures and ablation volumes for personalised treatment planning and image-guided intervention. Numerically, it requires full nonlinear modelling of the coupled computational bioheat transfer and biomechanics, and efficient solution procedures; however, existing studies considered the bioheat analysis alone or the coupled linear analysis, without the fully coupled nonlinear analysis. METHODS: We present a coupled thermo-visco-hyperelastic finite element algorithm, based on finite-strain thermoelasticity and total Lagrangian explicit dynamics. It considers the coupled nonlinear analysis of (i) bioheat transfer under soft tissue deformations and (ii) soft tissue deformations due to thermal expansion/shrinkage. The presented method accounts for anisotropic, finite-strain, temperature-dependent, thermal, and viscoelastic behaviours of soft tissues, and it is implemented using GPU acceleration for real-time computation. RESULTS: The presented method can achieve thermo-visco-elastodynamic analysis of anisotropic soft tissues undergoing large deformations with high computational speeds in tetrahedral and hexahedral finite element meshes for surgical simulation of thermal ablation. We also demonstrate the translational benefits of the presented method for clinical applications using a simulation of thermal ablation in the liver. CONCLUSION: The key advantage of the presented method is that it enables full nonlinear modelling of the anisotropic, finite-strain, temperature-dependent, thermal, and viscoelastic behaviours of soft tissues, instead of linear elastic, linear viscoelastic, and thermal-only modelling in the existing methods. It also provides high computational speeds for computer-assisted treatment systems towards enabling the operator to simulate thermal ablation accurately and visualise tissue temperatures and ablation zones immediately.

Fast computation of soft tissue thermal response under deformation based on fast explicit dynamics finite element algorithm for surgical simulation.

BACKGROUND AND OBJECTIVES: During thermal heating surgical procedures such as electrosurgery, thermal ablative treatment and hyperthermia, soft tissue deformation due to surgical tool-tissue interaction and patient movement can affect the distribution of thermal energy induced. Soft tissue temperature must be obtained from the deformed tissue for precise delivery of thermal energy. However, the classical Pennes bio-heat transfer model can handle only the static non-moving state of tissue. In addition, in order to enable a surgeon to visualise the simulated results immediately, the solution procedure must be suitable for real-time thermal applications. METHODS: This paper presents a formulation of bio-heat transfer under the effect of soft tissue deformation for fast or near real-time tissue temperature prediction, based on fast explicit dynamics finite element algorithm (FED-FEM) for transient heat transfer. The proposed thermal analysis under deformation is achieved by transformation of the unknown deformed tissue state to the known initial static state via a mapping function. The appropriateness and effectiveness of the proposed formulation are evaluated on a realistic virtual human liver model with blood vessels to demonstrate a clinically relevant scenario of thermal ablation of hepatic cancer. RESULTS: For numerical accuracy, the proposed formulation can achieve a typical 10-3 level of normalised relative error at nodes and between 10-4 and 10-5 level of total errors for the simulation, by comparing solutions against the commercial finite element analysis package. For computation time, the proposed formulation under tissue deformation with anisotropic temperature-dependent properties consumes 2.518 × 10-4 ms for one element thermal loads computation, compared to 2.237 × 10-4 ms for the formulation without deformation which is 0.89 times of the former. Comparisons with three other formulations for isotropic and temperature-independent properties are also presented. CONCLUSIONS: Compared to conventional methods focusing on numerical accuracy, convergence and stability, the proposed formulation focuses on computational performance for fast tissue thermal analysis. Compared to the classical Pennes model that handles only the static state of tissue, the proposed formulation can achieve fast thermal analysis on deformed states of tissue and can be applied in addition to tissue deformable models for non-linear heating analysis at even large deformation of soft tissue, leading to great translational potential in dynamic tissue temperature analysis and thermal dosimetry computation for computer-integrated medical education and personalised treatment.

Neural network methodology for real-time modelling of bio-heat transfer during thermo-therapeutic applications.

Real-time simulation of bio-heat transfer can improve surgical feedback in thermo-therapeutic treatment, leading to technical innovations to surgical process and improvements to patient outcomes; however, it is challenging to achieve real-time computational performance by conventional methods. This paper presents a cellular neural network (CNN) methodology for fast and real-time modelling of bio-heat transfer with medical applications in thermo-therapeutic treatment. It formulates nonlinear dynamics of the bio-heat transfer process and spatially discretised bio-heat transfer equation as the nonlinear neural dynamics and local neural connectivity of CNN, respectively. The proposed CNN methodology considers three-dimensional (3-D) volumetric bio-heat transfer behaviour in tissue and applies the concept of control volumes for discretisation of the Pennes bio-heat transfer equation on 3-D irregular grids, leading to novel neural network models embedded with bio-heat transfer mechanism for computation of tissue temperature and associated thermal dose. Simulations and comparative analyses demonstrate that the proposed CNN models can achieve good agreement with the commercial finite element analysis package, ABAQUS/CAE, in numerical accuracy and reduce computation time by 304 and 772.86 times compared to those of with and without ABAQUS parallel execution, far exceeding the computational performance of the commercial finite element codes. The medical application is demonstrated using a high-intensity focused ultrasound (HIFU)-based thermal ablation of hepatic cancer for prediction of tissue temperature and estimation of thermal dose.

Modeling of soft tissue thermal damage based on GPU acceleration.

Hyperthermia treatments require precise control of thermal energy to form the coagulation zones which sufficiently cover the tumor without affecting surrounding healthy tissues. This has led modeling of soft tissue thermal damage to become important in hyperthermia treatments to completely eradicate tumors without inducing tissue damage to surrounding healthy tissues. This paper presents a methodology based on GPU acceleration for modeling and analysis of bio-heat conduction and associated thermal-induced tissue damage for prediction of soft tissue damage in thermal ablation, which is a typical hyperthermia therapy. The proposed methodology combines the Arrhenius Burn integration with Pennes' bio-heat transfer for prediction of temperature field and thermal damage in soft tissues. The problem domain is spatially discretized on 3-D linear tetrahedral meshes by the Galerkin finite element method and temporally discretized by the explicit forward finite difference method. To address the expensive computation load involved in the finite element method, GPU acceleration is implemented using the High-Level Shader Language and achieved via a sequential execution of compute shaders in the GPU rendering pipeline. Simulations on a cube-shape specimen and comparison analysis with standalone CPU execution were conducted, demonstrating the proposed GPU-accelerated finite element method can effectively predict the temperature distribution and associated thermal damage in real time. Results show that the peak temperature is achieved at the heat source point and the variation of temperature is mainly dominated in its direct neighbourhood. It is also found that by the continuous application of point-source heat energy, the tissue at the heat source point is quickly necrotized in a matter of seconds, while the entire neighbouring tissues are fully necrotized in several minutes. Further, the proposed GPU acceleration significantly improves the computational performance for soft tissue thermal damage prediction, leading to a maximum reduction of 55.3 times in computation time comparing to standalone CPU execution.

Neural network modelling of soft tissue deformation for surgical simulation.

This paper presents a new neural network methodology for modelling of soft tissue deformation for surgical simulation. The proposed methodology formulates soft tissue deformation and its dynamics as the neural propagation and dynamics of cellular neural networks for real-time, realistic, and stable simulation of soft tissue deformation. It develops two cellular neural network models; based on the bioelectric propagation of biological tissues and principles of continuum mechanics, one cellular neural network model is developed for propagation and distribution of mechanical load in soft tissues; based on non-rigid mechanics of motion in continuum mechanics, the other cellular neural network model is developed for governing model dynamics of soft tissue deformation. The proposed methodology not only has computational advantage due to the collective and simultaneous activities of neural cells to satisfy the real-time computational requirement of surgical simulation, but also it achieves physical realism of soft tissue deformation according to the bioelectric propagation manner of mechanical load via dynamic neural activities. Furthermore, the proposed methodology also provides stable model dynamics for soft tissue deformation via the nonlinear property of the cellular neural network. Interactive soft tissue deformation with haptic feedback is achieved via a haptic device. Simulations and experimental results show the proposed methodology exhibits the nonlinear force-displacement relationship and associated nonlinear deformation of soft tissues. Furthermore, not only isotropic and homogeneous but also anisotropic and heterogeneous materials can be modelled via a simple modification of electrical conductivity values of mass points.

Deformable Models for Surgical Simulation: A Survey.

This paper presents a survey of the state-of-the-art deformable models studied in the literature, with regard to soft tissue deformable modeling for interactive surgical simulation. It first introduces the challenges of surgical simulation, followed by discussions and analyses on the deformable models, which are classified into three categories: the heuristic modeling methodology, continuum-mechanical methodology, and other methodologies. It also examines linear and nonlinear deformable modeling, model internal forces, and numerical time integrations, together with modeling of soft tissue anisotropy, viscoelasticity, and compressibility. Finally, various issues in the existing deformable models are discussed to outline the remaining challenges of deformable models in surgical simulation.

Soft tissue deformation modelling through neural dynamics-based reaction-diffusion mechanics.

Soft tissue deformation modelling forms the basis of development of surgical simulation, surgical planning and robotic-assisted minimally invasive surgery. This paper presents a new methodology for modelling of soft tissue deformation based on reaction-diffusion mechanics via neural dynamics. The potential energy stored in soft tissues due to a mechanical load to deform tissues away from their rest state is treated as the equivalent transmembrane potential energy, and it is distributed in the tissue masses in the manner of reaction-diffusion propagation of nonlinear electrical waves. The reaction-diffusion propagation of mechanical potential energy and nonrigid mechanics of motion are combined to model soft tissue deformation and its dynamics, both of which are further formulated as the dynamics of cellular neural networks to achieve real-time computational performance. The proposed methodology is implemented with a haptic device for interactive soft tissue deformation with force feedback. Experimental results demonstrate that the proposed methodology exhibits nonlinear force-displacement relationship for nonlinear soft tissue deformation. Homogeneous, anisotropic and heterogeneous soft tissue material properties can be modelled through the inherent physical properties of mass points. Graphical abstract Soft tissue deformation modelling with haptic feedback via neural dynamics-based reaction-diffusion mechanics.

ChainMail based neural dynamics modeling of soft tissue deformation for surgical simulation.

BACKGROUND: Realistic and real-time modeling and simulation of soft tissue deformation is a fundamental research issue in the field of surgical simulation. OBJECTIVE: In this paper, a novel cellular neural network approach is presented for modeling and simulation of soft tissue deformation by combining neural dynamics of cellular neural network with ChainMail mechanism. METHOD: The proposed method formulates the problem of elastic deformation into cellular neural network activities to avoid the complex computation of elasticity. The local position adjustments of ChainMail are incorporated into the cellular neural network as the local connectivity of cells, through which the dynamic behaviors of soft tissue deformation are transformed into the neural dynamics of cellular neural network. RESULTS: Experiments demonstrate that the proposed neural network approach is capable of modeling the soft tissues' nonlinear deformation and typical mechanical behaviors. CONCLUSIONS: The proposed method not only improves ChainMail's linear deformation with the nonlinear characteristics of neural dynamics but also enables the cellular neural network to follow the principle of continuum mechanics to simulate soft tissue deformation.

Cellular neural network modelling of soft tissue dynamics for surgical simulation.

BACKGROUND: Currently, the mechanical dynamics of soft tissue deformation is achieved by numerical time integrations such as the explicit or implicit integration; however, the explicit integration is stable only under a small time step, whereas the implicit integration is computationally expensive in spite of the accommodation of a large time step. OBJECTIVE: This paper presents a cellular neural network method for stable simulation of soft tissue deformation dynamics. METHOD: The non-rigid motion equation is formulated as a cellular neural network with local connectivity of cells, and thus the dynamics of soft tissue deformation is transformed into the neural dynamics of the cellular neural network. RESULTS: Results show that the proposed method can achieve good accuracy at a small time step. It still remains stable at a large time step, while maintaining the computational efficiency of the explicit integration. CONCLUSION: The proposed method can achieve stable soft tissue deformation with efficiency of explicit integration for surgical simulation.

A new ChainMail approach for real-time soft tissue simulation.

This paper presents a new ChainMail method for real-time soft tissue simulation. This method enables the use of different material properties for chain elements to accommodate various materials. Based on the ChainMail bounding region, a new time-saving scheme is developed to improve computational efficiency for isotropic materials. The proposed method also conserves volume and strain energy. Experimental results demonstrate that the proposed ChainMail method can not only accommodate isotropic, anisotropic and heterogeneous materials but also model incompressibility and relaxation behaviors of soft tissues. Further, the proposed method can achieve real-time computational performance.