Point Cloud Registration for Measuring Shape Dependence of Soft Tissue Deformation by Digital Twins in Head and Neck Surgery.

Introduction: A 2½ D point cloud registration method was developed to generate digital twins of different tissue shapes and resection cavities by applying a machine learning (ML) approach. This demonstrates the feasibility of quantifying soft tissue shifts. Methods: An ML model was trained using simulated surface scan data obtained from tumor resections in a pig head cadaver model. It hereby uses 438 2½ D scans of the tissue surface. Tissue shift was induced by a temperature change from 7.91 ± 4.1°C to 36.37 ± 1.28°C. Results: Digital twins were generated from various branched and compact resection cavities (RCs) and cut tissues (CT). A temperature increase induced a tissue shift with a significant volume increase of 6 mL and 2 mL in branched and compact RCs, respectively (p = 0.0443; 0.0157). The volumes of branched and compact CT were decreased by 3 and 4 mL (p < 0.001). In the warm state, RC and CT no longer fit together because of the significant tissue deformation. Although not significant, the compact RC showed a greater tissue deformation of 1 µL than the branched RC with 0.5 µL induced by the temperature change (p = 0.7874). The branched and compact CT forms responded almost equally to changes in temperature (p = 0.1461). Conclusions: The simulation experiment of induced soft tissue deformation using digital twins based on 2½ D point cloud models proved that our method helps to quantify shape-dependent tissue shifts.

Artificial intelligence directed development of a digital twin to measure soft tissue shift during head and neck surgery.

Digital twins derived from 3D scanning data were developed to measure soft tissue deformation in head and neck surgery by an artificial intelligence approach. This framework was applied suggesting feasibility of soft tissue shift detection as a hitherto unsolved problem. In a pig head cadaver model 104 soft tissue resection had been performed. The surface of the removed soft tissue (RTP) and the corresponding resection cavity (RC) was scanned (N = 416) to train an artificial intelligence (AI) with two different 3D object detectors (HoloLens 2; ArtecEva). An artificial tissue shift (TS) was created by changing the tissue temperature from 7,91±4,1°C to 36,37±1,28°C. Digital twins of RTP and RC in cold and warm conditions had been generated and volumes were calculated based on 3D surface meshes. Significant differences in number of vertices created by the different 3D scanners (HoloLens2 51313 vs. ArtecEva 21694, p<0.0001) hence result in differences in volume measurement of the RTC (p = 0.0015). A significant TS could be induced by changing the temperature of the tissue of RC (p = 0.0027) and RTP (p = <0.0001). RC showed more correlation in TS by heating than RTP with a volume increase of 3.1 µl or 9.09% (p = 0.449). Cadaver models are suitable for training a machine learning model for deformable registration through creation of a digital twin. Despite different point cloud densities, HoloLens and ArtecEva provide only slightly different estimates of volume. This means that both devices can be used for the task.TS can be simulated and measured by temperature change, in which RC and RTP react differently. This corresponds to the clinical behaviour of tumour and resection cavity during surgeries, which could be used for frozen section management and a range of other clinical applications.

Morphometric evaluation of two-pronucleus zygote images using image-processing techniques.

Identifying embryos with a high potential for implementation remains a challenge in in vitro fertilization (IVF) cycles. Despite progress in IVF treatment, only a minority of generated embryos has the ability to implant. Another drawback of this practice is the high frequency of multiple pregnancies. This problem leads to economic and health problems. Therefore, the transfer of a single embryo with high implantation potential is the ideal strategy. Morphometric evaluation of two-pronucleus zygote images is a helpful technique when aiming to transfer a single embryo with a high implantation potential. In this study, an automated zygote morphometric evaluation algorithm, called the zygote morphology evaluation (ZME) algorithm, was created to analyze the zygote and provide morphological measurements. The first and most crucial step of the ZME algorithm is the noise reduction step, which was first applied to zygote images. After that, the proposed algorithm detects different parts of the zygote that are indicators of embryo viability and normality, that is the oolemma, perivitelline space, zona pellucida, and nucleolar precursor bodies (NPBs). In addition, a novel dataset was prepared for this task. This dataset consisted of 703 human zygote images, and called the human zygote morphometric evaluation dataset (HZME-DS). Our experimental results in the HZME-DS showed that the ZME algorithm was able to achieve 79.58% average accuracy in identifying the oolemma region, 79.40% average accuracy in determining the perivitelline space, and 79.72% accuracy in identifying the zona pellucida. To calculate the accuracy of identifying NPBs, the proposed algorithm uses Recall and Precision measures, and their harmonic average (F1 measure) reached values of 81.14% and 79.53%, respectively. These encouraging results for our proposed method, which is an automatic and very fast method, showed that the ZME algorithm could help embryologists to evaluate the best zygotes in real time and the best embryos subsequently.

Applying data mining techniques for increasing implantation rate by selecting best sperms for intra-cytoplasmic sperm injection treatment.

BACKGROUND AND OBJECTIVE: Aspiration of a good-quality sperm during intracytoplasmic sperm injection (ICSI) is one of the main concerns. Understanding the influence of individual sperm morphology on fertilization, embryo quality, and pregnancy probability is one of the most important subjects in male factor infertility. Embryologists need to decide the best sperm for injection in real time during ICSI cycle. Our objective is to predict the quality of zygote, embryo, and implantation outcome before injection of each sperm in an ICSI cycle for male factor infertility with the aim of providing a decision support system on the sperm selection. METHODS: The information was collected from 219 patients with male factor infertility at the infertility therapy center of Alzahra hospital in Rasht from 2012 through 2014. The prepared dataset included the quality of zygote, embryo, and implantation outcome of 1544 injected sperms into the related oocytes. In our study, embryo transfer was performed at day 3. Each sperm was represented with thirteen clinical features. Data preprocessing was the first step in the proposed data mining algorithm. After applying more than 30 classifiers, 9 successful classifiers were selected and evaluated by 10-fold cross validation technique using precision, recall, F1, and AUC measures. Another important experiment was measuring the effect of each feature in prediction process. RESULTS: In zygote and embryo quality prediction, IBK and RandomCommittee models provided 79.2% and 83.8% F1, respectively. In implantation outcome prediction, KStar model achieved 95.9% F1, which is even better than prediction of human experts. All these predictions can be done in real time. CONCLUSIONS: A machine learning-based decision support system would be helpful in sperm selection phase of ICSI cycle to improve the success rate of ICSI treatment.

An efficient method for automatic morphological abnormality detection from human sperm images.

BACKGROUND AND OBJECTIVE: Sperm morphology analysis (SMA) is an important factor in the diagnosis of human male infertility. This study presents an automatic algorithm for sperm morphology analysis (to detect malformation) using images of human sperm cells. METHODS: The SMA method was used to detect and analyze different parts of the human sperm. First of all, SMA removes the image noises and enhances the contrast of the image to a great extent. Then it recognizes the different parts of sperm (e.g., head, tail) and analyzes the size and shape of each part. Finally, the algorithm classifies each sperm as normal or abnormal. Malformations in the head, midpiece, and tail of a sperm, can be detected by the SMA method. In contrast to other similar methods, the SMA method can work with low resolution and non-stained images. Furthermore, an image collection created for the SMA, has also been described in this study. This benchmark consists of 1457 sperm images from 235 patients, and is known as human sperm morphology analysis dataset (HSMA-DS). RESULTS: The proposed algorithm was tested on HSMA-DS. The experimental results show the high ability of SMA to detect morphological deformities from sperm images. In this study, the SMA algorithm produced above 90% accuracy in sperm abnormality detection task. Another advantage of the proposed method is its low computation time (that is, less than 9s), as such, the expert can quickly decide to choose the analyzed sperm or select another one. CONCLUSIONS: Automatic and fast analysis of human sperm morphology can be useful during intracytoplasmic sperm injection for helping embryologists to select the best sperm in real time.