Application status of artificial intelligence techniques in retinoblastoma / 国际眼科杂志(Guoji Yanke Zazhi)

Retinoblastoma is a kind of malignant eye tumor commonly seen in children, which is one of the main causes threatening children's vision and life. The diagnosis and evaluation of retinoblastoma has always been a hot topic in clinic. In the past few years, the application of artificial intelligence(AI)technology has made significant progress in the medical field, providing new opportunities and challenges for the diagnosis and treatment of retinoblastoma, for example, the use of AI algorithms to analyze massive clinical data, which can help doctors diagnose the disease more accurately and provide personalized treatment plans. In addition, AI technology also plays an important role in medical image analysis, genomics research and other aspects, which can help the development of new drugs and improve patient prognosis. This article reviews the application progress of AI in retinoblastoma.

3D hippocampal segmentation based on spatial and frequency domain features adaptive fusion and inter⁃class boundary region enhancement / 解剖学报

Objective Hippocampal atrophy is a clinically important marker for the diagnosis of many psychiatric disorders such as Alzheimer’s disease‚ so accurate segmentation of the hippocampus is an important scientific issue. With the development of deep learning‚ a large number of advanced automatic segmentation method have been proposed. However‚ 3D hippocampal segmentation is still challenging due to the effects of various noises in MRI and unclear boundaries between various classes of the hippocampus. Therefore‚ the aim of this paper is to propose new method to segment the hippocampal head‚ body‚ and tail more accurately. Methods To overcome these challenges‚ this paper proposed two strategies. One was the spatial and frequency domain features adaptive fusion strategy‚ which reduced the influence of noise on feature extraction by automatically selecting the appropriate frequency combination through fast Fourier transform and convolution. The other was an inter-class boundary region enhancement strategy‚ which allowed the network to focus on learning the boundary regions by weighting the loss function of the boundary regions between each class to achieve the goal of pinpointing the boundaries and regulating the size of the hippocampal head‚ body and tail. Results Experiments performed on a 50-case teenager brain MRI dataset show that our method achieves state-of-the-art hippocampal segmentation. Hippocampal head‚ body and tail had been improved compared to the existing method. Ablation experiments demonstrated the effectiveness of our two proposed strategies‚ and we also validated that the network had a strong generalization ability on a 260-case Task04_Hippocampus dataset. It was shown that the method proposed in this paper could be used in more hippocampal segmentation scenarios. Conclusion The method proposed in this paper can help clinicians to observe hippocampal atrophy more clearly and accomplish more accurate diagnosis and follow-up of the condition.

Research Progress and Prospect Analysis of Vascular Interventional Surgical Robot / 中国医疗器械杂志

Vascular interventional surgery is an important means to treat cardiovascular and cerebrovascular diseases, but the particularity of its working environment will bring greater radiation threat to doctors. Vascular interventional surgery robots can effectively improve the working environment of doctors and can provide more stable operations, improve the success rate of surgery. This study mainly introduces the current research status, key technologies, and future application of vascular interventional surgical robots.

Non-rigid registration for medical images based on deformable convolution and multi-scale feature focusing modules / 生物医学工程学杂志

Non-rigid registration plays an important role in medical image analysis. U-Net has been proven to be a hot research topic in medical image analysis and is widely used in medical image registration. However, existing registration models based on U-Net and its variants lack sufficient learning ability when dealing with complex deformations, and do not fully utilize multi-scale contextual information, resulting insufficient registration accuracy. To address this issue, a non-rigid registration algorithm for X-ray images based on deformable convolution and multi-scale feature focusing module was proposed. First, it used residual deformable convolution to replace the standard convolution of the original U-Net to enhance the expression ability of registration network for image geometric deformations. Then, stride convolution was used to replace the pooling operation of the downsampling operation to alleviate feature loss caused by continuous pooling. In addition, a multi-scale feature focusing module was introduced to the bridging layer in the encoding and decoding structure to improve the network model's ability of integrating global contextual information. Theoretical analysis and experimental results both showed that the proposed registration algorithm could focus on multi-scale contextual information, handle medical images with complex deformations, and improve the registration accuracy. It is suitable for non-rigid registration of chest X-ray images.

A multimodal medical image contrastive learning algorithm with domain adaptive denormalization / 生物医学工程学杂志

Recently, deep learning has achieved impressive results in medical image tasks. However, this method usually requires large-scale annotated data, and medical images are expensive to annotate, so it is a challenge to learn efficiently from the limited annotated data. Currently, the two commonly used methods are transfer learning and self-supervised learning. However, these two methods have been little studied in multimodal medical images, so this study proposes a contrastive learning method for multimodal medical images. The method takes images of different modalities of the same patient as positive samples, which effectively increases the number of positive samples in the training process and helps the model to fully learn the similarities and differences of lesions on images of different modalities, thus improving the model's understanding of medical images and diagnostic accuracy. The commonly used data augmentation methods are not suitable for multimodal images, so this paper proposes a domain adaptive denormalization method to transform the source domain images with the help of statistical information of the target domain. In this study, the method is validated with two different multimodal medical image classification tasks: in the microvascular infiltration recognition task, the method achieves an accuracy of (74.79 ± 0.74)% and an F1 score of (78.37 ± 1.94)%, which are improved as compared with other conventional learning methods; for the brain tumor pathology grading task, the method also achieves significant improvements. The results show that the method achieves good results on multimodal medical images and can provide a reference solution for pre-training multimodal medical images.

A survey of loss function of medical image segmentation algorithms / 生物医学工程学杂志

Medical image segmentation based on deep learning has become a powerful tool in the field of medical image processing. Due to the special nature of medical images, image segmentation algorithms based on deep learning face problems such as sample imbalance, edge blur, false positive, false negative, etc. In view of these problems, researchers mostly improve the network structure, but rarely improve from the unstructured aspect. The loss function is an important part of the segmentation method based on deep learning. The improvement of the loss function can improve the segmentation effect of the network from the root, and the loss function is independent of the network structure, which can be used in various network models and segmentation tasks in plug and play. Starting from the difficulties in medical image segmentation, this paper first introduces the loss function and improvement strategies to solve the problems of sample imbalance, edge blur, false positive and false negative. Then the difficulties encountered in the improvement of the current loss function are analyzed. Finally, the future research directions are prospected. This paper provides a reference for the reasonable selection, improvement or innovation of loss function, and guides the direction for the follow-up research of loss function.

CT and MRI fusion based on generative adversarial network and convolutional neural networks under image enhancement / 生物医学工程学杂志

Aiming at the problems of missing important features, inconspicuous details and unclear textures in the fusion of multimodal medical images, this paper proposes a method of computed tomography (CT) image and magnetic resonance imaging (MRI) image fusion using generative adversarial network (GAN) and convolutional neural network (CNN) under image enhancement. The generator aimed at high-frequency feature images and used double discriminators to target the fusion images after inverse transform; Then high-frequency feature images were fused by trained GAN model, and low-frequency feature images were fused by CNN pre-training model based on transfer learning. Experimental results showed that, compared with the current advanced fusion algorithm, the proposed method had more abundant texture details and clearer contour edge information in subjective representation. In the evaluation of objective indicators, Q AB/F, information entropy (IE), spatial frequency (SF), structural similarity (SSIM), mutual information (MI) and visual information fidelity for fusion (VIFF) were 2.0%, 6.3%, 7.0%, 5.5%, 9.0% and 3.3% higher than the best test results, respectively. The fused image can be effectively applied to medical diagnosis to further improve the diagnostic efficiency.

An Intelligent Method for Optimizing Large-volume Medical Image Transmission / 中国医疗器械杂志

In order to alleviate the conflict between medical supply and demand, and to improve the efficiency of medical image transmission, this study proposes an intelligent method for large-volume medical image transmission. This method extracts and generates keyword pairs by analyzing medical diagnostic reports, and uses a 3D-UNet to segment original image data into various sub-area based on its anatomy structure. Then, the sub-areas are scored through keyword pairs and preset scoring criteria, and transmitted to user frontend in the order of prioritization score. Experiments show that this method can fulfill physicians' requirements of radiology reading and diagnosis with only ten percent of data transmitted, which efficiently optimized traditional transmission procedures.

Research progress on medical image dataset expansion methods / 生物医学工程学杂志

Computer-aided diagnosis (CAD) systems play a very important role in modern medical diagnosis and treatment systems, but their performance is limited by training samples. However, the training samples are affected by factors such as imaging cost, labeling cost and involving patient privacy, resulting in insufficient diversity of training images and difficulty in data obtaining. Therefore, how to efficiently and cost-effectively augment existing medical image datasets has become a research hotspot. In this paper, the research progress on medical image dataset expansion methods is reviewed based on relevant literatures at home and abroad. First, the expansion methods based on geometric transformation and generative adversarial networks are compared and analyzed, and then improvement of the augmentation methods based on generative adversarial networks are emphasized. Finally, some urgent problems in the field of medical image dataset expansion are discussed and the future development trend is prospected.

Advances in digital twins technology of human skeletal muscle / 生物医学工程学杂志

The human skeletal muscle drives skeletal movement through contraction. Embedding its functional information into the human morphological framework and constructing a digital twin of skeletal muscle for simulating physical and physiological functions of skeletal muscle are of great significance for the study of "virtual physiological humans". Based on relevant literature both domestically and internationally, this paper firstly summarizes the technical framework for constructing skeletal muscle digital twins, and then provides a review from five aspects including skeletal muscle digital twins modeling technology, skeletal muscle data collection technology, simulation analysis technology, simulation platform and human medical image database. On this basis, it is pointed out that further research is needed in areas such as skeletal muscle model generalization, accuracy improvement, and model coupling. The methods and means of constructing skeletal muscle digital twins summarized in the paper are expected to provide reference for researchers in this field, and the development direction pointed out can serve as the next focus of research.

MF2ResU-Net: a multi-feature fusion deep learning architecture for retinal blood vessel segmentation / 数字中医药（英文）

Objective@#For computer-aided Chinese medical diagnosis and aiming at the problem of insufficient segmentation, a novel multi-level method based on the multi-scale fusion residual neural network (MF2ResU-Net) model is proposed.@*Methods@#To obtain refined features of retinal blood vessels, three cascade connected U-Net networks are employed. To deal with the problem of difference between the parts of encoder and decoder, in MF2ResU-Net, shortcut connections are used to combine the encoder and decoder layers in the blocks. To refine the feature of segmentation, atrous spatial pyramid pooling (ASPP) is embedded to achieve multi-scale features for the final segmentation networks.@*Results@#The MF2ResU-Net was superior to the existing methods on the criteria of sensitivity (Sen), specificity (Spe), accuracy (ACC), and area under curve (AUC), the values of which are 0.8013 and 0.8102, 0.9842 and 0.9809, 0.9700 and 0.9776, and 0.9797 and 0.9837, respectively for DRIVE and CHASE DB1. The results of experiments demonstrated the effectiveness and robustness of the model in the segmentation of complex curvature and small blood vessels.@*Conclusion@#Based on residual connections and multi-feature fusion, the proposed method can obtain accurate segmentation of retinal blood vessels by refining the segmentation features, which can provide another diagnosis method for computer-aided Chinese medical diagnosis.

Medical image instance segmentation: from candidate region to no candidate region / 生物医学工程学杂志

In recent years, the task of object detection and segmentation in medical image is the research hotspot and difficulty in the field of image processing. Instance segmentation provides instance-level labels for different objects belonging to the same class, so it is widely used in the field of medical image processing. In this paper, medical image instance segmentation was summarized from the following aspects: First, the basic principle of instance segmentation was described, the instance segmentation models were classified into three categories, the development context of the instance segmentation algorithm was displayed in two-dimensional space, and six classic model diagrams of instance segmentation were given. Second, from the perspective of the three models of two-stage instance segmentation, single-stage instance segmentation and three-dimensional (3D) instance segmentation, we summarized the ideas of the three types of models, discussed the advantages and disadvantages, and sorted out the latest developments. Third, the application status of instance segmentation in six medical images such as colon tissue image, cervical image, bone imaging image, pathological section image of gastric cancer, computed tomography (CT) image of lung nodule and X-ray image of breast was summarized. Fourth, the main challenges in the field of medical image instance segmentation were discussed and the future development direction was prospected. In this paper, the principle, models and characteristics of instance segmentation are systematically summarized, as well as the application of instance segmentation in the field of medical image processing, which is of positive guiding significance to the study of instance segmentation.

A generative adversarial network-based unsupervised domain adaptation method for magnetic resonance image segmentation / 生物医学工程学杂志

Intelligent medical image segmentation methods have been rapidly developed and applied, while a significant challenge is domain shift. That is, the segmentation performance degrades due to distribution differences between the source domain and the target domain. This paper proposed an unsupervised end-to-end domain adaptation medical image segmentation method based on the generative adversarial network (GAN). A network training and adjustment model was designed, including segmentation and discriminant networks. In the segmentation network, the residual module was used as the basic module to increase feature reusability and reduce model optimization difficulty. Further, it learned cross-domain features at the image feature level with the help of the discriminant network and a combination of segmentation loss with adversarial loss. The discriminant network took the convolutional neural network and used the labels from the source domain, to distinguish whether the segmentation result of the generated network is from the source domain or the target domain. The whole training process was unsupervised. The proposed method was tested with experiments on a public dataset of knee magnetic resonance (MR) images and the clinical dataset from our cooperative hospital. With our method, the mean Dice similarity coefficient (DSC) of segmentation results increased by 2.52% and 6.10% to the classical feature level and image level domain adaptive method. The proposed method effectively improves the domain adaptive ability of the segmentation method, significantly improves the segmentation accuracy of the tibia and femur, and can better solve the domain transfer problem in MR image segmentation.

Application of image similarity measure based on structure information and intuitionistic fuzzy set in radiotherapy setup verification / 中华放射肿瘤学杂志

Objective:To propose a method of image similarity measurement based on structure information and intuitionistic fuzzy set and measure the similarity between CT image and CBCT image of radiotherapy plan positioning, aiming to objectively measure the setup errors.Methods:A total of four pre-registration images of a nasopharyngeal carcinoma patient on the cross-sectional and sagittal planes and a pelvic tumor patient on the cross-sectional and coronal planes were randomly selected. Five methods were used to quantify the setup errors, including correlation coefficient, mean square error, image joint entropy, mutual information and similarity measure method.Results:All five methods could describe the deviation to a certain extent. Compared with other methods, the similarity measure method showed a stronger upward trend with the increase of errors. After normalization, the results of five types of error increase on the cross-sectional plane of the nasopharyngeal carcinoma patient were 0.553, 0.683, 1.055, 1.995, 5.151, and 1.171, 1.618, 1.962, 1.790, 3.572 on the sagittal plane, respectively. The results of other methods were between 0 and 2 after normalization, and the results of different errors of the same method slightly changed. In addition, the method was more sensitive to the soft tissue errors.Conclusions:The image similarity measurement method based on structure information and intuitionistic fuzzy set is more consistent with human eye perception than the existing evaluation methods. The errors between bone markers and soft tissues can be objectively quantified to certain extent. The soft tissue deviation reflected by the setup errors is of significance for individualized precision radiotherapy.

Comparative Analysis of Three Massive Medical Image Storage Technologies / 中国医疗器械杂志

Nowadays, the massive medical data have already influenced the information construction in medical institutes, so it is not enough to solely rely on traditional local storage system to solve the problems like the read/write speed, visualization, and economy brought about by the massive data. Furthermore, various medical cloud services have been developed at home and abroad that patients' medical data can be shared through all medical institutes on the cloud, which makes a higher demand on the transmission speed of the medical data. This article analyzes from multiple aspects like high availability and costs by performing a medical image transmission speed test on the three mainstream storage technologies to provide an optional storage system for future medical image big data in the access process. The experimental result shows that it can be found that in the process of accessing medical image big data, the access speed and performance of object storage system is better than those of the existing local storage systems. However, with comprehensive consideration, it is recommended that the distributed file storage system like HDFS be the first choice for the storage system of the medical images.

Susceptibility weighted imaging of the veins around foramen of monro / 解剖学报

Objective To image the veins around the foramen of monro (FM), to build the 3D model of them, to construct venous network in this area and to explore the spatial positional correlation between FM and veins around it. Methods Totally 60 healthy subjects were selected to get the original images on 3. 0 T MR and procesed the original images by minimum intensity projections (mIP) and Materialise’ s interactive medical image control system (Mimics), built the 3D model of the veins around FM, observed and analyzed the morphology of FM and the veins around it on original and processed images. Results The displaying rate of FM was 65% (78 sides), the displaying rate of internal cerebellar veins (ICV) was 100% (120 sides), the diameter was (2. 13±0. 30) mm. The displaying rate of anterior septal vein (ASV) was 100% (120 sides), the diameter was(0. 69±0. 19)mm. The displaying rate of superior thalamostriate vein (STV) was 98. 3% (118 sides), the diameter was (1. 47± 0. 38) mm. The displaying rate of superior choroidal vein (SCV) was 82. 5% (99 sides), the diameter was(0. 40±0. 18)mm. According to the relationship between the converging point of the tributaries of ICV and the location of FM, FMs were classified into 5 types:ⅠA, 24. 2% (29 sides), ASV converged into ICV at the venous angle and closed to the posterior edge of FM; ⅠB, 13. 3% (16 sides), ASV converged into ICV away from the venous angle and the posterior edge of FM; ⅡA, 45% (54 sides), ASV converged into ICV at the false venous angle and closed to the posterior edge of FM; ⅡB, 15. 8% (19 sides), ASV converged into ICV away form the false venous angle and the posterior edge of FM. Ⅲ, 1. 7% (2 sides), STV was absent. Conclusion FM and the veins around it are visible on the susceptibility weighted imaging(SWI). It can be constructed by Mimics that the 3D model of ICV, its tributaries, FM and the converging points of the major veins. The classification of FMs is meaningful to the option of surgical approaches through FM.

Development prospect of orthopedic rehabilitation medicine based on three-dimensional printing technology / 中国组织工程研究

BACKGROUND: The application of three-dimensional (3D) precision printing in orthopedic rehabilitation medicine is attracting more and more attention from clinicians, engineers and researchers. OBJECTIVE: To review the development of 3D printing in orthopedic rehabilitation. METHODS: Relevant documents published from 2011 to 2019 were retrieved from CNKI database, Wanfang database, PubMed database and Elsevier database by computer. The search terms were “3D Precision Printing, Orthopedic rehabilitation medicine, Artificial Intelligence” in English and Chinese. RESULTS AND CONCLUSION: At present, 3D precision printing is the key technology in the application of orthopedic rehabilitation medicine, including medical image processing and 3D modeling, surgical simulation planning system, surgical guide board design, implant design and 3D precision printing equipment. Among them, 3D reconstruction technologies such as multiplanar reconstructions, volume rendering technique, maximum intensity projection, minimum intensity projection and surface shaded display are used to read medical digital data and realize visual medical image processing and 3D modeling, which can improve doctor-patient communication efficiency. The thinking process and intelligent behavior of doctors in rehabilitation surgery can be simulated by computer, and a cloud service center with function similar to the brain intelligence of doctors is created to assist doctors in the planning of rehabilitation surgery. With the aid of personalized rehabilitation surgery guide board design software, the bone graft osteotomy guide board can be used to plan the osteotomy line and osteotomy range for the doctor, which can shorten the operation time and improve the operation safety. Using polymer materials, metal materials, ceramic materials and other materials as 3D printing materials, there are still problems such as poor mechanical adaptation and physiological adaptation. The automation degree of common biological 3D design software is relatively low, which is prone to problems such as unsatisfactory matching between the performance of orthopedic medical devices and the defect site, and single internal pore structure of implants. However, the application of 3D precision printing technology in the immersion rehabilitation medicine teaching system is beneficial to the cultivation of rehabilitation medicine talents combining with interdisciplinary medical workers.

Application and Development Trend of Medical Image Automatic Segmentation Technology in Radiation Therapy / 中国医疗器械杂志

The development of medical image segmentation technology has been briefly reviewed. The applications of auto-segmentation of organs at risk and target volumes based on Atlas and deep learning in the field of radiotherapy have been introduced in detail, respectively. Then the development direction and product model for general automatic sketching tools or systems based on solid clinical data are discussed.

Research on coronavirus disease 2019 (COVID-19) detection method based on depthwise separable DenseNet in chest X-ray images / 生物医学工程学杂志

Coronavirus disease 2019 (COVID-19) has spread rapidly around the world. In order to diagnose COVID-19 more quickly, in this paper, a depthwise separable DenseNet was proposed. The paper constructed a deep learning model with 2 905 chest X-ray images as experimental dataset. In order to enhance the contrast, the contrast limited adaptive histogram equalization (CLAHE) algorithm was used to preprocess the X-ray image before network training, then the images were put into the training network and the parameters of the network were adjusted to the optimal. Meanwhile, Leaky ReLU was selected as the activation function. VGG16, ResNet18, ResNet34, DenseNet121 and SDenseNet models were used to compare with the model proposed in this paper. Compared with ResNet34, the proposed classification model of pneumonia had improved 2.0%, 2.3% and 1.5% in accuracy, sensitivity and specificity respectively. Compared with the SDenseNet network without depthwise separable convolution, number of parameters of the proposed model was reduced by 43.9%, but the classification effect did not decrease. It can be found that the proposed DWSDenseNet has a good classification effect on the COVID-19 chest X-ray images dataset. Under the condition of ensuring the accuracy as much as possible, the depthwise separable convolution can effectively reduce number of parameters of the model.

An algorithm for three-dimensional plumonary parenchymal segmentation by integrating surfacelet transform with pulse coupled neural network / 生物医学工程学杂志

In order to overcome the difficulty in lung parenchymal segmentation due to the factors such as lung disease and bronchial interference, a segmentation algorithm for three-dimensional lung parenchymal is presented based on the integration of surfacelet transform and pulse coupled neural network (PCNN). First, the three-dimensional computed tomography of lungs is decomposed into surfacelet transform domain to obtain multi-scale and multi-directional sub-band information. The edge features are then enhanced by filtering sub-band coefficients using local modified Laplacian operator. Second, surfacelet inverse transform is implemented and the reconstructed image is fed back to the input of PCNN. Finally, iteration process of the PCNN is carried out to obtain final segmentation result. The proposed algorithm is validated on the samples of public dataset. The experimental results demonstrate that the proposed algorithm has superior performance over that of the three-dimensional surfacelet transform edge detection algorithm, the three-dimensional region growing algorithm, and the three-dimensional U-NET algorithm. It can effectively suppress the interference coming from lung lesions and bronchial, and obtain a complete structure of lung parenchyma.