MRCG: A MRI Retrieval Framework With Convolutional and Graph Neural Networks for Secure and Private IoMT.

In the context of Industry 4.0, the medical industry is horizontally integrating the medical resources of the entire industry through the Internet of Things (IoT) and digital interconnection technologies. Speeding up the establishment of the public retrieval database of diagnosis-related historical data is a common call for the entire industry. Among them, the Magnetic Resonance Imaging (MRI) retrieval system, which is one of the key tools for secure and private the Internet of Medical Things (IoMT), is significant for patients to check their conditions and doctors to make clinical diagnoses securely and privately. Hence, this paper proposes a framework named MRCG that integrates Convolutional Neural Network (CNN) and Graph Neural Network (GNN) by incorporating the relationship between multiple gallery images in the graph structure. First, we adopt a Vgg16-based triplet network jointly trained for similarity learning and classification task. Next, a graph is constructed from the extracted features of triplet CNN where each node feature encodes a query-gallery image pair. The edge weight between nodes represents the similarity between two gallery images. Finally, a GNN with skip connections is adopted to learn on the constructed graph and predict the similarity score of each query-gallery image pair. Besides, Focal loss is also adopted while training GNN to tackle the class imbalance of the nodes. Experimental results on some benchmark datasets, including the CE-MRI dataset and a public MRI dataset from the Kaggle platform, show that the proposed MRCG can achieve 88.64% mAP and 86.59% mAP, respectively. Compared with some other state-of-the-art models, the MRCG can also outperform all the baseline models.

Semi-Supervised 3D Medical Image Segmentation Based on Dual-Task Consistent Joint Learning and Task-Level Regularization.

Semi-supervised learning has attracted wide attention from many researchers since its ability to utilize a few data with labels and relatively more data without labels to learn information. Some existing semi-supervised methods for medical image segmentation enforce the regularization of training by implicitly perturbing data or networks to perform the consistency. Most consistency regularization methods focus on data level or network structure level, and rarely of them focus on the task level. It may not directly lead to an improvement in task accuracy. To overcome the problem, this work proposes a semi-supervised dual-task consistent joint learning framework with task-level regularization for 3D medical image segmentation. Two branches are utilized to simultaneously predict the segmented and signed distance maps, and they can learn useful information from each other by constructing a consistency loss function between the two tasks. The segmentation branch learns rich information from both labeled and unlabeled data to strengthen the constraints on the geometric structure of the target. Experimental results on two benchmark datasets show that the proposed method can achieve better performance compared with other state-of-the-art works. It illustrates our method improves segmentation performance by utilizing unlabeled data and consistent regularization.

Rotated Sphere Haar Wavelet and Deep Contractive Auto-Encoder Network With Fuzzy Gaussian SVM for Pilot's Pupil Center Detection.

How to track the attention of the pilot is a huge challenge. We are able to capture the pupil status of the pilot and analyze their anomalies and judge the attention of the pilot. This paper proposes a new approach to solve this problem through the integration of spherical Haar wavelet transform and deep learning methods. First, considering the application limitations of Haar wavelet and other wavelets in spherical signal decomposition and reconstruction, a feature learning method based on the spherical Haar wavelet is proposed. In order to obtain the salient features of the spherical signal, a rotating spherical Haar wavelet is also proposed, which has a consistent scale in the same direction between the reconstructed image and the original image. Second, in order to find a better characteristic representation of the spherical signal, a higher contractive autoencoder (HCAE) is designed for the potential representation of the spherical Haar wavelet coefficients, which has two penalty items, respectively, from Jacobian and two order items from Taylor expansion of the point x for the contract learning of sample space. Third, in order to improve the classification performance, this paper proposes a fuzzy Gaussian support vector machine (FGSVM) as the top classification tool of the deep learning model, which can punish some Gaussian noise from the output of the deep HCAE network (DHCAEN). Finally, a DHCAEN-FGSVM classifier is proposed to identify the location of the pupil center. The experimental results of the public data set and actual data show that our model is an effective method for spherical signal detection.