Transformer-Based Weakly Supervised Learning for Whole Slide Lung Cancer Image Classification.

Image analysis can play an important role in supporting histopathological diagnoses of lung cancer, with deep learning methods already achieving remarkable results. However, due to the large scale of whole-slide images (WSIs), creating manual pixel-wise annotations from expert pathologists is expensive and time-consuming. In addition, the heterogeneity of tumors and similarities in the morphological phenotype of tumor subtypes have caused inter-observer variability in annotations, which limits optimal performance. Effective use of weak labels could potentially alleviate these issues. In this paper, we propose a two-stage transformer-based weakly supervised learning framework called Simple Shuffle-Remix Vision Transformer (SSRViT). Firstly, we introduce a Shuffle-Remix Vision Transformer (SRViT) to retrieve discriminative local tokens and extract effective representative features. Then, the token features are selected and aggregated to generate sparse representations of WSIs, which are fed into a simple transformer-based classifier (SViT) for slide-level prediction. Experimental results demonstrate that the performance of our proposed SSRViT is significantly improved compared with other state-of-the-art methods in discriminating between adenocarcinoma, pulmonary sclerosing pneumocytoma and normal lung tissue (accuracy of 96.9% and AUC of 99.6%).

Masked autoencoders with handcrafted feature predictions: Transformer for weakly supervised esophageal cancer classification.

BACKGROUND AND OBJECTIVE: Esophageal cancer is a serious disease with a high prevalence in Eastern Asia. Histopathology tissue analysis stands as the gold standard in diagnosing esophageal cancer. In recent years, there has been a shift towards digitizing histopathological images into whole slide images (WSIs), progressively integrating them into cancer diagnostics. However, the gigapixel sizes of WSIs present significant storage and processing challenges, and they often lack localized annotations. To address this issue, multi-instance learning (MIL) has been introduced for WSI classification, utilizing weakly supervised learning for diagnosis analysis. By applying the principles of MIL to WSI analysis, it is possible to reduce the workload of pathologists by facilitating the generation of localized annotations. Nevertheless, the approach's effectiveness is hindered by the traditional simple aggregation operation and the domain shift resulting from the prevalent use of convolutional feature extractors pretrained on ImageNet. METHODS: We propose a MIL-based framework for WSI analysis and cancer classification. Concurrently, we introduce employing self-supervised learning, which obviates the need for manual annotation and demonstrates versatility in various tasks, to pretrain feature extractors. This method enhances the extraction of representative features from esophageal WSI for MIL, ensuring more robust and accurate performance. RESULTS: We build a comprehensive dataset of whole esophageal slide images and conduct extensive experiments utilizing this dataset. The performance on our dataset demonstrates the efficiency of our proposed MIL framework and the pretraining process, with our framework outperforming existing methods, achieving an accuracy of 93.07% and AUC (area under the curve) of 95.31%. CONCLUSION: This work proposes an effective MIL method to classify WSI of esophageal cancer. The promising results indicate that our cancer classification framework holds great potential in promoting the automatic whole esophageal slide image analysis.

WS-MTST: Weakly Supervised Multi-Label Brain Tumor Segmentation With Transformers.

Brain tumor segmentation is a key step in brain cancer diagnosis. Segmentation of brain tumor sub-regions, including necrotic, enhancing, and edematous regions, can provide more detailed guidance for clinical diagnosis. Weakly supervised brain tumor segmentation methods have received much attention because they do not require time-consuming pixel-level annotations. However, existing weakly supervised methods focus on the segmentation of the entire tumor region while ignoring the challenging task of multi-label segmentation for the tumor sub-regions. In this article, we propose a weakly supervised approach to solve the multi-label brain tumor segmentation problem. To the best of our knowledge, it's the first end-to-end multi-label weakly supervised segmentation model applied to brain tumor segmentation. With well-designed loss functions and a contrastive learning pre-training process, our proposed Transformer-based segmentation method (WS-MTST) has the ability to perform segmentation of brain tumor sub-regions. We conduct comprehensive experiments and demonstrate that our method reaches the state-of-the-art on the popular brain tumor dataset BraTS (from 2018 to 2020).

Cross-subject emotion recognition using visibility graph and genetic algorithm-based convolution neural network.

An efficient emotion recognition model is an important research branch in electroencephalogram (EEG)-based brain-computer interfaces. However, the input of the emotion recognition model is often a whole set of EEG channels obtained by electrodes placed on subjects. The unnecessary information produced by redundant channels affects the recognition rate and depletes computing resources, thereby hindering the practical applications of emotion recognition. In this work, we aim to optimize the input of EEG channels using a visibility graph (VG) and genetic algorithm-based convolutional neural network (GA-CNN). First, we design an experiment to evoke three types of emotion states using movies and collect the multi-channel EEG signals of each subject under different emotion states. Then, we construct VGs for each EEG channel and derive nonlinear features representing each EEG channel. We employ the genetic algorithm (GA) to find the optimal subset of EEG channels for emotion recognition and use the recognition results of the CNN as fitness values. The experimental results show that the recognition performance of the proposed method using a subset of EEG channels is superior to that of the CNN using all channels for each subject. Last, based on the subset of EEG channels searched by the GA-CNN, we perform cross-subject emotion recognition tasks employing leave-one-subject-out cross-validation. These results demonstrate the effectiveness of the proposed method in recognizing emotion states using fewer EEG channels and further enrich the methods of EEG classification using nonlinear features.

The Effects of Ambient Temperature on Lumbar Disc Herniation: A Retrospective Study.

Purpose: This article was designed to provide critical evidence into the relationship between ambient temperature and intensity of back pain in people with lumbar disc herniation (LDH). Methods: Data concerning patient's age, gender, diagnostic logout, admission time, discharge time, residence area, and work area (residence area and work area were used to ensure research area) from 2017 to 2019 were obtained from the Neck-Shoulder and Lumbocrural Pain Hospital in Jinan, China. A total of 1,450 hospitalization records were collected in total. The distributed lag non-linear model (DLNM) was used to evaluate the relationship between lag-response and exposure to ambient temperature. Stratification was based on age and gender. Days 1, 5, 20, and 28 prior to admission were denoted as lags 0, 5, 20, and 28, respectively. Results: An average daily temperature of 15-23°C reduced the risk of hospitalization the most in men. Conversely, temperatures <10°C drastically increased hospitalization in men, particularly in lags 0-5 and lags 20-28. Men aged between 40 and 50 years old showed less effect in pain sensation during ambient temperature. Conclusion: High or low ambient temperature can increase the hospitalization risk of LDH, and sometimes, the temperature effect is delayed.

COVID-19 Screening in Chest X-Ray Images Using Lung Region Priors.

Early screening of COVID-19 is essential for pandemic control, and thus to relieve stress on the health care system. Lung segmentation from chest X-ray (CXR) is a promising method for early diagnoses of pulmonary diseases. Recently, deep learning has achieved great success in supervised lung segmentation. However, how to effectively utilize the lung region in screening COVID-19 still remains a challenge due to domain shift and lack of manual pixel-level annotations. We hereby propose a multi-appearance COVID-19 screening framework by using lung region priors derived from CXR images. Firstly, we propose a multi-scale adversarial domain adaptation network (MS-AdaNet) to boost the cross-domain lung segmentation task as the prior knowledge to the classification network. Then, we construct a multi-appearance network (MA-Net), which is composed of three sub-networks to realize multi-appearance feature extraction and fusion using lung region priors. At last, we can obtain prediction results from normal, viral pneumonia, and COVID-19 using the proposed MA-Net. We extend the proposed MS-AdaNet for lung segmentation task on three different public CXR datasets. The results suggest that the MS-AdaNet outperforms contrastive methods in cross-domain lung segmentation. Moreover, experiments reveal that the proposed MA-Net achieves accuracy of 98.83 % and F1-score of 98.71 % on COVID-19 screening. The results indicate that the proposed MA-Net can obtain significant performance on COVID-19 screening.

Analysis of the Molecular Mechanisms of the Effects of Prunella vulgaris against Subacute Thyroiditis Based on Network Pharmacology.

Prunella vulgaris (PV) has a long history of application in traditional Chinese and Western medicine as a remedy for the treatment of subacute thyroiditis (SAT). This study applied network pharmacology to elucidate the mechanism of the effects of PV against SAT. Components of the potential therapeutic targets of PV and SAT-related targets were retrieved from databases. To construct a protein-protein interaction (PPI) network, the intersection of SAT-related targets and PV-related targets was input into the STRING platform. Gene ontology (GO) analysis and KEGG pathway enrichment analysis were carried out using the DAVID database. Networks were constructed by Cytoscape for visualization. The results showed that a total of 11 compounds were identified according to the pharmacokinetic parameters of ADME. A total of 126 PV-related targets and 2207 SAT-related targets were collected, and 83 overlapping targets were subsequently obtained. The results of the KEGG pathway and compound-target-pathway (C-T-P) network analysis suggested that the anti-SAT effect of PV mainly occurs through quercetin, luteolin, kaempferol, and beta-sitosterol and is most closely associated with their regulation of inflammation and apoptosis by targeting the PIK3CG, MAPK1, MAPK14, TNF, and PTGS2 proteins and the PI3K-Akt and TNF signaling pathways. The study demonstrated that quercetin, luteolin, kaempferol, and beta-sitosterol in PV may play a major role in the treatment of SAT, which was associated with the regulation of inflammation and apoptosis, by targeting the PI3K-Akt and TNF signaling pathways.