Predicting Obstructive Sleep Apnea Based on Computed Tomography Scans Using Deep Learning Models.

Rationale: The incidence of clinically undiagnosed obstructive sleep apnea (OSA) is high among the general population because of limited access to polysomnography. Computed tomography (CT) of craniofacial regions obtained for other purposes can be beneficial in predicting OSA and its severity. Objectives: To predict OSA and its severity based on paranasal CT using a three-dimensional deep learning algorithm. Methods: One internal dataset (N = 798) and two external datasets (N = 135 and N = 85) were used in this study. In the internal dataset, 92 normal participants and 159 with mild, 201 with moderate, and 346 with severe OSA were enrolled to derive the deep learning model. A multimodal deep learning model was elicited from the connection between a three-dimensional convolutional neural network-based part treating unstructured data (CT images) and a multilayer perceptron-based part treating structured data (age, sex, and body mass index) to predict OSA and its severity. Measurements and Main Results: In a four-class classification for predicting the severity of OSA, the AirwayNet-MM-H model (multimodal model with airway-highlighting preprocessing algorithm) showed an average accuracy of 87.6% (95% confidence interval [CI], 86.8-88.6%) in the internal dataset and 84.0% (95% CI, 83.0-85.1%) and 86.3% (95% CI, 85.3-87.3%) in the two external datasets, respectively. In the two-class classification for predicting significant OSA (moderate to severe OSA), the area under the receiver operating characteristic curve, accuracy, sensitivity, specificity, and F1 score were 0.910 (95% CI, 0.899-0.922), 91.0% (95% CI, 90.1-91.9%), 89.9% (95% CI, 88.8-90.9%), 93.5% (95% CI, 92.7-94.3%), and 93.2% (95% CI, 92.5-93.9%), respectively, in the internal dataset. Furthermore, the diagnostic performance of the Airway Net-MM-H model outperformed that of the other six state-of-the-art deep learning models in terms of accuracy for both four- and two-class classifications and area under the receiver operating characteristic curve for two-class classification (P < 0.001). Conclusions: A novel deep learning model, including a multimodal deep learning model and an airway-highlighting preprocessing algorithm from CT images obtained for other purposes, can provide significantly precise outcomes for OSA diagnosis.

Intelligent Bladder Volume Monitoring for Wearable Ultrasound Devices: Enhancing Accuracy Through Deep Learning-Based Coarse-to-Fine Shape Estimation.

Accurate and continuous bladder volume monitoring is crucial for managing urinary dysfunctions. Wearable ultrasound (US) devices offer a solution by enabling noninvasive and real-time monitoring. Previous studies have limitations in power consumption and computation cost or quantitative volume estimation capability. To alleviate this, we present a novel pipeline that effectively integrates conventional feature extraction and deep learning (DL) to achieve continuous quantitative bladder volume monitoring efficiently. Particularly, in the proposed pipeline, bladder shape is coarsely estimated by a simple bladder wall detection algorithm in wearable devices, and the bladder wall coordinates are wirelessly transferred to an external server. Subsequently, a roughly estimated bladder shape from the wall coordinates is refined in an external server with a diffusion-based model. With this approach, power consumption and computation costs on wearable devices remained low, while fully harnessing the potential of DL for accurate shape estimation. To evaluate the proposed pipeline, we collected a dataset of bladder US images and RF signals from 250 patients. By simulating data acquisition from wearable devices using the dataset, we replicated real-world scenarios and validated the proposed method within these scenarios. Experimental results exhibit superior improvements, including +9.32% of IoU value in 2-D segmentation and -22.06 of RMSE in bladder volume regression compared to state-of-the-art (SOTA) performance from alternative methods, emphasizing the potential of this approach in continuous bladder volume monitoring in clinical settings. Therefore, this study effectively bridges the gap between accurate bladder volume estimation and the practical deployment of wearable US devices, promising improved patient care and quality of life.

Deep Learning-Based Diagnostic System for Velopharyngeal Insufficiency Based on Videofluoroscopy in Patients With Repaired Cleft Palates.

Velopharyngeal insufficiency (VPI), which is the incomplete closure of the velopharyngeal valve during speech, is a typical poor outcome that should be evaluated after cleft palate repair. The interpretation of VPI considering both imaging analysis and perceptual evaluation is essential for further management. The authors retrospectively reviewed patients with repaired cleft palates who underwent assessment for velopharyngeal function, including both videofluoroscopic imaging and perceptual speech evaluation. The final diagnosis of VPI was made by plastic surgeons based on both assessment modalities. Deep learning techniques were applied for the diagnosis of VPI and compared with the human experts' diagnostic results of videofluoroscopic imaging. In addition, the results of the deep learning techniques were compared with a speech pathologist's diagnosis of perceptual evaluation to assess consistency with clinical symptoms. A total of 714 cases from January 2010 to June 2019 were reviewed. Six deep learning algorithms (VGGNet, ResNet, Xception, ResNext, DenseNet, and SENet) were trained using the obtained dataset. The area under the receiver operating characteristic curve of the algorithms ranged between 0.8758 and 0.9468 in the hold-out method and between 0.7992 and 0.8574 in the 5-fold cross-validation. Our findings demonstrated the deep learning algorithms performed comparable to experienced plastic surgeons in the diagnosis of VPI based on videofluoroscopic velopharyngeal imaging.

New Metric to Evaluate Cardiac Anisotropic Mechanics by Directional High-Frequency Ultrasound-Based Transverse Wave Elastography.

The evaluation of cardiac anisotropic mechanics is important in the diagnosis of heart disease. However, other representative ultrasound imaging-based metrics, which are capable of quantitatively evaluating anisotropic cardiac mechanics, are insufficient for accurately diagnosing heart disease due to the influence of viscosity and geometry of cardiac tissues. In this study, we propose a new ultrasound imaging-based metric, maximum cosine similarity (MaxCosim), for quantifying anisotropic mechanics of cardiac tissues by evaluating the periodicity of the transverse wave speeds depending on the measurement directions using ultrasound imaging. We developed a high-frequency ultrasound-based directional transverse wave imaging system to measure the transverse wave speed in multiple directions. The ultrasound imaging-based metric was validated by performing experiments on 40 rats randomly assigned to four groups; three doxorubicin (DOX) treatment groups received 10, 15, or 20 mg/kg DOX, while the control group received 0.2 mL/kg saline. In each heart sample, the developed ultrasound imaging system allowed measuring transverse wave speeds in multiple directions, and the new metric was then calculated from 3-D ultrasound transverse wave images to evaluate the degree of anisotropic mechanics of the heart sample. The results of the metric were compared with histopathological changes for validation. A decrease in the MaxCosim value was observed in the DOX treatment groups, with the degree of decrease depending on the dose. These results are consistent with the histopathological features, suggesting that our ultrasound imaging-based metric can quantify the anisotropic mechanics of cardiac tissues and potentially be used for the early diagnosis of heart disease.

Multi-Task and Few-Shot Learning-Based Fully Automatic Deep Learning Platform for Mobile Diagnosis of Skin Diseases.

Fluorescence imaging-based diagnostic systems have been widely used to diagnose skin diseases due to their ability to provide detailed information related to the molecular composition of the skin compared to conventional RGB imaging. In addition, recent advances in smartphones have made them suitable for application in biomedical imaging, and therefore various smartphone-based optical imaging systems have been developed for mobile healthcare. However, an advanced analysis algorithm is required to improve the diagnosis of skin diseases. Various deep learning-based algorithms have recently been developed for this purpose. However, deep learning-based algorithms using only white-light reflectance RGB images have exhibited limited diagnostic performance. In this study, we developed an auxiliary deep learning network called fluorescence-aided amplifying network (FAA-Net) to diagnose skin diseases using a developed multi-modal smartphone imaging system that offers RGB and fluorescence images. FAA-Net is equipped with a meta-learning-based algorithm to solve problems that may occur due to the insufficient number of images acquired by the developed system. In addition, we devised a new attention-based module that can learn the location of skin diseases by itself and emphasize potential disease regions, and incorporated it into FAA-Net. We conducted a clinical trial in a hospital to evaluate the performance of FAA-Net and to compare various evaluation metrics of our developed model and other state-of-the-art models for the diagnosis of skin diseases using our multi-modal system. Experimental results demonstrated that our developed model exhibited an 8.61% and 9.83% improvement in mean accuracy and area under the curve in classifying skin diseases, respectively, compared with other advanced models.

Deep Learning-Based Framework for Fast and Accurate Acoustic Hologram Generation.

Acoustic holography has been gaining attention for various applications, such as noncontact particle manipulation, noninvasive neuromodulation, and medical imaging. However, only a few studies on how to generate acoustic holograms have been conducted, and even conventional acoustic hologram algorithms show limited performance in the fast and accurate generation of acoustic holograms, thus hindering the development of novel applications. We here propose a deep learning-based framework to achieve fast and accurate acoustic hologram generation. The framework has an autoencoder-like architecture; thus, the unsupervised training is realized without any ground truth. For the framework, we demonstrate a newly developed hologram generator network, the holographic ultrasound generation network (HU-Net), which is suitable for unsupervised learning of hologram generation, and a novel loss function that is devised for energy-efficient holograms. Furthermore, for considering various hologram devices (i.e., ultrasound transducers), we propose a physical constraint (PC) layer. Simulation and experimental studies were carried out for two different hologram devices, such as a 3-D printed lens, attached to a single element transducer, and a 2-D ultrasound array. The proposed framework was compared with the iterative angular spectrum approach (IASA) and the state-of-the-art (SOTA) iterative optimization method, Diff-PAT. In the simulation study, our framework showed a few hundred times faster generation speed, along with comparable or even better reconstruction quality, than those of IASA and Diff-PAT. In the experimental study, the framework was validated with 3-D printed lenses fabricated based on different methods, and the physical effect of the lenses on the reconstruction quality was discussed. The outcomes of the proposed framework in various cases (i.e., hologram generator networks, loss functions, and hologram devices) suggest that our framework may become a very useful alternative tool for other existing acoustic hologram applications, and it can expand novel medical applications.

Speckle Reduction via Deep Content-Aware Image Prior for Precise Breast Tumor Segmentation in an Ultrasound Image.

The performance of computer-aided diagnosis (CAD) systems that are based on ultrasound imaging has been enhanced owing to the advancement in deep learning. However, because of the inherent speckle noise in ultrasound images, the ambiguous boundaries of lesions deteriorate and are difficult to distinguish, resulting in the performance degradation of CAD. Although several methods have been proposed to reduce speckle noise over decades, this task remains a challenge that must be improved to enhance the performance of CAD. In this article, we propose a deep content-aware image prior (DCAIP) with a content-aware attention module (CAAM) for superior despeckling of ultrasound images without clean images. For the image prior, we developed a CAAM to deal with the content information in an input image. In this module, super-pixel pooling (SPP) is used to give attention to salient regions in an ultrasound image. Therefore, it can provide more content information regarding the input image when compared to other attention modules. The DCAIP consists of deep learning networks based on this attention module. The DCAIP is validated by applying it as a preprocessing step for breast tumor segmentation in ultrasound images, which is one of the tasks in CAD. Our method improved the segmentation performance by 15.89% in terms of the area under the precision-recall (PR) curve (AUPRC). The results demonstrate that our method enhances the quality of ultrasound images by effectively reducing speckle noise while preserving important information in the image, promising for the design of superior CAD systems.

Explainable deep learning algorithm for distinguishing incomplete Kawasaki disease by coronary artery lesions on echocardiographic imaging.

BACKGROUND AND OBJECTIVE: Incomplete Kawasaki disease (KD) has often been misdiagnosed due to a lack of the clinical manifestations of classic KD. However, it is associated with a markedly higher prevalence of coronary artery lesions. Identifying coronary artery lesions by echocardiography is important for the timely diagnosis of and favorable outcomes in KD. Moreover, similar to KD, coronavirus disease 2019, currently causing a worldwide pandemic, also manifests with fever; therefore, it is crucial at this moment that KD should be distinguished clearly among the febrile diseases in children. In this study, we aimed to validate a deep learning algorithm for classification of KD and other acute febrile diseases. METHODS: We obtained coronary artery images by echocardiography of children (n = 138 for KD; n = 65 for pneumonia). We trained six deep learning networks (VGG19, Xception, ResNet50, ResNext50, SE-ResNet50, and SE-ResNext50) using the collected data. RESULTS: SE-ResNext50 showed the best performance in terms of accuracy, specificity, and precision in the classification. SE-ResNext50 offered a precision of 81.12%, a sensitivity of 84.06%, and a specificity of 58.46%. CONCLUSIONS: The results of our study suggested that deep learning algorithms have similar performance to an experienced cardiologist in detecting coronary artery lesions to facilitate the diagnosis of KD.

Ex Vivo Evaluation of Mechanical Anisotropic Tissues with High-Frequency Ultrasound Shear Wave Elastography.

The use of imaging devices to assess directional mechanics of tissues is highly desirable. This is because the directional mechanics depend on fiber orientation, and altered directional mechanics are closely related to the pathological status of tissues. However, measuring directional mechanics in tissues with high-stiffness is challenging due to the difficulty of generating localized displacement in these tissues using acoustic radiation force, a general method for generating displacement in ultrasound-based elastography. In addition, common ultrasound probes do not provide rotational function, which makes the measurement of directional mechanics inaccurate and unreliable. Therefore, we developed a high-frequency ultrasound mechanical wave elastography system that can accommodate a wide range of tissue stiffness and is also equipped with a motorized rotation stage for precise imaging of directional mechanics. A mechanical shaker was applied to the elastography system to measure tissues with high-stiffness. Phantom and ex vivo experiments were performed. In the phantom experiments, the lateral and axial resolution of the system were determined to be 144 µm and 168 µm, respectively. In the ex vivo experiments, we used swine heart and cartilage, both of which are considered stiff. The elastography system allows us to acquire the directional mechanics with high angular resolution in the heart and cartilage. The results demonstrate that the developed elastography system is capable of imaging a wide range of tissues and has high angular resolution. Therefore, this system might be useful for the diagnostics of mechanically anisotropic tissues via ex vivo tests.

Effects of transcranial ultrasound stimulation pulsed at 40 Hz on Aß plaques and brain rhythms in 5×FAD mice.

BACKGROUND: Alzheimer's disease (AD) is the most common cause of dementia, and is characterized by amyloid-ß (Aß) plaques and tauopathy. Reducing Aß has been considered a major AD treatment strategy in pharmacological and non-pharmacological approaches. Impairment of gamma oscillations, which play an important role in perception and cognitive function, has been shown in mouse AD models and human patients. Recently, the therapeutic effect of gamma entrainment in AD mouse models has been reported. Given that ultrasound is an emerging neuromodulation modality, we investigated the effect of ultrasound stimulation pulsed at gamma frequency (40 Hz) in an AD mouse model. METHODS: We implanted electroencephalogram (EEG) electrodes and a piezo-ceramic disc ultrasound transducer on the skull surface of 6-month-old 5×FAD and wild-type control mice (n = 12 and 6, respectively). Six 5×FAD mice were treated with two-hour ultrasound stimulation at 40 Hz daily for two weeks, and the other six mice received sham treatment. Soluble and insoluble Aß levels in the brain were measured by enzyme-linked immunosorbent assay. Spontaneous EEG gamma power was computed by wavelet analysis, and the brain connectivity was examined with phase-locking value and cross-frequency phase-amplitude coupling. RESULTS: We found that the total Aß42 levels, especially insoluble Aß42, in the treatment group decreased in pre- and infra-limbic cortex (PIL) compared to that of the sham treatment group. A reduction in the number of Aß plaques was also observed in the hippocampus. There was no increase in microbleeding in the transcranial ultrasound stimulation (tUS) group. In addition, the length and number of microglial processes decreased in PIL and hippocampus. Encelphalographic spontaneous gamma power was increased, and cross-frequency coupling was normalized, implying functional improvement after tUS stimulation. CONCLUSION: These results suggest that the transcranial ultrasound-based gamma-band entrainment technique can be an effective therapy for AD by reducing the Aß load and improving brain connectivity.

Ultrasonic blood flowmeter with a novel Xero algorithm for a mechanical circulatory support system.

Mechanical circulatory support systems (MCSSs) are crucial devices for transplants in patients with heart failure. The blood flowing through the MCSS can be recirculated or even stagnated in the event of critical blood flow issues. To avoid emergencies due to abnormal changes in the flow, continuous changes of the flowrate should be measured with high accuracy and robustness. For better flowrate measurements, a more advanced ultrasonic blood flowmeter (UFM), which is a noninvasive measurement tool, is needed. In this paper, we propose a novel UFM sensor module using a novel algorithm (Xero) that can exploit the advantages of both conventional cross-correlation (Xcorr) and zero-crossing (Zero) algorithms, using only the zero-crossing-based algorithm. To ensure the capability of our own developed and optimized ultrasonic sensor module for MCSSs, the accuracy, robustness, and continuous monitoring performance of the proposed algorithm were compared to those of conventional algorithms after application to the developed sensor module. The results show that Xero is superior to other algorithms for flowrate measurements under different environments and offers an error rate of at least 0.92%, higher robustness for changing fluid temperatures than conventional algorithms, and sensitive responses to sudden changes in flowrates. Thus, the proposed UFM system with Xero has a great potential for flowrate measurements in MCSSs.

Federated Learning for Thyroid Ultrasound Image Analysis to Protect Personal Information: Validation Study in a Real Health Care Environment.

BACKGROUND: Federated learning is a decentralized approach to machine learning; it is a training strategy that overcomes medical data privacy regulations and generalizes deep learning algorithms. Federated learning mitigates many systemic privacy risks by sharing only the model and parameters for training, without the need to export existing medical data sets. In this study, we performed ultrasound image analysis using federated learning to predict whether thyroid nodules were benign or malignant. OBJECTIVE: The goal of this study was to evaluate whether the performance of federated learning was comparable with that of conventional deep learning. METHODS: A total of 8457 (5375 malignant, 3082 benign) ultrasound images were collected from 6 institutions and used for federated learning and conventional deep learning. Five deep learning networks (VGG19, ResNet50, ResNext50, SE-ResNet50, and SE-ResNext50) were used. Using stratified random sampling, we selected 20% (1075 malignant, 616 benign) of the total images for internal validation. For external validation, we used 100 ultrasound images (50 malignant, 50 benign) from another institution. RESULTS: For internal validation, the area under the receiver operating characteristic (AUROC) curve for federated learning was between 78.88% and 87.56%, and the AUROC for conventional deep learning was between 82.61% and 91.57%. For external validation, the AUROC for federated learning was between 75.20% and 86.72%, and the AUROC curve for conventional deep learning was between 73.04% and 91.04%. CONCLUSIONS: We demonstrated that the performance of federated learning using decentralized data was comparable to that of conventional deep learning using pooled data. Federated learning might be potentially useful for analyzing medical images while protecting patients' personal information.

Imbalanced Loss-Integrated Deep-Learning-Based Ultrasound Image Analysis for Diagnosis of Rotator-Cuff Tear.

A rotator cuff tear (RCT) is an injury in adults that causes difficulty in moving, weakness, and pain. Only limited diagnostic tools such as magnetic resonance imaging (MRI) and ultrasound Imaging (UI) systems can be utilized for an RCT diagnosis. Although UI offers comparable performance at a lower cost to other diagnostic instruments such as MRI, speckle noise can occur the degradation of the image resolution. Conventional vision-based algorithms exhibit inferior performance for the segmentation of diseased regions in UI. In order to achieve a better segmentation for diseased regions in UI, deep-learning-based diagnostic algorithms have been developed. However, it has not yet reached an acceptable level of performance for application in orthopedic surgeries. In this study, we developed a novel end-to-end fully convolutional neural network, denoted as Segmentation Model Adopting a pRe-trained Classification Architecture (SMART-CA), with a novel integrated on positive loss function (IPLF) to accurately diagnose the locations of RCT during an orthopedic examination using UI. Using the pre-trained network, SMART-CA can extract remarkably distinct features that cannot be extracted with a normal encoder. Therefore, it can improve the accuracy of segmentation. In addition, unlike other conventional loss functions, which are not suited for the optimization of deep learning models with an imbalanced dataset such as the RCT dataset, IPLF can efficiently optimize the SMART-CA. Experimental results have shown that SMART-CA offers an improved precision, recall, and dice coefficient of 0.604% (+38.4%), 0.942% (+14.0%) and 0.736% (+38.6%) respectively. The RCT segmentation from a normal ultrasound image offers the improved precision, recall, and dice coefficient of 0.337% (+22.5%), 0.860% (+15.8%) and 0.484% (+28.5%), respectively, in the RCT segmentation from an ultrasound image with severe speckle noise. The experimental results demonstrated the IPLF outperforms other conventional loss functions, and the proposed SMART-CA optimized with the IPLF showed better performance than other state-of-the-art networks for the RCT segmentation with high robustness to speckle noise.

Intelligent smartphone-based multimode imaging otoscope for the mobile diagnosis of otitis media.

Otitis media (OM) is one of the most common ear diseases in children and a common reason for outpatient visits to medical doctors in primary care practices. Adhesive OM (AdOM) is recognized as a sequela of OM with effusion (OME) and often requires surgical intervention. OME and AdOM exhibit similar symptoms, and it is difficult to distinguish between them using a conventional otoscope in a primary care unit. The accuracy of the diagnosis is highly dependent on the experience of the examiner. The development of an advanced otoscope with less variation in diagnostic accuracy by the examiner is crucial for a more accurate diagnosis. Thus, we developed an intelligent smartphone-based multimode imaging otoscope for better diagnosis of OM, even in mobile environments. The system offers spectral and autofluorescence imaging of the tympanic membrane using a smartphone attached to the developed multimode imaging module. Moreover, it is capable of intelligent analysis for distinguishing between normal, OME, and AdOM ears using a machine learning algorithm. Using the developed system, we examined the ears of 69 patients to assess their performance for distinguishing between normal, OME, and AdOM ears. In the classification of ear diseases, the multimode system based on machine learning analysis performed better in terms of accuracy and F1 scores than single RGB image analysis, RGB/fluorescence image analysis, and the analysis of spectral image cubes only, respectively. These results demonstrate that the intelligent multimode diagnostic capability of an otoscope would be beneficial for better diagnosis and management of OM.

Forward-Looking Multimodal Endoscopic System Based on Optical Multispectral and High-Frequency Ultrasound Imaging Techniques for Tumor Detection.

We developed a forward-looking (FL) multimodal endoscopic system that offers color, spectral classified, high-frequency ultrasound (HFUS) B-mode, and integrated backscattering coefficient (IBC) images for tumor detection in situ. Examination of tumor distributions from the surface of the colon to deeper inside is essential for determining a treatment plan of cancer. For example, the submucosal invasion depth of tumors in addition to the tumor distributions on the colon surface is used as an indicator of whether the endoscopic dissection would be operated. Thus, we devised the FL multimodal endoscopic system to offer information on the tumor distribution from the surface to deep tissue with high accuracy. This system was evaluated with bilayer gelatin phantoms which have different properties at each layer of the phantom in a lateral direction. After evaluating the system with phantoms, it was employed to characterize forty human colon tissues excised from cancer patients. The proposed system could allow us to obtain highly resolved chemical, anatomical, and macro-molecular information on excised colon tissues including tumors, thus enhancing the detection of tumor distributions from the surface to deep tissue. These results suggest that the FL multimodal endoscopic system could be an innovative screening instrument for quantitative tumor characterization.

Fully-automatic deep learning-based analysis for determination of the invasiveness of breast cancer cells in an acoustic trap.

A single-beam acoustic trapping technique has been shown to be very useful for determining the invasiveness of suspended breast cancer cells in an acoustic trap with a manual calcium analysis method. However, for the rapid translation of the technology into the clinic, the development of an efficient/accurate analytical method is needed. We, therefore, develop a fully-automatic deep learning-based calcium image analysis algorithm for determining the invasiveness of suspended breast cancer cells using a single-beam acoustic trapping system. The algorithm allows to segment cells, find trapped cells, and quantify their calcium changes over time. For better segmentation of calcium fluorescent cells even with vague boundaries, a novel deep learning architecture with multi-scale/multi-channel convolution operations (MM-Net) is devised and constructed by a target inversion training method. The MM-Net outperforms other deep learning models in the cell segmentation. Also, a detection/quantification algorithm is developed and implemented to automatically determine the invasiveness of a trapped cell. For the evaluation of the algorithm, it is applied to quantify the invasiveness of breast cancer cells. The results show that the algorithm offers similar performance to the manual calcium analysis method for determining the invasiveness of cancer cells, suggesting that it may serve as a novel tool to automatically determine the invasiveness of cancer cells with high-efficiency.

Smartphone-based spectral imaging otoscope: System development and preliminary study for evaluation of its potential as a mobile diagnostic tool.

We develop a novel smartphone-based spectral imaging otoscope for telemedicine and examine its capability for the mobile diagnosis of middle ear diseases. The device was applied to perform spectral imaging and analysis of an ear-mimicking phantom and a normal and abnormal tympanic membrane for evaluation of its potential for the mobile diagnosis. Spectral classified images were obtained via online spectral analysis in a remote server. The phantom experimental results showed that it allowed us to distinguish four different fluids located behind a semitransparent membrane. Also, in the spectral classified images of normal ears (n = 3) and an ear with chronic otitis media (n = 1), the normal and abnormal regions in each ear could be quantitatively distinguished with high contrast. These preliminary results thus suggested that it might have the potentials for providing quantitative information for the mobile diagnosis of various middle ear diseases.

Channel Attention Module With Multiscale Grid Average Pooling for Breast Cancer Segmentation in an Ultrasound Image.

Breast cancer accounts for the second-largest number of deaths in women around the world, and more than 8% of women will suffer from the disease in their lifetime. Mortality due to breast cancer can be reduced by its early and precise diagnosis. Many studies have investigated methods for segmentation, and computer-aided diagnosis based on deep learning techniques, in particular, has recently gained attention. However, recently proposed methods such as fully convolutional network (FCN), SegNet, and U-Net still need to be further improved to provide better semantic segmentation when diagnosing breast cancer by ultrasound imaging, because of their low performance. In this article, we propose a channel attention module with multiscale grid average pooling (MSGRAP) for the precise segmentation of breast cancer regions in ultrasound images. We demonstrate the effectiveness of the channel attention module with MSGRAP for semantic segmentation and develop a novel semantic segmentation network with the proposed attention module for the precise segmentation of breast cancer regions in ultrasound images. While a conventional convolutional operation cannot use global spatial information on input images and only use the small local information in a kernel of a convolution filter, the proposed attention module allows using both global and local spatial information. In addition, through ablation studies, we come up with a network architecture for precise breast cancer segmentation in an ultrasound image. The proposed network was constructed with an open-source breast cancer ultrasound image data set, and its performance was compared with those of other state-of-the-art deep-learning models for the segmentation of breast cancer. The experimental results showed that our network outperformed other segmentation methods, and the proposed channel attention module improved the performance of the network for breast cancer segmentation in ultrasound images.

HER3-targeted protein chimera forms endosomolytic capsomeres and self-assembles into stealth nucleocapsids for systemic tumor homing of RNA interference in vivo.

RNA interference represents a potent intervention for cancer treatment but requires a robust delivery agent for transporting gene-modulating molecules, such as small interfering RNAs (siRNAs). Although numerous molecular approaches for siRNA delivery are adequate in vitro, delivery to therapeutic targets in vivo is limited by payload integrity, cell targeting, efficient cell uptake, and membrane penetration. We constructed nonviral biomaterials to transport small nucleic acids to cell targets, including tumor cells, on the basis of the self-assembling and cell-penetrating activities of the adenovirus capsid penton base. Our recombinant penton base chimera contains polypeptide domains designed for noncovalent assembly with anionic molecules and tumor homing. Here, structural modeling, molecular dynamics simulations, and functional assays suggest that it forms pentameric units resembling viral capsomeres that assemble into larger capsid-like structures when combined with siRNA cargo. Pentamerization forms a barrel lined with charged residues mediating pH-responsive dissociation and exposing masked domains, providing insight on the endosomolytic mechanism. The therapeutic impact was examined on tumors expressing high levels of HER3/ErbB3 that are resistant to clinical inhibitors. Our findings suggest that our construct may utilize ligand mimicry to avoid host attack and target the siRNA to HER3+ tumors by forming multivalent capsid-like structures.

Multimodal endoscopic system based on multispectral and photometric stereo imaging and analysis.

We propose a multimodal endoscopic system based on white light (WL), multispectral (MS), and photometric stereo (PS) imaging for the examination of colorectal cancer (CRC). Recently, the enhancement of the diagnostic accuracy of CRC colonoscopy has been reported; however, tumor diagnosis for a variety of lesion types remains challenging using current endoscopy. In this study, we demonstrate that our developed system can simultaneously discriminate tumor distributions and provide three-dimensional (3D) morphological information about the colon surface using the WL, MS, and PS imaging modalities. The results demonstrate that the proposed system has considerable potential for CRC diagnosis.