ACU2E-Net: A novel predict-refine attention network for segmentation of soft-tissue structures in ultrasound images.

Segmentation of anatomical structures in ultrasound images is a challenging task due to existence of artifacts inherit to the modality such as speckle noise, attenuation, shadowing, uneven textures and blurred boundaries. This paper presents a novel attention-based predict-refine network, called ACU2E-Net, for segmentation of soft-tissue structures in ultrasound images. The network consists of two modules: a predict module, which is built upon our newly proposed attentive coordinate convolution; and a novel multi-head residual refinement module, which consists of three parallel residual refinement modules. The attentive coordinate convolution is designed to improve the segmentation accuracy by perceiving the shape and positional information of the target anatomy. The proposed multi-head residual refinement module reduces both segmentation biases and variances by integrating residual refinement and ensemble strategies. Moreover, it avoids multi-pass training and inference commonly seen in ensemble methods. To show the effectiveness of our method, we collect a comprehensive dataset of thyroid ultrasound scans from 12 different imaging centers, and evaluate our proposed network against state-of-the-art segmentation methods. Comparisons against state-of-the-art models demonstrate the competitive performance of our newly designed network on both the transverse and sagittal thyroid images. Ablation studies show that proposed modules improve the segmentation Dice score of the baseline model from 79.62% to 80.97% and 82.92% while reducing the variance from 6.12% to 4.67% and 3.21% in transverse and sagittal views, respectively.

Thyroid Nodule Segmentation and Classification Using Deep Convolutional Neural Network and Rule-based Classifiers.

Thyroid cancer has a high prevalence all over the world. Accurate thyroid nodule diagnosis can lead to effective treatment and decrease the mortality rate. Ultrasound imaging is a safe, portable, and inexpensive tool for thyroid nodule monitoring. However, the widespread use of ultrasound has also resulted in over-diagnosis and over-treatment of nodules. There is also large variability in the assessment and characterization of nodules. Thyroid nodule classification requires precise delineation of the nodule boundary which is tedious and time- consuming. Automatic segmentation of nodule boundaries is highly desirable, however, it is challenging due to the wide range of nodule appearances, shapes, and sizes. In this study, we propose an end-to-end pipeline for nodule segmentation and classification. A residual dilated UNet (resDUnet) model is proposed for nodule segmentation. The output of resDUnet is fed to two rule-based classifiers to categorize the composition and echogenicity of the segmented nodule. We evaluate our segmentation method on a large dataset of 352 ultrasound images reviewed by a certified radiologist. When compared with ground-truth, resDUnet gives a higher Dice score than the standard UNet (82% vs. 81%). Our method requires minimal user interaction and it is robust to reasonable variations in the user-specified region-of-interest. We expect the proposed method to reduce variability in thyroid nodule assessment which results in more efficient and cost-effective monitoring of thyroid cancer.