Automated segmentation of epidermis in high-frequency ultrasound of pathological skin using a cascade of DeepLab v3+ networks and fuzzy connectedness.

This study proposes a novel, fully automated framework for epidermal layer segmentation in different skin diseases based on 75 MHz high-frequency ultrasound (HFUS) image data. A robust epidermis segmentation is a vital first step to detect changes in thickness, shape, and intensity and therefore support diagnosis and treatment monitoring in inflammatory and neoplastic skin lesions. Our framework links deep learning and fuzzy connectedness for image analysis. It consists of a cascade of two DeepLab v3+ models with a ResNet-50 backbone and a fuzzy connectedness analysis module for fine segmentation. Both deep models are pre-trained on the ImageNet dataset and subjected to transfer learning using our HFUS database of 580 images with atopic dermatitis, psoriasis and non-melanocytic skin tumors. The first deep model is used to detect the appropriate region of interest, while the second stands for the main segmentation procedure. We use the softmax layer of the latter twofold to prepare the input data for fuzzy connectedness analysis: as a reservoir of seed points and a direct contribution to the input image. In the experiments, we analyze different configurations of the framework, including region of interest detection, deep model backbones and training loss functions, or fuzzy connectedness analysis with parameter settings. We also use the Dice index and epidermis thickness to compare our results to state-of-the-art approaches. The Dice index of 0.919 yielded by our model over the entire dataset (and exceeding 0.93 in inflammatory diseases) proves its superiority over the other methods.

Deep Learning-Based High-Frequency Ultrasound Skin Image Classification with Multicriteria Model Evaluation.

This study presents the first application of convolutional neural networks to high-frequency ultrasound skin image classification. This type of imaging opens up new opportunities in dermatology, showing inflammatory diseases such as atopic dermatitis, psoriasis, or skin lesions. We collected a database of 631 images with healthy skin and different skin pathologies to train and assess all stages of the methodology. The proposed framework starts with the segmentation of the epidermal layer using a DeepLab v3+ model with a pre-trained Xception backbone. We employ transfer learning to train the segmentation model for two purposes: to extract the region of interest for classification and to prepare the skin layer map for classification confidence estimation. For classification, we train five models in different input data modes and data augmentation setups. We also introduce a classification confidence level to evaluate the deep model's reliability. The measure combines our skin layer map with the heatmap produced by the Grad-CAM technique designed to indicate image regions used by the deep model to make a classification decision. Moreover, we propose a multicriteria model evaluation measure to select the optimal model in terms of classification accuracy, confidence, and test dataset size. The experiments described in the paper show that the DenseNet-201 model fed with the extracted region of interest produces the most reliable and accurate results.

Deep learning approach to skin layers segmentation in inflammatory dermatoses.

Monitoring skin layers with medical imaging is critical to diagnosing and treating patients with chronic inflammatory skin diseases. The high-frequency ultrasound (HFUS) makes it possible to monitor skin condition in different dermatoses. Accurate and reliable segmentation of skin layers in patients with atopic dermatitis or psoriasis enables the assessment of the treatment effect by the layer thickness measurements. The epidermis and the subepidermal low echogenic band (SLEB) are the most important for further diagnosis since their appearance is an indicator of different skin problems. In medical practice, the analysis, including segmentation, is usually performed manually by the physician with all drawbacks of such an approach, e.g., extensive time consumption and lack of repeatability. Recently, HFUS becomes common in dermatological practice, yet it is barely supported by the development of automated analysis tools. To meet the need for skin layer segmentation and measurement, we developed an automated segmentation method of both epidermis and SLEB layers. It consists of a fuzzy c-means clustering-based preprocessing step followed by a U-shaped convolutional neural network. The network employs batch normalization layers adjusting and scaling the activation to make the segmentation more robust. The obtained segmentation results are verified and compared to the current state-of-the-art methods addressing the skin layer segmentation. The obtained Dice coefficient equal to 0.87 and 0.83 for the epidermis and SLEB, respectively, proves the developed framework's efficiency, outperforming the other approaches.