ABSTRACT
BACKGROUND: Application of deep learning to diagnostic dermatology has been the subject of numerous studies, with some reporting skin lesion classification performance on curated datasets comparable to that of experienced dermatologists. Most skin disease images encountered in clinical settings are macroscopic, without dermoscopic information, and exhibit considerable variability. Further research is necessary to determine the generalisability of deep learning algorithms across populations and acquisition settings. OBJECTIVES: We assessed the extent to which deep learning can generalise to non-dermoscopic datasets acquired at the primary-secondary care interface in the National Health Service (NHS). We explored how to obtain clinically satisfactory performance on non-standardised, real-world local data without availability of large diagnostically labelled local datasets. We measured the impact of pre-training deep learning algorithms on external, public-domain datasets. METHODS: Diagnostic macroscopic image datasets were created from previous referrals from primary to secondary care. These included 2213 images referred from primary care practitioners in NHS Tayside and 1510 images from NHS Forth Valley acquired by medical photographers. Two further datasets with identical diagnostic labels were obtained from public domain sources, namely the International Skin Imaging Collaboration (ISIC) dermoscopic dataset and the SD-260 non-dermoscopic dataset. Deep learning algorithms, specifically SWIN transformers and an EfficientNets, were trained using data from each of these datasets. Algorithms were also fine-tuned on images from the NHS datasets after pre-training on different data combinations, including the larger public domain datasets. ROC curves and area under such curves (AUC) were used to assess performance. RESULTS: SWIN transformers tested on Forth Valley data had AUCs of 0.85 and 0.89 when trained on SD-260 and Forth Valley data, respectively. Training on SD-260 followed by fine-tuning of Forth Valley data gave an AUC of 0.91. Similar effects of pre-training and tuning on local data were observed using Tayside data, and EfficientNets. Pre-training on the larger dermoscopic image dataset (ISIC-2019) provided no additional benefit. CONCLUSIONS: Pre-training on public macroscopic images, followed by tuning to local data, gave promising results. Further improvements are needed to afford deployment in real clinical pathways. Larger datasets local to the target domain might be expected to yield further improved performance.
ABSTRACT
Plasma lipoproteins are important carriers of cholesterol and have been linked strongly to cardiovascular disease (CVD). Our study aimed to achieve fine-grained measurements of lipoprotein subpopulations such as low-density lipoprotein (LDL), lipoprotein(a) (Lp(a), or remnant lipoproteins (RLP) using electron microscopy combined with machine learning tools from microliter samples of human plasma. In the reported method, lipoproteins were absorbed onto electron microscopy (EM) support films from diluted plasma and embedded in thin films of methyl cellulose (MC) containing mixed metal stains, providing intense edge contrast. The results show that LPs have a continuous frequency distribution of sizes, extending from LDL (> 15 nm) to intermediate density lipoprotein (IDL) and very low-density lipoproteins (VLDL). Furthermore, mixed metal staining produces striking "positive" contrast of specific antibodies attached to lipoproteins providing quantitative data on apolipoprotein(a)-positive Lp(a) or apolipoprotein B (ApoB)-positive particles. To enable automatic particle characterization, we also demonstrated efficient segmentation of lipoprotein particles using deep learning software characterized by a Mask Region-based Convolutional Neural Networks (R-CNN) architecture with transfer learning. In future, EM and machine learning could be combined with microarray deposition and automated imaging for higher throughput quantitation of lipoproteins associated with CVD risk.
