A clinically motivated self-supervised approach for content-based image retrieval of CT liver images.

Deep learning-based approaches for content-based image retrieval (CBIR) of computed tomography (CT) liver images is an active field of research, but suffer from some critical limitations. First, they are heavily reliant on labeled data, which can be challenging and costly to acquire. Second, they lack transparency and explainability, which limits the trustworthiness of deep CBIR systems. We address these limitations by: (1) Proposing a self-supervised learning framework that incorporates domain-knowledge into the training procedure, and, (2) by providing the first representation learning explainability analysis in the context of CBIR of CT liver images. Results demonstrate improved performance compared to the standard self-supervised approach across several metrics, as well as improved generalization across datasets. Further, we conduct the first representation learning explainability analysis in the context of CBIR, which reveals new insights into the feature extraction process. Lastly, we perform a case study with cross-examination CBIR that demonstrates the usability of our proposed framework. We believe that our proposed framework could play a vital role in creating trustworthy deep CBIR systems that can successfully take advantage of unlabeled data.

Cerebral blood flow measurements with 15O-water PET using a non-invasive machine-learning-derived arterial input function.

Cerebral blood flow (CBF) can be measured with dynamic positron emission tomography (PET) of 15O-labeled water by using tracer kinetic modelling. However, for quantification of regional CBF, an arterial input function (AIF), obtained from arterial blood sampling, is required. In this work we evaluated a novel, non-invasive approach for input function prediction based on machine learning (MLIF), against AIF for CBF PET measurements in human subjects.Twenty-five subjects underwent two 10 min dynamic 15O-water brain PET scans with continuous arterial blood sampling, before (baseline) and following acetazolamide medication. Three different image-derived time-activity curves were automatically segmented from the carotid arteries and used as input into a Gaussian process-based AIF prediction model, considering both baseline and acetazolamide scans as training data. The MLIF approach was evaluated by comparing AIF and MLIF curves, as well as whole-brain grey matter CBF values estimated by kinetic modelling derived with either AIF or MLIF.The results showed that AIF and MLIF curves were similar and that corresponding CBF values were highly correlated and successfully differentiated before and after acetazolamide medication. In conclusion, our non-invasive MLIF method shows potential to replace the AIF obtained from blood sampling for CBF measurements using 15O-water PET and kinetic modelling.

Machine learning derived input-function in a dynamic 18F-FDG PET study of mice.

Tracer kinetic modelling, based on dynamic 18F-fluorodeoxyglucose (FDG) positron emission tomography (PET) is used to quantify glucose metabolism in humans and animals. Knowledge of the arterial input-function (AIF) is required for such measurements. Our aim was to explore two non-invasive machine learning-based models, for AIF prediction in a small-animal dynamic FDG PET study. 7 tissue regions were delineated in images from 68 FDG PET/computed tomography mouse scans. Two machine learning-based models were trained for AIF prediction, based on Gaussian processes (GP) and a long short-term memory (LSTM) recurrent neural network, respectively. Because blood data were unavailable, a reference AIF was formed by fitting an established AIF model to vena cava and left ventricle image data. The predicted and reference AIFs were compared by the area under curve (AUC) and root mean square error (RMSE). Net-influx rate constants, K i , were calculated with a two-tissue compartment model, using both predicted and reference AIFs for three tissue regions in each mouse scan, and compared by means of error, ratio, correlation coefficient, P value and Bland-Altman analysis. The impact of different tissue regions on AIF prediction was evaluated by training a GP and an LSTM model on subsets of tissue regions, and calculating the RMSE between the reference and the predicted AIF curve. Both models generated AIFs with AUCs similar to reference. The LSTM models resulted in lower AIF RMSE, compared to GP. K i from both models agreed well with reference values, with no significant differences. Myocardium was highlighted as important for AIF prediction, but AIFs with similar RMSE were obtained also without myocardium in the input data. Machine learning can be used for accurate and non-invasive prediction of an image-derived reference AIF in FDG studies of mice. We recommend the LSTM approach, as this model predicts AIFs with lower errors, compared to GP.