Closing the loop for AI-ready radiology.

BACKGROUND: In recent years, AI has made significant advancements in medical diagnosis and prognosis. However, the incorporation of AI into clinical practice is still challenging and under-appreciated. We aim to demonstrate a possible vertical integration approach to close the loop for AI-ready radiology. METHOD: This study highlights the importance of two-way communication for AI-assisted radiology. As a key part of the methodology, it demonstrates the integration of AI systems into clinical practice with structured reports and AI visualization, giving more insight into the AI system. By integrating cooperative lifelong learning into the AI system, we ensure the long-term effectiveness of the AI system, while keeping the radiologist in the loop.  RESULTS: We demonstrate the use of lifelong learning for AI systems by incorporating AI visualization and structured reports. We evaluate Memory Aware-Synapses and Rehearsal approach and find that both approaches work in practice. Furthermore, we see the advantage of lifelong learning algorithms that do not require the storing or maintaining of samples from previous datasets. CONCLUSION: In conclusion, incorporating AI into the clinical routine of radiology requires a two-way communication approach and seamless integration of the AI system, which we achieve with structured reports and visualization of the insight gained by the model. Closing the loop for radiology leads to successful integration, enabling lifelong learning for the AI system, which is crucial for sustainable long-term performance. KEY POINTS: · The integration of AI systems into the clinical routine with structured reports and AI visualization.. · Two-way communication between AI and radiologists is necessary to enable AI that keeps the radiologist in the loop.. · Closing the loop enables lifelong learning, which is crucial for long-term, high-performing AI in radiology..

[Integration of structured reporting into the routine radiological workflow]. / Integration der strukturierten Befundung in den radiologischen Routine-Workflow.

CLINICAL ISSUE: Structured reporting has been one of the most discussed topics in radiology for years. Currently, there is a lack of user-friendly software solutions that are integrated into the IT infrastructure of hospitals and practices to allow efficient data entry. STANDARD RADIOLOGICAL METHODS: Radiological reports are mostly generated as free text documents, either dictated via speech recognition systems or typed. In addition, text components are used to create reports of normal findings that can be further edited and complemented by free text. METHODOLOGICAL INNOVATIONS: Software-based reporting systems can combine speech recognition systems with radiological reporting templates in the form of interactive decision trees. A technical integration into RIS ("radiological information system"), PACS ("picture archiving and communication system"), and AV ("advanced visualization") systems via application programming interfaces and interoperability standards can enable efficient processes and the generation of machine-readable report data. PERFORMANCE: Structured and semantically annotated clinical data collected via the reporting system are immediately available for epidemiological data analysis and continuous AI training. EVALUATION: The use of structured reporting in routine radiological diagnostics involves an initial transition phase. A successful implementation further requires close integration of the technical infrastructure of several systems. PRACTICAL RECOMMENDATIONS: By using a hybrid reporting solution, radiological reports with different levels of structure can be generated. Clinical questions or procedural information can be semi-automatically transferred, thereby eliminating avoidable errors and increasing productivity.

Evaluation of camera-based freehand SPECT in preoperative sentinel lymph node mapping for melanoma patients.

BACKGROUND: Assessment of lymphatic status via sentinel lymph node (SLN) biopsy is an integral and crucial part of melanoma surgical oncology. The most common technique for sentinel node mapping is preoperative planar scintigraphy of an injected gamma-emitting lymphatic tracer followed by intraoperative node localization using a non-imaging gamma probe with auditory feedback. In recent years, intraoperative visualization of SLNs in 3D has become possible by coupling the probe to an external system capable of tracking its location and orientation as it is read out, thereby enabling computation of the 3D distribution of the tracer (freehand SPECT). In this project, the non-imaging probe of the fhSPECT system was replaced by a unique handheld gamma camera containing an array of sodium iodide crystals optically coupled to an array of silicon photomultipliers (SiPMs). A feasibility study was performed in which preoperative SLN mapping was performed using camera fhSPECT and the number of detected nodes was compared to that visualized by lymphoscintigraphy, probe fhSPECT, and to the number ultimately excised under non-imaging probe guidance. RESULTS: Among five subjects, SLNs were detected in nine lymphatic basins, with one to five SLNs detected per basin. A basin-by-basin comparison showed that the number of SLNs detected using camera fhSPECT exceeded that using lymphoscintigraphy and probe fhSPECT in seven of nine basins and five of five basins, respectively. (Probe fhSPECT scans were not performed for four basins.) It exceeded the number excised under non-imaging probe guidance for seven of nine basins and equaled the number excised for the other two basins. CONCLUSIONS: Freehand SPECT using a prototype SiPM-based gamma camera demonstrates high sensitivity for detection of SLNs in a preoperative setting. Camera fhSPECT is a potential means for efficiently obtaining real-time 3D activity distribution maps in applications such as image-guided percutaneous biopsy, and surgical SLN biopsy or radioguided tumor excision.

Extending the Hybrid Surgical Guidance Concept With Freehand Fluorescence Tomography.

Within image-guided surgery, 'hybrid' guidance technologies have been used to integrate the complementary features of radioactive guidance and fluorescence guidance. Here, we explore how the generation of a novel freehand fluorescence (fhFluo) imaging approach complements freehand SPECT (fhSPECT) in a hybrid setup. Near-infrared optical tracking was used to register the position and the orientation of a hybrid opto-nuclear detection probe while recording its readings. Dedicated look-up table models were used for 3D reconstruction. In phantom and excised tissue settings (i.e., flat-surface human skin explants), fhSPECT and fhFluo were investigated for image resolution and in-tissue signal penetration. Finally, the combined potential of these freehand technologies was evaluated on prostate and lymph node specimens of prostate cancer patients receiving prostatectomy and sentinel lymph node dissection (tracers: indocyanine green (ICG) +99m Tc-nanocolloid or ICG-99mTc-nanocolloid). After hardware and software integration, the hybrid setup created 3D nuclear and fluorescence tomography scans. The imaging resolution of fhFluo (1 mm) was superior to that of fhSPECT (6 mm). Fluorescence modalities were confined to a maximum depth of 0.5 cm, while nuclear modalities were usable at all evaluated depths (<2 cm). Both fhSPECT and fhFluo enabled augmented- and virtual-reality navigation toward segmented image hotspots, including relative hotspot quantification with an accuracy of 3.9% and 4.1%. Imaging in surgical specimens confirmed these trends (fhSPECT: in-depth detectability, low resolution, and fhFluo: superior resolution, superficial detectability). Overall, when radioactive and fluorescent tracer signatures are used, fhFluo has complementary value to fhSPECT. Combined the freehand technologies render a unique hybrid imaging and navigation modality.

Abstract ID: 247 Patient specific scatter reduction in SIRT gamma camera images.

INTRODUCTION: Clinical Bremsstrahlung imaging with gamma cameras or SPECT scanners, for example used in selective internal radiation therapy (SIRT) [1], suffers from low contrast due to a continuous spectrum and a high amount of scatter. Information about the scattering of the radionuclide within the patient's body can be obtained from Monte-Carlo simulations and subsequently being used to improve image quality. METHODS: An MAA-acquisition (CT+SPECT) of a HCC patient with a unifocal uptake in the right liver lobe is segmented (lesion) and loaded into the MC simulation framework GATE [2]. The voxelized lesion is used as Y90 source (1.5 GBq, 'fastY90' [3] is used yielding a speedup of 2.3×), the CT dataset is used for attenuation by converting HUs into corresponding materials. A mini gamma camera (Crystal Photonics, Germany) with a LEHR collimator and 4 × 4 cm2 detector size is positioned close to liver on the patient's skin, pointing towards the lesion. A simulation (60 s acquisition time) is performed on a cluster with 512 cores (2.2-2.5 Ghz each). The total number of counts, the energy spectrum and the order of scattered particles within each geometric volume are obtained from the ROOT output. Particles that have not scattered at all are defined as primary events. Scattering is only calculated within the phantom. RESULTS: The simulation took 172 min on the cluster with input data voxel size of 1 × 1 × 3.75 mm3. The number of emitted particles is 7.6 M with 600 k detected counts (∼8% ratio). 13.3% of the detected particles are primary events. Additionally, scatter of multiple orders has been observed (41%, 24% and 13% and 8% for the first four orders). CONCLUSION: The energy-spectrum of the simulated 2D gamma camera image can be analyzed and used to correct the actual image acquired of that specific patient to achieve improved image quality and subsequently also dosimetry.

Flexible mini gamma camera reconstructions of extended sources using step and shoot and list mode.

PURPOSE: Hand- and robot-guided mini gamma cameras have been introduced for the acquisition of single-photon emission computed tomography (SPECT) images. Less cumbersome than whole-body scanners, they allow for a fast acquisition of the radioactivity distribution, for example, to differentiate cancerous from hormonally hyperactive lesions inside the thyroid. This work compares acquisition protocols and reconstruction algorithms in an attempt to identify the most suitable approach for fast acquisition and efficient image reconstruction, suitable for localization of extended sources, such as lesions inside the thyroid. METHODS: Our setup consists of a mini gamma camera with precise tracking information provided by a robotic arm, which also provides reproducible positioning for our experiments. Based on a realistic phantom of the thyroid including hot and cold nodules as well as background radioactivity, the authors compare "step and shoot" (SAS) and continuous data (CD) acquisition protocols in combination with two different statistical reconstruction methods: maximum-likelihood expectation-maximization (ML-EM) for time-integrated count values and list-mode expectation-maximization (LM-EM) for individually detected gamma rays. In addition, the authors simulate lower uptake values by statistically subsampling the experimental data in order to study the behavior of their approach without changing other aspects of the acquired data. RESULTS: All compared methods yield suitable results, resolving the hot nodules and the cold nodule from the background. However, the CD acquisition is twice as fast as the SAS acquisition, while yielding better coverage of the thyroid phantom, resulting in qualitatively more accurate reconstructions of the isthmus between the lobes. For CD acquisitions, the LM-EM reconstruction method is preferable, as it yields comparable image quality to ML-EM at significantly higher speeds, on average by an order of magnitude. CONCLUSIONS: This work identifies CD acquisition protocols combined with LM-EM reconstruction as a prime candidate for the wider introduction of SPECT imaging with flexible mini gamma cameras in the clinical practice.

3D scintigraphic imaging and navigation in radioguided surgery: freehand SPECT technology and its clinical applications.

Freehand SPECT (fhSPECT) is a technology platform for providing 3-dimensional (3D) navigation for radioguided surgical procedures, such as sentinel lymph node (SLN) biopsy (SLNB). In addition to the information provided by conventional handheld gamma detection probes, fhSPECT allows for direct visualization of the distribution of radioactivity in any given region of interest, allowing for improved navigation to radioactive target lesions and providing accurate lesion depth measurements. Herein, we will review the currently available clinical data on the use of fhSPECT: (i) for SLNB of various malignancies, including difficult-to-detect SLNs, and (ii) for radioguided localization of solid tumors. Moreover, the combination of fhSPECT with other technologies (e.g., small field-of-view gamma cameras, and diagnostic ultrasound) is discussed. These technical advances have the potential to greatly expand the clinical application of radioguided surgery in the future.

Advanced inside-out tracking approach for real-time combination of MRI and US images in the radio-frequency shielded room using combination markers.

For the real-time fusion of different modalities, a variety of tracking methods are available including the optical, electromagnetic (EM) and image-based tracking. But as a drawback optical tracking suffers from line of sight issues and EM tracking requires the manual referencing for the fusion procedure and is not usable in Magnetic Resonance Imaging (MRI) environment. To avoid these issues, we propose a real-time setup containing a camera capable of inside-Out tracking using combined circular markers attached to Ultrasound (US) probe and a suitable platform for automatic overlay of MRI and US image using markers. This new approach could help clinicians carry out successful surgical procedures by requiring least system interaction and solving line of sight issues. As a proof-of-concept, we show our first result by mimicking common liver tumor intervention using framed marker fusion technique in a candle gel phantom. We evaluated the tracking error distances using the combination of special markers with Inside-Out approach and conventional optical tracking. The results achieved show comparable performance to the standard Outside-In tracking and manual reference approach, while easing the interventional procedure in terms of hardware and line of sight requirements.

Towards personalized interventional SPECT-CT imaging.

The development of modern robotics and compact imaging detectors allows the transfer of diagnostic imaging modalities to the operating room, supporting surgeons to perform faster and safer procedures. An intervention that currently suffers from a lack of interventional imaging is radioembolization, a treatment for hepatic carcinoma. Currently, this procedure requires moving the patient from an angiography suite for preliminary catheterization and injection to a whole-body SPECT/CT for leakage detection, necessitating a second catheterization back in the angiography suite for the actual radioembolization. We propose an imaging setup that simplifies this procedure using a robotic approach to directly acquire an interventional SPECT/CT in the angiography suite. Using C-arm CT and a co-calibrated gamma camera mounted on a robotic arm, a personalized trajectory of the gamma camera is generated from the C-arm CT, enabling an interventional SPECT reconstruction that is inherently co-registered to the C-arm CT. In this work we demonstrate the feasibility of this personalized interventional SPECT/CT imaging approach in a liver phantom study.

Mini gamma cameras for intra-operative nuclear tomographic reconstruction.

Nuclear imaging modalities like PET or SPECT are in extensive use in medical diagnostics. In a move towards personalized therapy, we present a flexible nuclear tomographic imaging system to enable intra-operative SPECT-like 3D imaging. The system consists of a miniaturized gamma camera mounted on a robot arm for flexible positioning, while spatio-temporal localization is provided by an optical tracking system. To facilitate statistical tomographic reconstruction of the radiotracer distribution using a maximum likelihood approach, a precise model of the mini gamma camera is generated by measurements. The entire system is evaluated in a series of experiments using a hot spot phantom, with a focus on criteria relevant for the intra-operative workflow, namely the number of required imaging positions as well as the required imaging time. The results show that high quality reconstructed images of simple hot spot configurations with positional errors of less than one millimeter are possible within acquisition times as short as 15s.

Combination of intra-operative freehand SPECT imaging with MR images for guidance and navigation.

Nowadays for clinical applications such as sentinel lymph node biopsy in breast or prostate cancer, only pre-operative image data is used for navigation, i.e. CT, SPECT/CT or PET/CT. Freehand SPECT and freehand PET provide intra-operative functional imaging techniques that can be complemented with pre- and intra-operative MR imaging to allow for better planning, navigation and guidance. In this paper we propose a method to enable navigation based on pre- or intra-operatively acquired MR images. A fully MR compatible phantom and a dedicated MR compatible optical tracking target with MR markers is built for this study. PET/MR, SPECT/CT and freehand SPECT scans of the phantom are performed. Registration is done using point based registration of the known marker and target geometries and a ground truth is obtained from a SPECT/CT and an MR image that are directly registered. The RMS errors was 0.31 mm for the ground truth and 3.29 mm when using segmentation of the MR markers and their spatial relationship with the optical tracking spheres of the dedicated target. Thus, the freehand SPECT can be registered easily by this approach without the need of any additional CT scans and therefore without any additional radiation dose for the patient. This enables intra-operative fusion of the pre- or intra-operatively acquired MR data, which could provide valuable additional information for intra-operative applications such as guidance based on accurate anatomy or verifying exact tumor location in combination with detailed morphological patient data.

First use of mini gamma cameras for intra-operative robotic SPECT reconstruction.

Different types of nuclear imaging systems have been used in the past, starting with pre-operative gantry-based SPECT systems and gamma cameras for 2D imaging of radioactive distributions. The main applications are concentrated on diagnostic imaging, since traditional SPECT systems and gamma cameras are bulky and heavy. With the development of compact gamma cameras with good resolution and high sensitivity, it is now possible to use them without a fixed imaging gantry. Mounting the camera onto a robot arm solves the weight issue, while also providing a highly repeatable and reliable acquisition platform. In this work we introduce a novel robotic setup performing scans with a mini gamma camera, along with the required calibration steps, and show the first SPECT reconstructions. The results are extremely promising, both in terms of image quality as well as reproducibility. In our experiments, the novel setup outperformed a commercial fhSPECT system, reaching accuracies comparable to state-of-the-art SPECT systems.

Towards intra-operative PET for head and neck cancer: lymph node localization using high-energy probes.

We present a novel approach for intra-operative localization of lymph nodes and metastases in the head and neck region using the radio-tracer [18F]FDG. By combining an optical tracking system with a high-energy gamma probe to detect 511keV annihilation gammas, we enable intra-operative PET to visualize activity distributions. Detection of these gammas is modeled ad-hoc analytically, taking into account several factors affecting the detection process. This allows us to iteratively reconstruct the radio-tracer distribution within a localized volume of interest. As a feasibility study we analyze clinical data of 7 patients with tumors in the head and neck region, and derive a realistic neck phantom configuration with [18F]FDG-filled lesions mimicking tumors and lymph nodes. We demonstrate the capabilities and limitations of our approach using that neck phantom. We also outline possible improvements to make our method clinically viable towards less invasive surgeries.