ISLE: An Intelligent Streaming Framework for High-Throughput AI Inference in Medical Imaging.

As the adoption of artificial intelligence (AI) systems in radiology grows, the increase in demand for greater bandwidth and computational resources can lead to greater infrastructural costs for healthcare providers and AI vendors. To that end, we developed ISLE, an intelligent streaming framework to address inefficiencies in current imaging infrastructures. Our framework draws inspiration from video-on-demand platforms to intelligently stream medical images to AI vendors at an optimal resolution for inference from a single high-resolution copy using progressive encoding. We hypothesize that ISLE can dramatically reduce the bandwidth and computational requirements for AI inference, while increasing throughput (i.e., the number of scans processed by the AI system per second). We evaluate our framework by streaming chest X-rays for classification and abdomen CT scans for liver and spleen segmentation and comparing them with the original versions of each dataset. For classification, our results show that ISLE reduced data transmission and decoding time by at least 92% and 88%, respectively, while increasing throughput by more than 3.72 × . For both segmentation tasks, ISLE reduced data transmission and decoding time by at least 82% and 88%, respectively, while increasing throughput by more than 2.9 × . In all three tasks, the ISLE streamed data had no impact on the AI system's diagnostic performance (all P > 0.05). Therefore, our results indicate that our framework can address inefficiencies in current imaging infrastructures by improving data and computational efficiency of AI deployments in the clinical environment without impacting clinical decision-making using AI systems.

Improving the Safety of Computed Tomography Through Automated Quality Measurement: A Radiologist Reader Study of Radiation Dose, Image Noise, and Image Quality.

OBJECTIVES: The Centers for Medicare and Medicaid Services funded the development of a computed tomography (CT) quality measure for use in pay-for-performance programs, which balances automated assessments of radiation dose with image quality to incentivize dose reduction without compromising the diagnostic utility of the tests. However, no existing quantitative method for assessing CT image quality has been validated against radiologists' image quality assessments on a large number of CT examinations. Thus to develop an automated measure of image quality, we tested the relationship between radiologists' subjective ratings of image quality with measurements of radiation dose and image noise. MATERIALS AND METHODS: Board-certified, posttraining, clinically active radiologists rated the image quality of 200 diagnostic CT examinations from a set of 734, representing 14 CT categories. Examinations with significant distractions, motion, or artifact were excluded. Radiologists rated diagnostic image quality as excellent, adequate, marginally acceptable, or poor; the latter 2 were considered unacceptable for rendering diagnoses. We quantified the relationship between ratings and image noise and radiation dose, by category, by analyzing the odds of an acceptable rating per standard deviation (SD) increase in noise or geometric SD (gSD) in dose. RESULTS: One hundred twenty-five radiologists contributed 24,800 ratings. Most (89%) were acceptable. The odds of an examination being rated acceptable statistically significantly increased per gSD increase in dose and decreased per SD increase in noise for most categories, including routine dose head, chest, and abdomen-pelvis, which together comprise 60% of examinations performed in routine practice. For routine dose abdomen-pelvis, the most common category, each gSD increase in dose raised the odds of an acceptable rating (2.33; 95% confidence interval, 1.98-3.24), whereas each SD increase in noise decreased the odds (0.90; 0.79-0.99). For only 2 CT categories, high-dose head and neck/cervical spine, neither dose nor noise was associated with ratings. CONCLUSIONS: Radiation dose and image noise correlate with radiologists' image quality assessments for most CT categories, making them suitable as automated metrics in quality programs incentivizing reduction of excessive radiation doses.

Economic and Environmental Costs of Cloud Technologies for Medical Imaging and Radiology Artificial Intelligence.

Radiology is on the verge of a technological revolution driven by artificial intelligence (including large language models), which requires robust computing and storage capabilities, often beyond the capacity of current non-cloud-based informatics systems. The cloud presents a potential solution for radiology, and we should weigh its economic and environmental implications. Recently, cloud technologies have become a cost-effective strategy by providing necessary infrastructure while reducing expenditures associated with hardware ownership, maintenance, and upgrades. Simultaneously, given the optimized energy consumption in modern cloud data centers, this transition is expected to reduce the environmental footprint of radiologic operations. The path to cloud integration comes with its own challenges, and radiology informatics leaders must consider elements such as cloud architectural choices, pricing, data security, uptime service agreements, user training and support, and broader interoperability. With the increasing importance of data-driven tools in radiology, understanding and navigating the cloud landscape will be essential for the future of radiology and its various stakeholders.

Exploring the Clinical Translation of Generative Models Like ChatGPT: Promise and Pitfalls in Radiology, From Patients to Population Health.

Generative artificial intelligence (AI) tools such as GPT-4, and the chatbot interface ChatGPT, show promise for a variety of applications in radiology and health care. However, like other AI tools, ChatGPT has limitations and potential pitfalls that must be considered before adopting it for teaching, clinical practice, and beyond. We summarize five major emerging use cases for ChatGPT and generative AI in radiology across the levels of increasing data complexity, along with pitfalls associated with each. As the use of AI in health care continues to grow, it is crucial for radiologists (and all physicians) to stay informed and ensure the safe translation of these new technologies.

Criteria for the translation of radiomics into clinically useful tests.

Computer-extracted tumour characteristics have been incorporated into medical imaging computer-aided diagnosis (CAD) algorithms for decades. With the advent of radiomics, an extension of CAD involving high-throughput computer-extracted quantitative characterization of healthy or pathological structures and processes as captured by medical imaging, interest in such computer-extracted measurements has increased substantially. However, despite the thousands of radiomic studies, the number of settings in which radiomics has been successfully translated into a clinically useful tool or has obtained FDA clearance is comparatively small. This relative dearth might be attributable to factors such as the varying imaging and radiomic feature extraction protocols used from study to study, the numerous potential pitfalls in the analysis of radiomic data, and the lack of studies showing that acting upon a radiomic-based tool leads to a favourable benefit-risk balance for the patient. Several guidelines on specific aspects of radiomic data acquisition and analysis are already available, although a similar roadmap for the overall process of translating radiomics into tools that can be used in clinical care is needed. Herein, we provide 16 criteria for the effective execution of this process in the hopes that they will guide the development of more clinically useful radiomic tests in the future.

Artificial Intelligence in Nuclear Medicine: Opportunities, Challenges, and Responsibilities Toward a Trustworthy Ecosystem.

Trustworthiness is a core tenet of medicine. The patient-physician relationship is evolving from a dyad to a broader ecosystem of health care. With the emergence of artificial intelligence (AI) in medicine, the elements of trust must be revisited. We envision a road map for the establishment of trustworthy AI ecosystems in nuclear medicine. In this report, AI is contextualized in the history of technologic revolutions. Opportunities for AI applications in nuclear medicine related to diagnosis, therapy, and workflow efficiency, as well as emerging challenges and critical responsibilities, are discussed. Establishing and maintaining leadership in AI require a concerted effort to promote the rational and safe deployment of this innovative technology by engaging patients, nuclear medicine physicians, scientists, technologists, and referring providers, among other stakeholders, while protecting our patients and society. This strategic plan was prepared by the AI task force of the Society of Nuclear Medicine and Molecular Imaging.

Clinical Impact and Generalizability of a Computer-Assisted Diagnostic Tool to Risk-Stratify Lung Nodules With CT.

OBJECTIVE: To evaluate whether an imaging classifier for radiology practice can improve lung nodule classification and follow-up. METHODS: A machine learning classifier was developed and trained using imaging data from the National Lung Screening Trial (NSLT) to produce a malignancy risk score (malignancy Similarity Index [mSI]) for individual lung nodules. In addition to NLST cohorts, external cohorts were developed from a tertiary referral lung cancer screening program data set and an external nonscreening data set of all nodules detected on CT. Performance of the mSI combined with Lung-RADS was compared with Lung-RADS alone and the Mayo and Brock risk calculators. RESULTS: We analyzed 963 subjects and 1,331 nodules across these cohorts. The mSI was comparable in accuracy (area under the curve = 0.89) to existing clinical risk models (area under the curve = 0.86-0.88) and independently predictive in the NLST cohort of 704 nodules. When compared with Lung-RADS, the mSI significantly increased sensitivity across all cohorts (25%-117%), with significant increases in specificity in the screening cohorts (17%-33%). When used in conjunction with Lung-RADS, use of mSI would result in earlier diagnoses and reduced follow-up across cohorts, including the potential for early diagnosis in 42% of malignant NLST nodules from prior-year CT scans. CONCLUSION: A computer-assisted diagnosis software improved risk classification from chest CTs of screening and incidentally detected lung nodules compared with Lung-RADS. mSI added predictive value independent of existing radiological and clinical variables. These results suggest the generalizability and potential clinical impact of a tool that is straightforward to implement in practice.

Academic Radiology Departments Should Lead Artificial Intelligence Initiatives.

RATIONALE AND OBJECTIVES: With a track record of innovation and unique access to digital data, radiologists are distinctly positioned to usher in a new medical era of artificial intelligence (AI). MATERIALS AND METHODS: In this Perspective piece, we summarize AI initiatives that academic radiology departments should consider related to the traditional pillars of education, research, and clinical excellence, while also introducing a new opportunity for engagement with industry. RESULTS: We provide early successful examples of each as well as suggestions to guide departments towards future success. CONCLUSION: Our goal is to assist academic radiology leaders in bringing their departments into the AI era and realizing its full potential in our field.

Advancing Research on Medical Image Perception by Strengthening Multidisciplinary Collaboration.

Medical image interpretation is central to detecting, diagnosing, and staging cancer and many other disorders. At a time when medical imaging is being transformed by digital technologies and artificial intelligence, understanding the basic perceptual and cognitive processes underlying medical image interpretation is vital for increasing diagnosticians' accuracy and performance, improving patient outcomes, and reducing diagnostician burnout. Medical image perception remains substantially understudied. In September 2019, the National Cancer Institute convened a multidisciplinary panel of radiologists and pathologists together with researchers working in medical image perception and adjacent fields of cognition and perception for the "Cognition and Medical Image Perception Think Tank." The Think Tank's key objectives were to identify critical unsolved problems related to visual perception in pathology and radiology from the perspective of diagnosticians, discuss how these clinically relevant questions could be addressed through cognitive and perception research, identify barriers and solutions for transdisciplinary collaborations, define ways to elevate the profile of cognition and perception research within the medical image community, determine the greatest needs to advance medical image perception, and outline future goals and strategies to evaluate progress. The Think Tank emphasized diagnosticians' perspectives as the crucial starting point for medical image perception research, with diagnosticians describing their interpretation process and identifying perceptual and cognitive problems that arise. This article reports the deliberations of the Think Tank participants to address these objectives and highlight opportunities to expand research on medical image perception.

Deep Learning and Medical Image Analysis for COVID-19 Diagnosis and Prediction.

The coronavirus disease 2019 (COVID-19) pandemic has imposed dramatic challenges to health-care organizations worldwide. To combat the global crisis, the use of thoracic imaging has played a major role in the diagnosis, prediction, and management of COVID-19 patients with moderate to severe symptoms or with evidence of worsening respiratory status. In response, the medical image analysis community acted quickly to develop and disseminate deep learning models and tools to meet the urgent need of managing and interpreting large amounts of COVID-19 imaging data. This review aims to not only summarize existing deep learning and medical image analysis methods but also offer in-depth discussions and recommendations for future investigations. We believe that the wide availability of high-quality, curated, and benchmarked COVID-19 imaging data sets offers the great promise of a transformative test bed to develop, validate, and disseminate novel deep learning methods in the frontiers of data science and artificial intelligence.

Demographic Reporting in Publicly Available Chest Radiograph Data Sets: Opportunities for Mitigating Sex and Racial Disparities in Deep Learning Models.

OBJECTIVE: Data sets with demographic imbalances can introduce bias in deep learning models and potentially amplify existing health disparities. We evaluated the reporting of demographics and potential biases in publicly available chest radiograph (CXR) data sets. METHODS: We reviewed publicly available CXR data sets available on February 1, 2021, with >100 CXRs and performed a thorough search of various repositories, including Radiopaedia and Kaggle. For each data set, we recorded the total number of images and whether the data set reported demographic variables (age, race or ethnicity, sex, insurance status) in aggregate and on an image-level basis. RESULTS: Twenty-three CXR data sets were included (range, 105-371,858 images). Most data sets reported demographics in some form (19 of 23; 82.6%) and on an image level (17 of 23; 73.9%). The majority reported age (19 of 23; 82.6%) and sex (18 of 23; 78.2%), but a minority reported race or ethnicity (2 of 23; 8.7%) and insurance status (1 of 23; 4.3%). Of the 13 data sets with sex distribution readily available, the average breakdown was 55.2% male subjects, ranging from 47.8% to 69.7% male representation. Of these, 8 (61.5%) overrepresented male subjects and 5 (38.5%) overrepresented female subjects. DISCUSSION: Although most publicly available CXR data sets report age and sex on an image-basis level, few report race or ethnicity and insurance status. Furthermore, these data sets frequently underrepresent one of the sexes, more frequently the female sex. We recommend that data sets report standard demographic variables, and when possible, balance demographic representation to mitigate bias. Furthermore, for researchers using these data sets, we recommend that attention be paid to balancing demographic labels in addition to disease labels, as well as developing training methods that can account for these imbalances.

Trustworthy Artificial Intelligence in Medical Imaging.

Trust in artificial intelligence (AI) by society and the development of trustworthy AI systems and ecosystems are critical for the progress and implementation of AI technology in medicine. With the growing use of AI in a variety of medical and imaging applications, it is more vital than ever to make these systems dependable and trustworthy. Fourteen core principles are considered in this article aiming to move the needle more closely to systems that are accurate, resilient, fair, explainable, safe, and transparent: toward trustworthy AI.

Artificial Intelligence in Medical Imaging and its Impact on the Rare Disease Community: Threats, Challenges and Opportunities.

Almost 1 in 10 individuals can suffer from one of many rare diseases (RDs). The average time to diagnosis for an RD patient is as high as 7 years. Artificial intelligence (AI)-based positron emission tomography (PET), if implemented appropriately, has tremendous potential to advance the diagnosis of RDs. Patient advocacy groups must be active stakeholders in the AI ecosystem if we are to avoid potential issues related to the implementation of AI into health care. AI medical devices must not only be RD-aware at each stage of their conceptualization and life cycle but also should be trained on diverse and augmented datasets representative of the end-user population including RDs. Inability to do so leads to potential harm and unsustainable deployment of AI-based medical devices (AIMDs) into clinical practice.

Artificial Intelligence and Positron Emission Tomography Imaging Workflow:: Technologists' Perspective.

Artificial intelligence (AI) can enhance the efficiency of medical imaging quality control and clinical documentation, provide clinical decision support, and increase image acquisition and processing quality. A clear understanding of the basic tenets of these technologies and their impact will enable nuclear medicine technologists to train for performing advanced imaging tasks. AI-enabled medical devices' anticipated role and impact on routine nuclear medicine workflow (scheduling, quality control, check-in, radiotracer injection, waiting room, image planning, image acquisition, image post-processing) is reviewed in this article. With the assistance of AI, newly compiled patient imaging data can be customized to encompass personalized risk assessments of patients' disease burden, along with the development of individualized treatment plans. Nuclear medicine technologists will continue to play a crucial role on the medical team, collaborating with patients and radiologists to improve each patient's imaging experience and supervising the performance of integrated AI applications.