Use of Artificial Intelligence Chatbots in Interpretation of Pathology Reports.

Importance: Anatomic pathology reports are an essential part of health care, containing vital diagnostic and prognostic information. Currently, most patients have access to their test results online. However, the reports are complex and are generally incomprehensible to laypeople. Artificial intelligence chatbots could potentially simplify pathology reports. Objective: To evaluate the ability of large language model chatbots to accurately explain pathology reports to patients. Design, Setting, and Participants: This cross-sectional study used 1134 pathology reports from January 1, 2018, to May 31, 2023, from a multispecialty hospital in Brooklyn, New York. A new chat was started for each report, and both chatbots (Bard [Google Inc], hereinafter chatbot 1; GPT-4 [OpenAI], hereinafter chatbot 2) were asked in sequential prompts to explain the reports in simple terms and identify key information. Chatbot responses were generated between June 1 and August 31, 2023. The mean readability scores of the original and simplified reports were compared. Two reviewers independently screened and flagged reports with potential errors. Three pathologists reviewed the flagged reports and categorized them as medically correct, partially medically correct, or medically incorrect; they also recorded any instances of hallucinations. Main Outcomes and Measures: Outcomes included improved mean readability scores and a medically accurate interpretation. Results: For the 1134 reports included, the Flesch-Kincaid grade level decreased from a mean of 13.19 (95% CI, 12.98-13.41) to 8.17 (95% CI, 8.08-8.25; t = 45.29; P < .001) by chatbot 1 and 7.45 (95% CI, 7.35-7.54; t = 49.69; P < .001) by chatbot 2. The Flesch Reading Ease score was increased from a mean of 10.32 (95% CI, 8.69-11.96) to 61.32 (95% CI, 60.80-61.84; t = -63.19; P < .001) by chatbot 1 and 70.80 (95% CI, 70.32-71.28; t = -74.61; P < .001) by chatbot 2. Chatbot 1 interpreted 993 reports (87.57%) correctly, 102 (8.99%) partially correctly, and 39 (3.44%) incorrectly; chatbot 2 interpreted 1105 reports (97.44%) correctly, 24 (2.12%) partially correctly, and 5 (0.44%) incorrectly. Chatbot 1 had 32 instances of hallucinations (2.82%), while chatbot 2 had 3 (0.26%). Conclusions and Relevance: The findings of this cross-sectional study suggest that artificial intelligence chatbots were able to simplify pathology reports. However, some inaccuracies and hallucinations occurred. Simplified reports should be reviewed by clinicians before distribution to patients.

The Angiopoietin Signaling Pathway Is Involved in Inflammatory Processes in Hospitalized COVID-19 Patients.

The viral agent SARS-CoV-2 clearly affects several organ systems, including the cardiovascular system. Angiopoietins are involved in vascular integrity and angiogenesis. Angiopoietin-1 (Ang1) promotes vessel stabilization, while angiopoietin-2 (Ang2), which is usually expressed at low levels, is significantly elevated in inflammatory and angiogenic conditions. Interleukin-6 (IL-6) is known to induce defective angiogenesis via the activation of the Ang2 pathway. Vasculitis and vasculopathy are some of the defining features of moderate to severe COVID-19-associated systemic disease. We investigated the serum levels of angiopoietins, as well as interleukin-6 levels and anti-SARS-CoV2 IgG titers, in hospitalized COVID-19 patients across disease severity and healthy controls. Ang2 levels were elevated in COVID-19 patients across all severity compared to healthy controls, while Ang1 levels were decreased. The patients with adverse outcomes (death and/or prolonged hospitalization) had relatively lower and stable Ang1 levels but continuously elevated Ang2 levels, while those who had no adverse outcomes had increasing levels of both Ang1 and Ang2, followed by a decrease in both. These results suggest that the dynamic levels of Ang1 and Ang2 during the clinical course may predict adverse outcomes in COVID-19 patients. Ang1 seems to play an important role in controlling Ang2-related inflammatory mechanisms in COVID-19 patients. IL-6 and anti-SARS-CoV2 spike protein IgG levels were significantly elevated in patients with severe disease. Our findings represent an informative pilot assessment into the role of the angiopoietin signaling pathway in the inflammatory response in COVID-19.