Zero-shot learning to extract assessment criteria and medical services from the preventive healthcare guidelines using large language models.

OBJECTIVES: The integration of these preventive guidelines with Electronic Health Records (EHRs) systems, coupled with the generation of personalized preventive care recommendations, holds significant potential for improving healthcare outcomes. Our study investigates the feasibility of using Large Language Models (LLMs) to automate the assessment criteria and risk factors from the guidelines for future analysis against medical records in EHR. MATERIALS AND METHODS: We annotated the criteria, risk factors, and preventive medical services described in the adult guidelines published by United States Preventive Services Taskforce and evaluated 3 state-of-the-art LLMs on extracting information in these categories from the guidelines automatically. RESULTS: We included 24 guidelines in this study. The LLMs can automate the extraction of all criteria, risk factors, and medical services from 9 guidelines. All 3 LLMs perform well on extracting information regarding the demographic criteria or risk factors. Some LLMs perform better on extracting the social determinants of health, family history, and preventive counseling services than the others. DISCUSSION: While LLMs demonstrate the capability to handle lengthy preventive care guidelines, several challenges persist, including constraints related to the maximum length of input tokens and the tendency to generate content rather than adhering strictly to the original input. Moreover, the utilization of LLMs in real-world clinical settings necessitates careful ethical consideration. It is imperative that healthcare professionals meticulously validate the extracted information to mitigate biases, ensure completeness, and maintain accuracy. CONCLUSION: We developed a data structure to store the annotated preventive guidelines and make it publicly available. Employing state-of-the-art LLMs to extract preventive care criteria, risk factors, and preventive care services paves the way for the future integration of these guidelines into the EHR.

Predicting future occlusion or stenosis of lower extremity bypass grafts using artificial intelligence to simultaneously analyze all flow velocities collected in current and previous ultrasound examinations.

Objective: Routine surveillance with duplex ultrasound (DUS) examination is recommended after femoral-popliteal and femoral-tibial-pedal vein bypass grafts with various intervals postoperatively. The presently used methodology to analyze bypass graft DUS examination does not use all the available data and has been shown to have a significant rate for missing impending bypass graft failure. The objective of this research is to investigate recurrent neural networks (RNNs) to predict future bypass graft occlusion or stenosis. Methods: This study includes DUS examinations of 663 patients who had bypass graft operations done between January 2009 and June 2022. Only examinations without missing values were included. We developed two RNNs (a bidirectional long short-term memory unit and a bidirectional gated recurrent unit) to predict bypass graft occlusion and stenosis based on peak systolic velocities collected in the 2 to 5 previous DUS examinations. We excluded the examinations with missing values and split our data into training and test sets. Then, we applied 10-fold cross-validation on training to optimize the hyperparameters and compared models using the test data. Results: The bidirectional long short-term memory unit model can gain an overall sensitivity of 0.939, specificity of 0.963, and area under the curve of 0.950 on the prediction of bypass graft occlusion, and an overall sensitivity of 0.915, specificity of 0.909, and area under the curve of 0.912 predicting the development of a future critical stenosis. The results on different bypass types show that the system performs differently on different types. The results on subcohorts based on gender, smoking status, and comorbidities show that the performance on current smokers is lower than the never smoker. Conclusions: We found that RNNs can gain good sensitivity, specificity, and accuracy for the detection of impending bypass graft occlusion or the future development of a critical bypass graft stenosis using all the available peak systolic velocity data in the present and previous bypass graft DUS examinations. Integrating clinical data, including demographics, social determinants, medication, and other risk factors, together with the DUS examination may result in further improvements. Clinical Relevance: Detecting bypass graft failure before it occurs is important clinically to prevent amputations, salvage limbs, and save lives. Current methods evaluating screening duplex ultrasound examinations have a significant failure rate for detecting a bypass graft at risk for failure. Artificial intelligence using recurrent neural networks has the potential to improve the detection of at-risk bypass graft before they fail. Additionally, artificial intelligence is in the news and is being applied to many fields. Vascular surgeons need to know its potential to improve vascular outcomes.

SymptomGraph: Identifying Symptom Clusters from Narrative Clinical Notes using Graph Clustering.

Patients with cancer or other chronic diseases often experience different symptoms before or after treatments. The symptoms could be physical, gastrointestinal, psychological, or cognitive (memory loss), or other types. Previous research focuses on understanding the individual symptoms or symptom correlations by collecting data through symptom surveys and using traditional statistical methods to analyze the symptoms, such as principal component analysis or factor analysis. This research proposes a computational system, SymptomGraph, to identify the symptom clusters in the narrative text of written clinical notes in electronic health records (EHR). SymptomGraph is developed to use a set of natural language processing (NLP) and artificial intelligence (AI) methods to first extract the clinician-documented symptoms from clinical notes. Then, a semantic symptom expression clustering method is used to discover a set of typical symptoms. A symptom graph is built based on the co-occurrences of the symptoms. Finally, a graph clustering algorithm is developed to discover the symptom clusters. Although SymptomGraph is applied to the narrative clinical notes, it can be adapted to analyze symptom survey data. We applied Symptom-Graph on a colorectal cancer patient with and without diabetes (Type 2) data set to detect the patient symptom clusters one year after the chemotherapy. Our results show that SymptomGraph can identify the typical symptom clusters of colorectal cancer patients' post-chemotherapy. The results also show that colorectal cancer patients with diabetes often show more symptoms of peripheral neuropathy, younger patients have mental dysfunctions of alcohol or tobacco abuse, and patients at later cancer stages show more memory loss symptoms. Our system can be generalized to extract and analyze symptom clusters of other chronic diseases or acute diseases like COVID-19.