Deep learning application to automated classification of recommendations made by hospital pharmacists during medication prescription review.

PURPOSE: Recommendations to improve therapeutics are proposals made by pharmacists during the prescription review process to address suboptimal use of medicines. Recommendations are generated daily as text documents but are rarely reused beyond their primary use to alert prescribers and caregivers. If recommendation data were easier to summarize, they could be used retrospectively to improve safeguards for better prescribing. The objective of this work was to train a deep learning algorithm for automated recommendation classification to valorize the large amount of recommendation data. METHODS: The study was conducted in a French university hospital, at which recommendation data were collected throughout 2017. Data from the first 6 months of 2017 were labeled by 2 pharmacists who assigned recommendations to 1 of the 29 possible classes of the French Society of Clinical Pharmacy classification. A deep neural network classifier was trained to predict the class of recommendations. RESULTS: In total, 27,699 labeled recommendations from the first half of 2017 were used to train and evaluate a classifier. The prediction accuracy calculated on a validation dataset was 78.0%. We also predicted classes for unlabeled recommendations collected during the second half of 2017. Of the 4,460 predictions reviewed, 67 required correction. When these additional labeled data were concatenated with the original dataset and the neural network was retrained, accuracy reached 81.0%. CONCLUSION: To facilitate analysis of recommendations, we have implemented an automated classification system using deep learning that achieves respectable performance. This tool can help to retrospectively highlight the clinical significance of daily medication reviews performed by hospital clinical pharmacists.

Using machine learning or deep learning models in a hospital setting to detect inappropriate prescriptions: a systematic review.

OBJECTIVES: The emergence of artificial intelligence (AI) is catching the interest of hospital pharmacists. A massive collection of health data is now available to train AI models and hold the promise of disrupting codes and practices. The objective of this systematic review was to examine the state of the art of machine learning or deep learning models that detect inappropriate hospital medication orders. METHODS: A systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. MEDLINE and Embase databases were searched from inception to May 2023. Studies were included if they reported and described an AI model intended for use by clinical pharmacists in hospitals. Risk of bias was assessed using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). RESULTS: 13 articles were selected after review: 12 studies were judged to have high risk of bias; 11 studies were published between 2020 and 2023; 8 were conducted in North America and Asia; 6 analysed orders and detected inappropriate prescriptions according to patient profiles and medication orders; and 7 detected specific inappropriate prescriptions, such as detecting antibiotic resistance, dosage abnormality in prescriptions, high alert drugs errors from prescriptions or predicting the risk of adverse drug events. Various AI models were used, mainly supervised learning techniques. The training datasets used were very heterogeneous; the length of study varied from 2 weeks to 7 years and the number of prescription orders analysed went from 31 to 5 804 192. CONCLUSIONS: This systematic review points out that, to date, few original research studies report AI tools based on machine or deep learning in the field of hospital clinical pharmacy. However, these original articles, while preliminary, highlighted the potential value of integrating AI into clinical hospital pharmacy practice.