ABSTRACT
BACKGROUND: Injection drug use (IDU) can increase mortality and morbidity. Therefore, identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients' electronic health records (EHR) is difficult because there is no other structured data available, such as International Classification of Disease (ICD) codes, and IDU is most often documented in unstructured free-text clinical notes. Although natural language processing can efficiently extract this information from unstructured data, there are no validated tools. METHODS: To address this gap in clinical information, we design a question-answering (QA) framework to extract information on IDU from clinical notes for use in clinical operations. Our framework involves two main steps: (1) generating a gold-standard QA dataset and (2) developing and testing the QA model. We use 2323 clinical notes of 1145 patients curated from the US Department of Veterans Affairs (VA) Corporate Data Warehouse to construct the gold-standard dataset for developing and evaluating the QA model. We also demonstrate the QA model's ability to extract IDU-related information from temporally out-of-distribution data. RESULTS: Here, we show that for a strict match between gold-standard and predicted answers, the QA model achieves a 51.65% F1 score. For a relaxed match between the gold-standard and predicted answers, the QA model obtains a 78.03% F1 score, along with 85.38% Precision and 79.02% Recall scores. Moreover, the QA model demonstrates consistent performance when subjected to temporally out-of-distribution data. CONCLUSIONS: Our study introduces a QA framework designed to extract IDU information from clinical notes, aiming to enhance the accurate and efficient detection of people who inject drugs, extract relevant information, and ultimately facilitate informed patient care.
There are many health risks associated with injection drug use (IDU). Identifying people who inject drugs early can reduce the likelihood of these issues arising. However, extracting information about any possible IDU from a person's electronic health records can be difficult because the information is often in text-based general clinical notes rather than provided in a particular section of the record or as numerical data. Manually extracting information from these notes is time-consuming and inefficient. We used a computational method to train computer software to be able to extract IDU details. Potentially, this approach could be used by healthcare providers to more efficiently and accurately identify people who inject drugs, and therefore provide better advice and medical care.
ABSTRACT
U.S. health systems, policy makers, and patients increasingly demand high-value care that improves health outcomes at lower cost. This study describes the initial design and analysis of the Mental Health Management System (MHMS), a performance data and quality improvement tool used by the Veterans Health Administration (VHA) to increase the value of its mental health care. The MHMS evaluates access to and quality of mental health care, organizational structure and efficiency, implementation of innovative treatment options, and, in collaboration with management, resource needs for delivering care. Performance on 31 measures was calculated for all U.S. VHA facilities (N = 139). Pearson correlations revealed that better access to care was significantly associated with fewer mental health provider staffing vacancies (r = -.24) and higher staff-to-patient ratios for psychiatrists (r = .19) and other outpatient mental health providers (r = .27). Higher staff-to-patient ratios were significantly associated with higher performance on a number of patient and provider satisfaction measures (range of r = .18-.51) and continuity of care measures (range of r = .26-.43). Relationships observed between organizational and clinical performance measures suggest that the MHMS is a robust informatics and quality improvement tool that can serve as a model for health systems planning to adopt a value perspective. Future research should expand the MHMS framework to measure patient and health systems costs and psychosocial outcomes, as well as evaluate whether quality improvement solutions implemented as a result of using organizational information leads to higher-value mental health care. (PsycINFO Database Record
