Prevalence of Effective Audit-and-Feedback Practices in Primary Care Settings: A Qualitative Examination Within Veterans Health Administration.

OBJECTIVE: The purpose of this study is to uncover and catalog the various practices for delivering and disseminating clinical performance in various Veterans Affairs (VA) locations and to evaluate their quality against evidence-based models of effective feedback as reported in the literature. BACKGROUND: Feedback can enhance clinical performance in subsequent performance episodes. However, evidence is clear that the way in which feedback is delivered determines whether performance is harmed or improved. METHOD: We purposively sampled 16 geographically dispersed VA hospitals based on high, low, consistently moderate, and moderately average highly variable performance on a set of 17 outpatient clinical performance measures. We excluded four sites due to insufficient interview data. We interviewed four key personnel from each location (n = 48) to uncover effective and ineffective audit and feedback strategies. Interviews were transcribed and analyzed qualitatively using a framework-based content analysis approach to identify emergent themes. RESULTS: We identified 102 unique strategies used to deliver feedback. Of these strategies, 64 (62.74%) have been found to be ineffective according to the audit-and-feedback research literature. Comparing features common to effective (e.g., individually tailored, computerized feedback reports) versus ineffective (e.g., large staff meetings) strategies, most ineffective strategies delivered feedback in meetings, whereas strategies receiving the highest effectiveness scores delivered feedback via visually understood reports that did not occur in a group setting. CONCLUSIONS: Findings show that current practices are leveraging largely ineffective feedback strategies. Future research should seek to identify the longitudinal impact of current feedback and audit practices on clinical performance. APPLICATION: Feedback in primary care has little standardization and does not follow available evidence for effective feedback design. Future research in this area is warranted.

Validation of a Health System Measure to Capture Intensive Medication Treatment of Hypertension in the Veterans Health Administration.

Importance: Blood pressure (BP) targets are the main measure of high-quality hypertension care in health systems. However, BP alone does not reflect intensity of pharmacological treatment, which should be carefully managed in older patients. Objectives: To develop and validate an electronic health record (EHR) data-only algorithm using pharmacy and BP data to capture intensive hypertension care (IHC), defined as 3 or more BP medications and BP less than 120 mm Hg, and to identify conditions associated with greater IHC, either through greater algorithm false-positive IHC, or by contributing clinically to delivering more IHC. Design, Setting, and Participants: This cross-sectional study was conducted among 319 randomly selected patients aged 65 years or older receiving IHC from the Veterans Health Administration (VHA) from July 1, 2011, to June 30, 2013. Data were collected from a total of 3625 primary care visits. Data were analyzed from January 2017 to March 2020. Exposures: Calibration and measurement of the algorithm for IHC (algorithm IHC). Main Outcomes and Measures: For each primary care visit, the reference standard, clinical IHC, was determined by detailed review of free-text clinical notes. The correlation in BP medication count between the EHR-only algorithm vs the reference standard and the sensitivity and specificity of the algorithm IHC were calculated. In addition, presence vs absence of contributing conditions acting in combination with hypertension management were measured to examine incidence of IHC associated with contributing conditions, including an acute condition that lowered BP (eg, dehydration), another condition requiring a BP target lower than the standard 140 mm Hg (eg, diabetes), or the patient needing a BP-lowering medication for a nonhypertension condition (eg, ß-blocker for atrial fibrillation) resulting in low BP. Results: Among 319 patients with 3625 visits (mean [SD] age, 75.6 [7.2] years; 3592 [99.1%] men), 911 visits (25.1%) had clinical IHC by the reference standard. The algorithm for determining medication count was highly correlated with the reference standard (r = 0.84). Sensitivity of detecting clinical IHC was 92.2% (95% CI, 89.3%-95.1%), and specificity was 97.2% (95% CI, 96.1%-98.3%), suggesting that clinical IHC can be identified from routinely collected data. Only 75 visits (2.1%) were algorithm IHC false positives, 55 visits (1.5%) involved IHC with contributing conditions, and 125 visits (3.5%) involved either false-positive or IHC with contributing conditions. Among select contributing conditions, congestive heart failure (37 patients [5.2%]) was most associated with a prespecified combined false-positive or IHC with contributing conditions rate higher than 5%. Conclusions and Relevance: These findings suggest that health system data can be used reliably to estimate IHC.

Development, implementation and user experience of the Veterans Health Administration (VHA) dialysis dashboard.

BACKGROUND: Adults with end-stage renal disease (ESRD) requiring chronic dialysis continue to suffer from poor health outcomes and represent a population rightfully targeted for quality improvement. Electronic dashboards are increasingly used in healthcare to facilitate quality measurement and improvement. However, detailed descriptions of the creation of healthcare dashboards are uncommonly available and formal inquiry into perceptions, satisfaction, and utility by clinical users has been rarely conducted, particularly in the context of dialysis care. Therefore, we characterized the development, implementation and user experience with Veterans Health Administration (VHA) dialysis dashboard. METHODS: A clinical-quality dialysis dashboard was implemented, which displays clinical performance measures (CPMs) for Veterans with ESRD receiving chronic hemodialysis at all VHA facilities. Data on user experience and perceptions were collected via an e-mail questionnaire to dialysis medical directors and nurse managers at these facilities. RESULTS: Since 2016 the dialysis dashboard reports monthly on CPMs for approximately 3000 Veterans receiving chronic hemodialysis across 70 VHA dialysis facilities. Of 141 dialysis medical directors and nurse managers, 61 completed the questionnaire. Sixty-six percent of respondents did not find the dashboard difficult to access, 64% agreed that it is easy to use, 59% agreed that its layout is good, and the majority agreed that presentation of data is clear (54%), accurate (56%), and up-to-date (54%). Forty-eight percent of respondents indicated that it helped them improve patient care while 12% did not. Respondents indicated that they used the dialysis dashboard for clinical reporting (71%), quality assessment/performance improvement (QAPI) (62%), and decision-making (23%). CONCLUSIONS: Most users of the VHA dialysis dashboard found it accurate, up-to-date, easy to use, and helpful in improving patient care. It meets diverse user needs, including administrative reporting, clinical benchmarking and decision-making, and quality assurance and performance improvement (QAPI) activities. Moreover, the VHA dialysis dashboard affords national-, regional- and facility-level assessments of quality of care, guides and motivates best clinical practices, targets QAPI efforts, and informs and promotes population health management improvement efforts for Veterans receiving chronic hemodialysis.

Root Cause Analyses of Reported Adverse Events Occurring During Gastrointestinal Scope and Tube Placement Procedures in the Veterans Health Association.

OBJECTIVE: This study describes reported adverse events related to gastrointestinal (GI) scope and tube placement procedures (between January 2010 and June 2012), in the Veterans Health Administration. Adverse events, including those related to GI procedures resulting in preventable harm, continue to occur. METHODS: This is a descriptive review of root cause analysis reports of GI scope and tube placement procedures from the National Center for Patient Safety database. Adverse event type, procedure, location, severity, and frequency were extracted. Spearman ρ was used to determine associations between types of adverse events and harm levels. RESULTS: We reviewed 27 cases of reported adverse events related to GI invasive procedures. Of the adverse events for which we could determine location (n = 25), 10 (40%) were in the operating room and 15 (60%) occurred in a nonoperating room. Endoscopies were associated with the least amount of harm. The most frequently reported adverse event types were human factors (22.22%, n = 6) and retained items (18.52%, n = 5). Retained item events were associated with the most harm. The most common root causes were lack of standardization in the process of care and suboptimal communication. CONCLUSIONS: Retained items after invasive procedures and human factors errors were the most common and harmful type of adverse event in this study. Efforts to reduce adverse events during GI invasive procedures include improving situational awareness of the risk of retained items, standardization of care, communication between providers, and inspection of instruments for intactness before and after procedures.

Implementation of Evidence-Based Recommendations for Preventive Services in the Veterans Health Administration.

INTRODUCTION: The Veterans Health Administration (VHA) is the largest integrated health care system in the United States. To date, there has been scant research on how VHA adopts clinical preventive services guidelines and how U.S. Preventive Services Task Force recommendations factor into the process. METHODS: Researchers conducted semistructured interviews with eight VHA leaders to examine how they adopt, disseminate, and measure adherence to recommendations. Interviews were recorded, transcribed, and aggregated into a database to enable sorting and synthesis. Themes were identified across the key informant interviews. RESULTS: The development of VHA clinical prevention guidelines is coordinated by the National Center for Health Promotion and Disease Prevention. A VHA Advisory Committee discusses and votes to approve or disapprove each guideline. Several factors can impact the ability of a veterans affairs medical center to implement a guideline, such as local system capacity and priorities for quality improvement. Methods to promote implementation include electronic reminders, educational events, and a robust performance measurement system. CONCLUSIONS: Provision of evidence-based clinical preventive services is an important part of VHA's effort to provide high-quality care for Veterans. Recent achievements in lung cancer, colorectal cancer, and Hepatitis C screening highlight VHA's successful approach to implementation of preventive services guidance.

The ED-PACT Tool Initiative: Communicating Veterans' Care Needs After Emergency Department Visits.

BACKGROUND: Communication failures between providers threaten patient safety. PURPOSE: We developed, implemented, and formatively evaluated the ED-PACT Tool, which uses the Veterans Health Administration's (VA) electronic health record to send messages from emergency department (ED) providers to primary care patient-aligned care team (PACT) registered nurses (RNs) for Veterans discharged home from the ED with urgent or specific follow-up needs. METHODS: We used Plan-Do-Study-Act quality improvement methodology. RESULTS: Between November 1, 2015, and November 30, 2017, the tool was used to send 4,899 messages in one local VA healthcare system (ED and associated primary care clinics). Formative evaluation revealed that providers and RNs perceive the tool as providing substantial benefit for coordinating post-ED care. Patient-aligned care team leaders reported that RN training and "buy-in" facilitated tool implementation, while insufficient staffing posed a barrier. Emergency department providers noted the advantage of having a standardized and reliable system for communicating with PACTs. CONCLUSIONS/IMPLICATIONS: The ED-PACT Tool encapsulates several best practices (standardized processes, "closed-loop" communication, embedding into workflow) to facilitate communication between VA ED and follow-up care providers. Our development process illustrates key lessons in quality improvement and innovation implementation including the value of using rapid-cycle improvement methodology, with interprofessional collaboration and representatives from intended spread sites.

Increasing nurse practitioner students' comfort levels in caring for veterans with post-traumatic stress disorder.

ABSTRACT: Few nurse practitioner programs integrate education on care of veterans into their curriculum. Because more veterans are seeking health care outside of the Veteran Affairs system, all advanced practice nurses need to be prepared to meet the unique needs of veterans with post-traumatic stress disorder (PTSD). The authors developed an education session on military-to-civilian transition and screening and treatment of veterans with PTSD. The session was provided to a convenience sample of students. Case studies were included to allow student participation and active learning. Students completed pre-education and post-education surveys to measure their comfort level in caring for this specific population and their understanding of PTSD. The participant scores on comfort level with identifying and managing PTSD after the education session were significantly increased. Placing veteran-specific education into nurse practitioner programs enhances the comfort level with identifying and managing PTSD. Adding this veteran-specific education could enhance the overall care for veterans in the civilian sector.

The Veterans Precision Oncology Data Commons: Transforming VA data into a national resource for research in precision oncology.

The Department of Veterans Affairs (VA) has a strong track record providing high-quality, evidence-based care to cancer patients. In order to accelerate discoveries that will further improve care for Veterans with cancer, the VA has partnered with the Center for Translational Data Science at the University of Chicago and the Open Commons Consortium to establish a data sharing platform, the Veterans Precision Oncology Data Commons (VPODC). The VPODC makes clinical, genomic, and imaging data from the VA available to the research community at large. In this paper, we detail our motivation for data sharing, describe the VPODC, and outline our collaboration model. By transforming VA data into a national resource for research in precision oncology, the VPODC seeks to foster innovation through collaboration and resource sharing that will ultimately lead to improved care for Veterans with cancer.

Clinical Care Quality Among Veterans Health Administration Patients With Mental Illness Following Medical Home Implementation.

OBJECTIVE: This study sought to compare quality of care following medical home implementation among Veterans Health Administration (VHA) primary care patients with and without mental illness. METHODS: VHA primary care patients seen between April 2010 and March 2013 whose medical records were reviewed by the VHA External Peer Review Program were identified. The proportion of patients meeting quality indicators in each mental illness group (depression, posttraumatic stress disorder, anxiety disorder, substance use disorder, serious mental illness, and any mental illness) was compared with the proportion of patients without mental illness. Sample sizes ranged from 210,864 to 236,421. Differences of 5.0% or greater were deemed clinically important, and higher proportions indicated higher quality of care across 33 clinical indicators. RESULTS: The proportion of veterans meeting clinical quality indicators ranged from 64.7% to 99.6%. Differences of ≥5.0% between veterans with and without mental illness were detected in six of 33 indicators. A greater proportion of veterans with mental illness received influenza immunizations (age 50-64) and had documented left ventricular functioning (among veterans with chronic heart failure) compared with veterans without mental illness. A lower proportion of veterans with substance use disorders or severe mental illness received colorectal cancer screening or met indicators related to recommended medications if diagnosed as having diabetes or ischemic heart disease. CONCLUSIONS: Contrary to earlier reports of lower-quality care, patients with and without mental illness had similar preventive and chronic disease management care quality following medical home implementation.

Regional Adoption of Primary Care-Mental Health Integration in Veterans Health Administration Patient-Centered Medical Homes.

INTRODUCTION: Behavioral health integration is important, yet difficult to implement, in patient-centered medical homes. The Veterans Health Administration (VA) mandated evidence-based collaborative care models through Primary Care-Mental Health Integration (PC-MHI) in large PC clinics. This study characterized PC-MHI programs among all PC clinics, including small sites exempt from program implementation, in one VA region. METHODS: Researchers administered a cross-sectional key informant organizational survey on PC-MHI among VA PC clinics in Southern California, Arizona, and New Mexico (n = 69 distinct sites) from February to May 2018. Researchers analyzed PC clinic leaders' responses to five items about organizational structure and practice management. RESULTS: Researchers received surveys from 65 clinics (94% response rate). Although only 38% were required to implement on-site PC-MHI programs, 95% of participating clinics reported providing access to such services. The majority reported having integrated, colocated, or tele-MH providers (94%) and care management (77%). Most stated same-day services (59%) and "warm" handoffs (56%) were always available, the former varying significantly based on clinic size and distance from affiliated VA hospitals. CONCLUSIONS: Regional adoption of PC-MHI was high, including telemedicine, among VA patient-centered medical homes, regardless of whether implementation was required. Small, remote PC clinics that voluntarily provide PC-MHI services may need more support.

Improving Documentation of Distress in Veteran Patients for Hematology/Oncology Clinics.

The purpose of this quality improvement study was to improve physician documentation of distress in medical records of hematology/oncology veteran patients at the Malcolm Randall Veteran Affairs (VA) Medical Center hematology/oncology fellows' clinic in Gainesville, Florida. Before this intervention, the VA hematology/oncology fellows were not documenting patient distress in medical records. The quality improvement intervention was executed through the use of Plan-Do-Study-Act (PDSA) cycles with an ultimate goal of 50% documentation rate. Physician charts were audited to investigate official documentation of distress in patient charts. Physician documentation of distress was 14% in the first PDSA cycle, 21% in the second PDSA cycle, and 36% in the third PDSA cycle. Additional data on distress in hematology/oncology veteran patients were collected using the National Comprehensive Cancer Network Distress Thermometer and Problem List for Patients. Analysis of findings indicated that 42% of 88 patients experienced distress. Findings also suggest that hematology/oncology veteran patients experience specific sources of distress, notably fatigue and pain. These patients have presumably undergone unique experiences that can result in distress that providers should follow-up with in medical charts. Although this intervention has proven challenging to fully implement, standardizing patient distress in patient medical records has the potential to improve the quality of care provided by hematology/oncology physicians.

What Should Health Care Systems Consider When Implementing Complementary and Integrative Health: Lessons from Veterans Health Administration.

OBJECTIVES: Health care systems are increasingly interested in becoming whole health systems that include complementary and integrative health (CIH) approaches. The nation's largest health care system, the Veterans Health Administration (VA), has been transforming to such a system. However, anecdotal evidence suggested that many VA medical centers have faced challenges in implementing CIH approaches, whereas others have flourished. We report on a large-scale, research-operations partnered effort to understand the challenges faced by VA sites and the strategies used to address these to better support VAs implementation of CIH nationally. DESIGN: We conducted semi-structured, in-person qualitative interviews with 149 key stakeholders at 8 VA medical centers, with content based on Greenhalgh's implementation framework. For analysis, we identified a priori categories of content aligned with Greenhalgh's framework and then generated additional categories developed inductively, capturing additional implementation experiences. These categories formed a template to aid in coding data. RESULTS: VA sites commonly reported that nine key factors facilitated CIH implementation: (1) organizing individual CIH approaches into one program instead of spreading across several departments; (2) having CIH strategic plans and steering committees; (3) strong, professional, and enthusiastic CIH program leads and practitioners; (4) leadership support; (5) providers' positive attitudes toward CIH; (6) perceptions of patients' attitudes; (7) demonstrating evidence of CIH effectiveness; (8) champions; and (9) effectively marketing. Common challenges included are: (1) difficulties in hiring; (2) insufficient/inconsistent CIH funding; (3) appropriate patient access to CIH approaches; (4) difficulties in coding/documenting CIH use; (5) insufficient/inappropriate space; (6) insufficient staff's and provider's time; and (7) the health care cultural and geographic environments. Sites also reported several successful strategies supporting CIH implementation. CONCLUSIONS: VA sites experience both success and challenges with implementing CIH approaches and have developed a wide range of strategies to support their implementation efforts. This information is potentially useful to other health care organizations considering how best to support CIH provision.

Veterans Health Administration Primary Care Provider Adherence to Prescribing Guidelines for Systemic Hormone Therapy in Menopausal Women.

BACKGROUND: Systemic hormone therapy (HT) is effective for treating menopausal symptoms but also confers risks. Therefore, experts have developed clinical guidelines for its use. PURPOSE: We assessed primary care guideline adherence in prescribing systemic HT, and associations between adherence and provider characteristics, in four Veterans Health Administration (VA) facilities. METHODS: We abstracted medical records associated with new and renewal systemic HT prescriptions examining adherence to guidelines for documenting indications and contraindications; prescribing appropriate dosages; and prescribing progesterone. RESULTS: Average guideline adherence was 58%. Among new prescriptions, 74% documented a guideline-adherent indication and 28% documented absence of contraindications. Among renewals, 39% documented a guideline-adherent indication. In prescribing an appropriate dose, 45% of new prescriptions were guideline-adherent. Among renewal prescriptions with conjugated equine estrogen doses ≥0.625 mg or equivalent, 16% documented the dosing rationale. Among 116 prescriptions for systemic estrogen in women with a uterus, progesterone was not prescribed in 8. CONCLUSIONS: Guideline adherence in prescribing systemic HT was low among VA primary care providers. Failures to coprescribe progesterone put women at increased risk for endometrial cancer. IMPLICATIONS: Intervention development is urgently needed to improve guideline adherence among primary care prescribers of systemic HT for menopause. Similar assessments should be conducted in community settings.

Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration.

BACKGROUND: It is challenging to conduct and quickly disseminate findings from in-depth qualitative analyses, which can impede timely implementation of interventions because of its time-consuming methods. To better understand tradeoffs between the need for actionable results and scientific rigor, we present our method for conducting a framework-guided rapid analysis (RA) and a comparison of these findings to an in-depth analysis of interview transcripts. METHODS: Set within the context of an evaluation of a successful academic detailing (AD) program for opioid prescribing in the Veterans Health Administration, we developed interview guides informed by the Consolidated Framework for Implementation Research (CFIR) and interviewed 10 academic detailers (clinical pharmacists) and 20 primary care providers to elicit detail about successful features of the program. For the RA, verbatim transcripts were summarized using a structured template (based on CFIR); summaries were subsequently consolidated into matrices by participant type to identify aspects of the program that worked well and ways to facilitate implementation elsewhere. For comparison purposes, we later conducted an in-depth analysis of the transcripts. We described our RA approach and qualitatively compared the RA and deductive in-depth analysis with respect to consistency of themes and resource intensity. RESULTS: Integrating the CFIR throughout the RA and in-depth analysis was helpful for providing structure and consistency across both analyses. Findings from the two analyses were consistent. The most frequently coded constructs from the in-depth analysis aligned well with themes from the RA, and the latter methods were sufficient and appropriate for addressing the primary evaluation goals. Our approach to RA was less resource-intensive than the in-depth analysis, allowing for timely dissemination of findings to our operations partner that could be integrated into ongoing implementation. CONCLUSIONS: In-depth analyses can be resource-intensive. If consistent with project needs (e.g., to quickly produce information to inform ongoing implementation or to comply with a policy mandate), it is reasonable to consider using RA, especially when faced with resource constraints. Our RA provided valid findings in a short timeframe, enabling identification of actionable suggestions for our operations partner.

Gerofit Prehabilitation Pilot Program: Preparing Frail Older Veterans for Surgery.

Older Veterans are increasingly undergoing surgery and are at particularly high risk of postoperative morbidity and mortality. Prehabilitation has emerged as a method to improve postoperative outcomes by enhancing the patient's preoperative condition. We present data from our prehabilitation pilot project and plans for expansion and dissemination of a nationwide quality improvement effort. The infrastructure of the existing Veterans Affairs (VA) Gerofit health and exercise program was used to create our pilot. Pilot patients were screened for risk of postoperative functional decline, assessed for baseline physical function, enrolled in a personalized exercise program, and prepared to transition into the hospital for surgery. Patients (n = 9) completed an average of 17.7 prehabilitation sessions. After completing the program, 55.6% improved in ≥2 of the 5 fitness assessments completed. Postoperative outcomes including complications, 30-day mortality, and 30-day readmissions were better than predicted by the National Surgical Quality Improvement Program Surgical Risk Calculator. We have obtained institutional support for implementing similar prehabilitation programs at VA hospitals nationally through our designation as a VA Patient Safety Center for Inquiry. This is the first multi-institutional prehabilitation program for frail, older Veterans and represents an essential step toward optimizing surgical care for this vulnerable population.

"It's Changed Everything": Voices of Veterans in the Veteran-Directed Home and Community Based Services Program.

The purpose of this study was to understand the value and impact of the Veteran-Directed Home and Community Based Services program (VD-HCBS) on Veterans' lives in their own voices. Focus groups and individual interviews by telephone were conducted to elicit participant perspectives on what was most meaningful, and what difference VD-HCBS made in their lives. Transcripts were analyzed using content analysis. The sample included 21 Veterans, with a mean age of 66±14, enrolled in VD-HCBS an average of 20.8 months. All were at risk of institutional placement based on their level of disability. Five major categories captured the information provided by participants: What a Difference Choice Makes; I'm a Person!; It's a Home-Saver; Coming Back to Life; and Keeping Me Healthy & Safe. Participants described the program as life changing. This study is the first time that Veterans themselves have identified the ways in which VD-HCBS impacted their lives, uncovering the mechanisms underlying positive outcomes. These categories revealed new ways of understanding VD-HCBS as an innovative approach to meeting the person-centered needs of Veterans wishing to remain at home, while experiencing quality care and leading meaningful lives, areas identified as priorities for improving long term services and supports.

Local Leaders' Perspectives on Women Veterans' Health Care: What Would Ideal Look Like?

BACKGROUND: The Veterans Health Administration (VHA) faces challenges in providing comprehensive, gender-sensitive care for women. National policies have led to important advancements, but local leadership also plays a vital role in implementing changes and operationalizing national priorities. In this article, we explore the notions of ideal women veterans' health care articulated by women's health leaders at local VHA facilities and regional networks, with the goal of identifying elements that could inform practice and policy. METHODS: We conducted semistructured interviews with 86 local and regional women's health leaders at 12 VHA medical centers across four regions. At the conclusion of interviews about women's primary care, participants were asked to imagine "ideal care" for women veterans. Interviews were transcribed and coded using a hybrid inductive/deductive approach. RESULTS: In describing ideal care, participants commonly touched on whether women veterans should have separate primary care services from men; the need for childcare, expanded reproductive health services, resources, and staffing; geographic accessibility; the value of input from women veterans; the physical appearance of facilities; fostering active interest in women's health across providers and staff; and the relative priority of women's health at the VHA. CONCLUSIONS: Policy and practice changes to care for women veterans must be mindful of key stakeholders' vision for that care. Specific features of that vision include clinic construction that anticipates a growing patient population, providing childcare and expanded reproductive health services, ensuring adequate support staff, expanding mechanisms to incorporate women veterans' input, and fostering a culture oriented towards women's health at the organizational level.

Assessing Brief Intervention for Unhealthy Alcohol Use: A Comparison of Electronic Health Record Documentation and Patient Self-Report.

OBJECTIVE: Alcohol screening and brief intervention (BI) are recommended preventive health practices. Veterans Health Administration (VA) uses a performance measure to incentivize BI delivery. Concerns have been raised about the validity of the BI performance measure, which relies on electronic health record (EHR) documentation. Our objective was to assess concordance between EHR-based documentation and patient-reported receipt of BI, and to examine correlates of concordance. METHOD: Patients with a documented positive screen for unhealthy alcohol use at VA Greater Los Angeles primary care clinics were surveyed (within 15 days on average) in 2013-2014. Documented BI was indicated by an EHR note that the patient was advised to drink within recommended limits or reduce or abstain from drinking. Patient-reported receipt of BI corresponded to an affirmative response to questions on whether a VA provider advised the patient to drink less or abstain. Patient report and documentation were assessed over the same period. RESULTS: Documented and patient-reported receipt of BI had low concordance. Almost all patients who reported receiving BI had documentation of BI (93%; 95% CI [90%, 95%]), but only 63% [59%, 67%] of patients with documented BI reported receiving it. BI concordance was associated with more severe unhealthy alcohol use and drinking-related consequences, mental health comorbidity, and greater readiness-to-change alcohol use. CONCLUSIONS: Discrepancies between EHR documentation and patient-reported BI raise concerns about performance measure validity. Patient-reported receipt of BI could be an alternative or complementary measure of BI.