End Users' Perceived Engagement with Clinical Dashboards: A Rapid Review.

Clinical dashboards are an emerging and fast-evolving technology used to support frontline clinicians' practice. Understanding end users' perceived engagement with clinical dashboards is essential to co-design, implementation, and adoption. There is a lack of literature exploring the integration of dashboards into clinical workflow. This rapid review explores clinical end users' perceived engagement with dashboards that support workflow. We conducted a literature search in PubMed and CINAHL. Four articles met our eligibility criteria. Findings reveal variations in taxonomy and measures used to evaluate clinicians' perceived engagement. There are also a variety of reported barriers and facilitators to adoption. Standardized frameworks and vocabulary are needed to facilitate a common understanding of clinical end users' perceived engagement with dashboards.

Use of Real Time Clinical Video Telehealth to Home by primary care providers within the Veterans Health Administration during the first wave of the COVID-19 pandemic: variability across VA stations and with time.

Objective: Determine the extent to which use of Clinical Video Telehealth to Home (VT2H) for primary care licensed independent practitioner visits (PCLIPVs) varied over time and across the Veterans Health Administration (VA) during the first 18 months of the COVID pandemic, and if there was an association between VT2H usage and VA station characteristics. Materials and Methods: All outpatient encounters (n = 12 143 456) for Veterans (n = 4 373 638) that had VA PCLIPVs during the period of observation were categorized as conducted by VT2H, in-person, or telephone. The change over time in the percentage of total PCLIPVs conducted by VT2H was plotted and associations between VA station characteristics and VT2H usage were analyzed using simple statistics and negative binomial regression. Results: Between March 2020 and mid-August 2020, VT2H visits increased from <2% to 13% of all VA PCLIPVs. However, VT2H usage varied substantively by VA station and declined system-wide to <9% of PCLIPVs by July 2021. VA stations that serve a greater proportion of rural Veterans were found less likely to use VT2H. Discussion: The VA was successful in increasing the use of VT2H for PCLIPVs during the first phase of the COVID pandemic. However, VT2H usage varied by VA station and over time. Beyond rurality, it is unknown what station characteristics may be responsible for the variance in VT2H use. Conclusion: Future investigation is warranted to identify the unique practices employed by VA stations that were most successful in using VT2H for PCLIPVs and whether they can be effectively disseminated to other stations.

Supporting Veterans, Caregivers, and Providers in Rural Regions With Tele-Geriatric Psychiatry Consultation: A Mixed Methods Pilot Study.

OBJECTIVES: Cross-facility tele-geriatric psychiatry consultation is a promising model for providing specialty services to regions lacking sufficient geriatric psychiatry expertise. This evaluation focused on assessing the feasibility and acceptability of a consultation program developed by a geriatric psychiatrist in a Veterans Health Administration regional telehealth hub. DESIGN: Concurrent, mixed methods program evaluation. SETTING: A region served by a VA health care system telehealth hub. PARTICIPANTS: Patients with at least 1 geriatric mental health encounter with a geriatric psychiatrist consultant during a 1 year-period; referring providers. INTERVENTION: Virtual psychiatric evaluation of Veterans with time-limited follow-up and e-consultation with providers. MEASUREMENTS: Interviews with consultant, medical record data, and referring provider surveys. RESULTS: Three hundred fifteen Veterans (M = 76.0 ± 9.64 years; 40% rural-dwelling) had 666 encounters (M = 2.11 ± 1.78) with most occurring via clinical video telehealth (n = 443; 67.6%), e-consultation (n = 99; 15.1%), or video to home (n = 95; 14.5%). Most encounters were related to neurocognitive disorders, depressive disorders, trauma-related disorders, or serious mental illness. Referring providers (N = 58) highly recommended the program, reported high satisfaction, followed through with recommendations, and believed that this program increased access to geriatric psychiatry. CONCLUSIONS: This single program was shown to be feasible, acceptable, and valued by the referring providers. The findings highlighted the complex presentations of Veterans referred, and the current unmet need of providers of such Veterans, providing impetus for wider implementation.

Impact of moral injury and posttraumatic stress disorder on health care utilization and suicidality in rural and urban veterans.

This study explored the impact of moral injury (MI) and posttraumatic stress disorder (PTSD) on health care utilization, mental health complexity, and suicidality in rural and urban veterans. Analyses combined data from the Salt Lake City PTSD Clinic Intake Database and the Department of Veterans Affairs Corporate Data Warehouse. Participants (N = 1,545; Mage = 45.9 years) were predominately male (88.3%) and White (87.8%). Adjusted analyses indicated associations between a 1-unit increase in Moral Injury Events Scale (MIES) score and increased mental health complexity, RR = 1.01, 95% CI [1.01, 1.02], p < .001; psychotropic medication utilization, RR = 1.01, 95% CI [1.01, 1.03], p < .001; VA drug class count, RR = 1.01, 95% CI [1.00, 1.01], p = .030; outpatient utilization, RR = 1.01, 95% CI [1.01, 1.02], p < .001; and mental health outpatient utilization, RR = 1.01, 95% CI [1.00, 1.03], p < .001. For the MIES x PTSD interaction, all associations remained statistically significant with similar estimated effects. However, for rural veterans, this interaction did not significantly affect utilization. Among those with PTSD, a 1-unit MIES increase was associated with an increased risk of suicidality, OR = 1.02, 95% CI [1.01, 1.04], and psychiatric admission, OR = 1.02, 95% CI [1.00, 1.04]. Findings suggest that higher MIES scores predict increased health care utilization and mental health complexity. Further, PTSD combined with higher MIES scores may increase the risk of suicidality and psychiatric admission. Rural veterans with PTSD and higher MIES scores may require additional outreach and intervention.

Leveraging A Clinical Dashboard and Process Mappings to Improve Treatment Access and Outcomes for Women Veterans with Urinary Incontinence.

In support of the Improving Primary Care Understanding of Resources and Screening for Urinary Incontinence to Enhance Treatment initiative with the Veterans Health Administration, we developed a clinical dashboard to support primary care providers in identifying underdiagnosed, undertreated women Veterans with urinary incontinence. This paper describes our dashboard development and evaluation. We employed a user-centered design in determining dashboard requirements, interface design, and functionality. We invited early users at three pilot sites to formal usability reviews. We quantified the dashboard usability using the System Usability Scale and administered surveys and interviews for insights on performance. We employed process maps to uncover processes of end-users' dashboard engagements within local environments. User evaluations demonstrated the dashboard as a helpful instrument in identifying women Veterans with good to excellent usability performance. User feedback offers a user-driven pathway to develop our dashboard that supports clinicians to better care for women Veterans with urinary incontinence.

Developing the VA Geriatric Scholars Programs' Clinical Dashboards Using the PDSA Framework for Quality Improvement.

BACKGROUND: Involving clinician end users in the development process of clinical dashboards is important to ensure that user needs are adequately met prior to releasing the dashboard for use. The challenge with following this approach is that clinician end users can undergo periodic turnover, meaning, the clinicians that played a role in the initial development process may not be the same individuals that use the dashboard in future. OBJECTIVES: Here, we summarize our Plan, Do, Study, Act (PDSA)-guided clinical dashboard development process for the VA Geriatric Scholars Program (GSP) and the value of continuous, iterative development. We summarize dashboard adaptations that resulted from two PDSA cycles of improvement for the potentially inappropriate medication dashboard (PIMD), one of many Geriatric Scholars clinical dashboards. We also present the evaluative performance of the PIMD. METHODS: Evaluation of the PIMD was performed using the system usability scale (SUS) and through review of user interaction logs. Routine end users that were Geriatric Scholars and had evidence of 5 or more dashboard views were invited to complete an electronic form that contained the 10-item SUS. RESULTS: The proportion of Geriatric Scholars that utilized the PIMD increased for each iterative dashboard version that was produced as a byproduct from feedback (31.0% in 2017 to 60.2% in 2019). The overall usability of the PIMD among routine users was found to be above average (SUS score: 75.2 [95% CI 70.5-79.8]) in comparison to the recommended standard of acceptability (SUS score: 68) CONCLUSION: The solicitation of feedback during dashboard orientations led to iterative adaptations of the PIMD that broadened its intended use. The presented PDSA-guided process to clinical dashboard development for the VA GSP can serve as a valuable framework for development teams seeking to produce well-adopted and usable health information technology (IT) innovations.

Integration of Patient-Reported Outcome Measures in the Electronic Health Record: The Veterans Affairs Experience.

PURPOSE: There are growing efforts to integrate patient-reported outcome (PRO) data into electronic health records (EHRs) to bring together disparate sources of patient information and improve medical care. PRO measures can be used to assess cancer symptom presence and severity. Integrating PRO tools in EHRs can alert providers to address symptoms, which is an essential component of comprehensive oncology care. METHODS: We modified a PRO used to measure cancer and end-of-life symptoms, the Edmonton Symptom Assessment System to create the Veteran Symptom Assessment System (VSAS). VSAS was implemented as an integrated PRO as part of the Veterans Administration EHR system and was used at hematology-oncology clinics in Veteran Administration (VA) medical centers in the Southeast. RESULTS: From 2013 to 2014, VSAS was introduced, underwent usability testing and modifications, and was finally implemented in the EHR. Between 2015 and 2019, VSAS was administered 43,883 times in 9,058 patients. Eighty-nine percent of Veterans were male, 11% were female, 52% identified as non-Hispanic White, and 43% identified as African American. Fatigue, shortness of breath with exertion, and pain were most frequently reported initially (68%, 48%, and 45%, respectively) and were most frequently rated as severe (27%, 16%, and 17%, respectively). In patients diagnosed with stage IV cancer, higher symptom burden was significantly associated with shorter overall survival. The majority of Veterans with longitudinal measurements experienced improvement in symptoms, most frequently in severe symptoms. CONCLUSION: To our knowledge, this is the first large-scale implementation of a PRO system, integrated in the VA EHR, in ambulatory patients with cancer and blood disorders. The integration of VSAS within the VA EHR is a significant demonstration and a necessary requirement for current and future systemic initiatives in cancer symptom management.

Predicting Survival in Veterans with Follicular Lymphoma Using Structured Electronic Health Record Information and Machine Learning.

The most accurate prognostic approach for follicular lymphoma (FL), progression of disease at 24 months (POD24), requires two years' observation after initiating first-line therapy (L1) to predict outcomes. We applied machine learning to structured electronic health record (EHR) data to predict individual survival at L1 initiation. We grouped 523 observations and 1933 variables from a nationwide cohort of FL patients diagnosed 2006-2014 in the Veterans Health Administration into traditionally used prognostic variables ("curated"), commonly measured labs ("labs"), and International Classification of Diseases diagnostic codes ("ICD") sets. We compared performance of random survival forests (RSF) vs. traditional Cox model using four datasets: curated, curated + labs, curated + ICD, and curated + ICD + labs, also using Cox on curated + POD24. We evaluated variable importance and partial dependence plots with area under the receiver operating characteristic curve (AUC). RSF with curated + labs performed best, with mean AUC 0.73 (95% CI: 0.71-0.75). It approximated, but did not surpass, Cox with POD24 (mean AUC 0.74 [95% CI: 0.71-0.77]). RSF using EHR data achieved better performance than traditional prognostic variables, setting the foundation for the incorporation of our algorithm into the EHR. It also provides for possible future scenarios in which clinicians could be provided an EHR-based tool which approximates the predictive ability of the most accurate known indicator, using information available 24 months earlier.

Treatment Patterns and Outcomes in a Nationwide Cohort of Older and Younger Veterans with Waldenström Macroglobulinemia, 2006-2019.

Little is known about real-world treatment patterns and outcomes in Waldenström macroglobulinemia (WM) following the recent introduction of newer treatments, especially among older adults. We describe patterns of first-line (1 L) WM treatment in early (2006-2012) and modern (2013-2019) eras and report outcomes (overall response rate (ORR), overall survival (OS), progression-free survival (PFS), and adverse event (AE)-related discontinuation) in younger (≤70 years) and older (>70 years) populations. We followed 166 younger and 152 older WM patients who received 1 L treatment between January 2006 and April 2019 in the Veterans Health Administration. Median follow-up was 43.5 months (range: 0.6-147.2 months). Compared to the early era, older patients in the modern era achieved improved ORRs (early: 63.8%, modern: 72.3%) and 41% lower risk of death/progression (hazard ratio (HR) for PFS: 0.59, 95% CI (confidence interval): 0.36-0.95), with little change in AE-related discontinuation between eras (HR: 0.82, 95% CI: 0.4-1.7). In younger patients, the AE-related discontinuation risk increased almost fourfold (HR: 3.9, 95% CI: 1.1-14), whereas treatment effects did not change between eras (HR for OS: 1.4, 95% CI: 0.66-2.8; HR for PFS: 1.1, 95% CI: 0.67-1.7). Marked improvements in survival among older adults accompanied a profound shift in 1 L treatment patterns for WM.

Real-world practice patterns and outcomes in Veterans with relapsed/refractory diffuse large B-cell lymphoma.

Aim: To describe practices and outcomes in veterans with relapsed/refractory diffuse large B-cell lymphoma. Patients & methods: Using Veteran Affairs Cancer Registry System and electronic health record data, we identified relapsed/refractory diffuse large B-cell lymphoma patients completing second-line treatment (2L) in 2000-2016. Treatments were classified as aggressive/nonaggressive. Analyses included descriptive statistics and the Kaplan-Meier estimation of progression-free survival and overall survival. Results: Two hundred and seventy patients received 2L. During median 9.7-month follow-up starting from 2L, 470 regimens were observed, averaging 2.7 regimens/patient: 219 aggressive, 251 nonaggressive. One hundred and twenty-one patients proceeded to third-line, 50 to fourth-line and 18 to fifth-line treatment. Median progression-free survival in 2L was 5.2 months. Median overall survival was 9.5 months. Forty-four patients (16.3%) proceeded to bone marrow transplant. Conclusion: More effective, less toxic treatments are needed and should be initiated earlier in treatment trajectory.

Atrial Fibrillation and Bleeding in Patients With Chronic Lymphocytic Leukemia Treated with Ibrutinib in the Veterans Health Administration.

BACKGROUND: Chronic lymphocytic leukemia (CLL) is the most common type of leukemia in adults. The introduction of novel oral agents, starting with ibrutinib in 2013, has revolutionized the therapeutic landscape; however, clinical trials have suggested an association between ibrutinib and the risk of bleeding-related adverse events and atrial fibrillation (Afib) in patients with CLL. METHODS: Patients diagnosed and treated for CLL at the Veterans Health Administration (VHA) from 2010 to 2014 were followed until December 31, 2016, death, or lack of utilization of hematology/oncology services for ≥ 18 months; or until incidence of another cancer. Treatments dispensed, evidence of VHA system use, bleeding events, and Afib were determined from the administrative records, laboratory records, pharmacy dispensation records, and clinical notes in the electronic healthcare record. RESULTS: From 2010 to 2014, 2,796 patients were diagnosed and received care for CLL within the VHA, of whom 172 patients received ibrutinib and 291 received bendamustine + rituximab (BR). The use of anticoagulants following induction therapy did not differ between BR and ibrutinib patients (9% vs 8%, respectively), nor did the use of antiplatelets agents (6% vs 2%, respectively). Of the 291 patients that received BR, 12 (4%) developed a bleeding event compared with 20 (12%) who received ibrutinib. Additionally, 13 (8%) ibrutinib patients developed Afib compared with 9 (3%) BR patients. CONCLUSIONS: Real-world evidence from a nationwide cohort of patients with CLL suggests that while ibrutinib is associated with increased bleeding-related adverse events and Afib, the risk is comparable to those reported in previous clinical trials. These findings suggest that patients in real-world clinical care settings with higher levels of comorbidities may be at an increased risk for bleeding events and Afib.

Maintenance rituximab in Veterans with follicular lymphoma.

Real-world practice patterns and clinical outcomes in patients with follicular lymphoma (FL), including the adoption of maintenance rituximab (MR) therapy in the United States (US), have been reported in few studies since the release of the National LymphoCare Study almost a decade ago. We analyzed data from the largest integrated healthcare system in the United States, the Veterans Health Administration (VHA), to identify rates of adoption and effectiveness of MR in FL patients after first-line (1L) treatment. We identified previously untreated patients with FL in the VHA between 2006 and 2014 who achieved at least stable disease after chemoimmunotherapy or immunotherapy. Among these patients, those who initiated MR within 238 days of 1L composed the MR group, whereas those who did not were classified as the non-MR group. We examined the effect of MR on progression-free survival (PFS) and overall survival (OS). A total of 676 patients met our inclusion criteria, of whom 300 received MR. MR was associated with significant PFS (hazard ratio [HR]=0.55, P < .001) and OS (HR = 0.53, P = .005) compared to the non-MR group, after adjusting by age, sex, ethnicity, geographic region, diagnosis period, stage, grade at diagnosis, hemoglobin, lactate dehydrogenase (LDH), Charlson comorbidity index (CCI), 1L treatment regimen, and response to 1L treatment. These results suggest that in FL patients who do not experience disease progression after 1L treatment in real-world settings, MR is associated with a significant improvement in both PFS and OS. Maintenance therapy should be considered in FL patients who successfully complete and respond to 1L therapy.

Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process.

BACKGROUND: With the increased usage of dashboard reporting systems to monitor and track patient panels by clinical users, developers must ensure that the information displays they produce are accurate and intuitive. When evaluating usability of a clinical dashboard among potential end users, developers oftentimes rely on methods such as questionnaires as opposed to other, more time-intensive strategies that incorporate direct observation. OBJECTIVES: Prior to release of the potentially inappropriate medication (PIM) clinical dashboard, designed to facilitate completion of a quality improvement project by clinician scholars enrolled in the Veterans Affairs (VA) workforce development Geriatric Scholars Program (GSP), we evaluated the usability of the system. This article describes the process of usability testing a dashboard reporting system with clinicians using direct observation and think-aloud moderating techniques. METHODS: We developed a structured interview protocol that combines virtual observation, think-aloud moderating techniques, and retrospective questioning of the overall user experience, including use of the System Usability Scale (SUS). Thematic analysis was used to analyze field notes from the interviews of three GSP alumni. RESULTS: Our structured approach to usability testing identified specific functional problems with the dashboard reporting system that were missed by results from the SUS. Usability testing lead to overall improvements in the intuitive use of the system, increased data transparency, and clarification of the dashboard's purpose. CONCLUSION: Reliance solely on questionnaires and surveys at the end stages of dashboard development can mask potential functional problems that will impede proper usage and lead to misinterpretation of results. A structured approach to usability testing in the developmental phase is an important tool for developers of clinician friendly systems for displaying easily digested information and tracking outcomes for the purpose of quality improvement.

The Enhancing Quality of Prescribing Practices for Older Veterans Discharged From the Emergency Department (EQUIPPED) Potentially Inappropriate Medication Dashboard: A Suitable Alternative to the In-person Academic Detailing and Standardized Feedback Reports of Traditional EQUIPPED?

PURPOSE: The Enhancing Quality of Prescribing Practices for Older Veterans Discharged From the Emergency Department (EQUIPPED) program is a quality improvement initiative that combines education, clinical decision support (ie, geriatric pharmacy order sets), and in-person academic detailing coupled with audit and feedback in an effort to improve appropriate prescribing to older veterans discharged from the emergency department. Although the EQUIPPED program is effective at reducing the prescribing of potentially inappropriate medications, the reliance on in-person academic detailing may be a limitation for broader dissemination. The EQUIPPED dashboard is a passive yet continuous audit and feedback mechanism developed to potentially replace the in-person academic detailing of the traditional EQUIPPED program. We describe the development process of the EQUIPPED dashboard and the key audit and feedback components found within. METHODS: The Veterans Affairs (VA) Corporate Data Warehouse (CDW) serves as the underlying data source for the EQUIPPED dashboard. SQL Server Integration Services was used to build the backend data architecture. Data were isolated from the CDW for reporting purposes using an extract, load, transform (ELT) approach. The team used SQL Server Reporting Services to produce the user interface and add interactive functionality. The team used an agile development approach when designing the user interface, engaging end users at 2 VA EQUIPPED implementation sites by providing printed screenshots of a beta version of the dashboard. FINDINGS: The EQUIPPED dashboard ELT process executes nightly to provide dashboard end users with a near real-time data experience and the potential for daily audit and feedback. The following dashboard components were identified as necessary for the EQUIPPED dashboard to be a suitable audit and feedback tool: key performance indicators, peer-to-peer benchmarking, individual patient or encounter drill down, educational decision support, and longitudinal performance tracking. IMPLICATIONS: To our knowledge, the EQUIPPED dashboard is the first information display of its kind with built-in audit and feedback that has been developed for VA emergency department practitioners as the primary end users. Further investigation is warranted to determine whether the EQUIPPED dashboard is a suitable alternative to in-person academic detailing. The EQUIPPED dashboard will be leveraged in a formal implementation trial that will entail the randomization of multiple VA sites to either (1) traditional EQUIPPED with in-person academic detailing coupled with audit and feedback or (2) EQUIPPED with passive audit and feedback delivered through the EQUIPPED dashboard without in-person prescribing outreach.

Real-world practice patterns in veterans with metastatic castration-resistant prostate cancer.

BACKGROUND: Metastatic castration-resistant prostate cancer (mCRPC) is incurable, with most patients surviving less than 3 years. However, many treatments that extend survival have been approved in the past decade. OBJECTIVE: To describe the patient demographics, disease characteristics, treatment patterns, and outcomes in a cohort of Veterans diagnosed with mCRPC in the Veterans Health Administration. DESIGN: We identified 3,637 Veterans diagnosed with prostate cancer between January 2006 and August 2015 with evidence of mCRPC through December 2016. We described the most commonly used systemic mCRPC treatments according to mCRPC diagnosis era: Epoch 1 (2006-2010) or Epoch 2 (2011-2016). Patient demographics, disease characteristics, and treatment patterns were examined using descriptive statistics. An unadjusted Kaplan-Meier method was used to estimate the median time to biochemical progression and overall survival (OS) with 95% confidence intervals. RESULTS: The median age at initial prostate cancer diagnosis was 68 years. Approximately 67% of patients were non-Hispanic white, 29% were black, and 4% were other/unknown. A high-risk Gleason score (8-10) was reported in 748 (67%) of patients in Epoch 1 and 1578 (63%) of patients in Epoch 2, and the median prostate-specific antigen level at initial prostate cancer diagnosis was higher in Epoch 1 patients than in Epoch 2 patients (68 vs. 35 ng/ml). Following mCRPC diagnosis, the most common first-line therapies in Epoch 1 patients were docetaxel (83%) and abiraterone (9%), whereas Epoch 2 patients mainly received abiraterone (47%), docetaxel (36%), and enzalutamide (15%). In Epoch 1 and Epoch 2 patients, the median time to biochemical progression (unadjusted) was 9 and 13 months, respectively, and the median OS (unadjusted) was 15 and 23 months, respectively. CONCLUSIONS: The introduction of new therapies has resulted in increased use of the noncytotoxic agents abiraterone and enzalutamide as first-line treatment in lieu of docetaxel. Our results suggest that more recently diagnosed patients (Epoch 2) have a delayed time to biochemical progression and longer OS (unadjusted) compared with patients diagnosed earlier (Epoch 1).

VA Geriatric Scholars Program's impact on prescribing potentially inappropriate medications.

OBJECTIVES: The Veterans Affairs (VA) Geriatric Scholars Program (GSP) is a workforce development program to enhance skills and competencies among VA clinicians who provide healthcare for older veterans in VA primary care clinics. An intensive geriatrics didactics (IGD) course is a core element of this professional development program. The objective of this study was to evaluate the impact of completing the IGD course on providers' rates of prescribing definite potentially inappropriate medications (DPIMs) based on Beers Criteria from 2008 to 2016. STUDY DESIGN: We applied a longitudinal interrupted time series design to examine changes in DPIM prescribing rates for GSP participants before and after completing the IGD course. METHODS: The time series was divided into two 12-month periods, representing the preintervention period (ie, 12 months prior to completing the IGD course) and the postintervention period (ie, 12 months after completing the IGD course), and populated with pharmacy dispensing data from the VA's Corporate Data Warehouse. An adjusted slope impact model was developed to estimate the postintervention change in the proportion of the dispensed medications identified as DPIMs. RESULTS: After adjusting for case mix, we observed a statistically significant reduction in the proportion of DPIMs dispensed post IGD (slope change, 0.994; 95% CI, 0.991-0.997). This change in slope reflects a total decrease of 7971 DPIM dispensings during the postintervention period. This equates to an estimated 24 fewer DPIM dispensings per provider during the postintervention period. CONCLUSIONS: Although the size of the effect was modest, we found that participation in the GSP IGD course reduced prescribing of DPIMs for older veterans.

Validation of Algorithms Used to Identify Red Blood Cell Transfusion Related Admissions in Veteran Patients with End Stage Renal Disease.

BACKGROUND: The goal of this study was to compare the performance of several database algorithms designed to identify red blood cell (RBC) Transfusion Related hospital Admissions (TRAs) in Veterans with end stage renal disease (ESRD). METHODS: Hospitalizations in Veterans with ESRD and evidence of dialysis between 01/01/2008 and 12/31/2013 were screened for TRAs using a clinical algorithm (CA) and four variations of claims-based algorithms (CBA 1-4). Criteria were implemented to exclude patients with non-ESRD-related anemia (e.g., injury, surgery, bleeding, medications known to produce anemia). Diagnostic performance of each algorithm was delineated based on two clinical representations of a TRA: RBC transfusion required to treat ESRD-related anemia on admission regardless of the reason for admission (labeled as TRA) and hospitalization for the primary purpose of treating ESRD-related anemia (labeled TRA-Primary). The performance of all algorithms was determined by comparing each to a reference standard established by medical records review. Population-level estimates of classification agreement statistics were calculated for each algorithm using inverse probability weights and bootstrapping procedures. Due to the low prevalence of TRAs, the geometric mean was considered the primary measure of algorithm performance. RESULTS: After application of exclusion criteria, the study consisted of 12,388 Veterans with 26,672 admissions. The CA had a geometric mean of 90.8% (95% Confidence Interval: 81.8, 95.6) and 94.7% (95% CI: 80.5, 98.7) for TRA and TRA-Primary, respectively. The geometric mean for the CBAs ranged from 60.3% (95% CI: 53.2, 66.9) to 91.8% (95% CI: 86.9, 95) for TRA, and from 80.7% (95% CI: 72.9, 86.7) to 96.7% (95% CI: 94.1, 98.2) for TRA-Primary. The adjusted proportions of admissions classified as TRAs was 3.2% (95% CI: 2.8, 3.8) and TRA-Primary was 1.3% (95% CI: 1.1, 1.7). CONCLUSIONS: The CA and select CBAs were able to identify TRAs and TRA-primary with high levels of accuracy and can be used to examine anemia management practices in ESRD patients.