Evaluating feedback reports to support documentation of veterans' care preferences in home based primary care.

BACKGROUND: To evaluate the effectiveness of delivering feedback reports to increase completion of LST notes among VA Home Based Primary Care (HBPC) teams. The Life Sustaining Treatment Decisions Initiative (LSTDI) was implemented throughout the Veterans Health Administration (VHA) in the United States in 2017 to ensure that seriously ill Veterans have care goals and LST decisions elicited and documented. METHODS: We distributed monthly feedback reports summarizing LST template completion rates to 13 HBPC intervention sites between October 2018 and February 2020 as the sole implementation strategy. We used principal component analyses to match intervention to 26 comparison sites and used interrupted time series/segmented regression analyses to evaluate the differences in LST template completion rates between intervention and comparison sites. Data were extracted from national databases for VA HBPC in addition to interviews and surveys in a mixed methods process evaluation. RESULTS: LST template completion rose from 6.3 to 41.9% across both intervention and comparison HBPC teams between March 1, 2018, and February 26, 2020. There were no statistically significant differences for intervention sites that received feedback reports. CONCLUSIONS: Feedback reports did not increase documentation of LST preferences for Veterans at intervention compared with comparison sites. Observed increases in completion rates across intervention and comparison sites can likely be attributed to implementation strategies used nationally as part of the national roll-out of the LSTDI. Our results suggest that feedback reports alone were not an effective implementation strategy to augment national implementation strategies in HBPC teams.

Randomized controlled trial of tailored audit with feedback in VHA long-term care settings.

BACKGROUND: The Long-Term Care QUERI program supported implementation of the Life-Sustaining Treatment Decisions Initiative in US Veterans Health Administration long-term care settings. The program worked with eleven Community Living Centers (CLCs) and twelve Home-Based Primary Care (HBPC) programs to increase rates of completed templates, using audit with feedback. We distributed monthly feedback reports to site champions showing the number of Veterans with appropriate documentation. Although feedback reports are a common implementation tool, little is known about the most effective ways to design, distribute, and support them. We sought to test tailoring reports with tips using site-specific data, as well as national comparator data. METHODS: We conducted a cluster randomized controlled trial of monthly feedback reports utilizing site-tailored tips and national comparator data compared to our original feedback reports that included only graphical and numerical data. CLC and HBPC team members were invited to participate in brief surveys each quarter to determine if they had received and used the feedback reports. The outcome for CLC residents was the percent with a completed LST template any time prior to the 14th day of their stay. The outcome for HBPC residents was the percent of Veterans with a completed LST template by their second HBPC visit. RESULTS: The response rate to the survey ranged between 6.8 and 19.3% of staff members across the CLC and HBPC sites with 12.8-25.5% of survey respondents reporting that they had seen the feedback reports. The linear regression models showed no significant association between receiving the enhanced feedback reports and having a higher documentation completion rate. CONCLUSIONS: Receiving feedback reports tailored to sites by including tips based on baseline context assessments and qualitative findings, and reports showing national comparator data, did not have an impact on the number of Veterans with a completed LST template. Having a higher proportion of CLC or HBPC team members view the reports was not associated with an increase in LST template completion. These findings suggest that tailored audit with feedback may not have been effective at the program level, although the proportion of respondents who reported seeing the reports was small.

A survey of college students' knowledge and attitudes regarding vaccination practices.

Objective: The prevalence of illnesses related to VPDs is higher among older adults and college students experience them despite decades of vaccine availability. The Centers for Disease Control and Prevention and American College Health Association (ACHA) emphasizes that all students should provide vaccine proof or receive immunizations prior to class registration. Methods: Using the KAP model, this study investigates the perceptions of first-generation university students regarding campus vaccine requirements. Data were collected using the Web-based survey software Qualtrics regarding students' vaccine knowledge and attitudes. Results: Of the 1,327 responses, the majority were female (74.23%), Hispanic (56.67%), and ages 18-25 years (35.57%). Participants were familiar with the function of vaccines (96.64%) and believed that vaccines prevent contagious diseases (92.70%). These responses were significantly associated with vaccination compliance however, 18.48% of students were not in full compliance. There were significant differences in vaccination compliance across academic standing, age, and race. Conclusion: Implications for public health practices on university campuses are discussed.Supplemental data for this article can be accessed online at.

Evaluating implementation strategies to support documentation of veterans' care preferences.

OBJECTIVE: To evaluate the effectiveness of feedback reports and feedback reports + external facilitation on completion of life-sustaining treatment (LST) note the template and durable medical orders. This quality improvement program supported the national roll-out of the Veterans Health Administration (VA) LST Decisions Initiative (LSTDI), which aims to ensure that seriously-ill veterans have care goals and LST decisions elicited and documented. DATA SOURCES: Primary data from national databases for VA nursing homes (called Community Living Centers [CLCs]) from 2018 to 2020. STUDY DESIGN: In one project, we distributed monthly feedback reports summarizing LST template completion rates to 12 sites as the sole implementation strategy. In the second involving five sites, we distributed similar feedback reports and provided robust external facilitation, which included coaching, education, and learning collaboratives. For each project, principal component analyses matched intervention to comparison sites, and interrupted time series/segmented regression analyses evaluated the differences in LSTDI template completion rates between intervention and comparison sites. DATA COLLECTION METHODS: Data were extracted from national databases in addition to interviews and surveys in a mixed-methods process evaluation. PRINCIPAL FINDINGS: LSTDI template completion rose from 0% to about 80% throughout the study period in both projects' intervention and comparison CLCs. There were small but statistically significant differences for feedback reports alone (comparison sites performed better, coefficient estimate 3.48, standard error 0.99 for the difference between groups in change in trend) and feedback reports + external facilitation (intervention sites performed better, coefficient estimate -2.38, standard error 0.72). CONCLUSIONS: Feedback reports + external facilitation was associated with a small but statistically significant improvement in outcomes compared with comparison sites. The large increases in completion rates are likely due to the well-planned national roll-out of the LSTDI. This finding suggests that when dissemination and support for widespread implementation are present and system-mandated, significant enhancements in the adoption of evidence-based practices may require more intensive support.

Comparing Post-Acute Populations and Care in Veterans Affairs and Community Nursing Homes.

OBJECTIVE: The quality of care provided by the US Department of Veterans Affairs (VA) is increasingly being compared to community providers. The objective of this study was to compare the VA Community Living Centers (CLCs) to nursing homes in the community (NHs) in terms of characteristics of their post-acute populations and performance on 3 claims-based ("short-stay") quality measures. DESIGN: Observational, cross-sectional. SETTING AND PARTICIPANTS: CLC and NH residents admitted from hospitals during July 2015-June 2016. METHODS: CLC residents were compared with 3 NH populations: males, Veterans, and all NH residents. CLC and NH performance was compared on risk-adjusted claims-based measures: unplanned rehospitalizations and emergency department visits within 30 days of CLC or NH admission and successful discharge to the community within 100 days of NH admission. RESULTS: Veterans admitted from hospitals to CLCs (n = 23,839 Veterans/135 CLCs) were less physically impaired, less likely to have anxiety, congestive heart failure, hypertension, and dementia than Veterans (n = 241,177/14,818 NHs), males (n = 661,872/15,280 NHs), and all residents (n = 1,674,578/15,395 NHs) admitted to NHs from hospitals. Emergency department and successful discharge risk-adjusted rates of CLCs were statistically significantly better than those of NHs [mean (standard deviation): 8.3% (4.6%) and 67.7% (11.5%) in CLCs vs 11.9% (5.3%) and 57.0% (10.5%) in NHs, respectively]. CLCs had slightly worse rehospitalization rates [22.5% (6.2%) in CLCs vs 21.1% (5.9%) in NHs], but lower combined emergency department and rehospitalization rates [30.8% (0.8%) in CLCs vs 33.0% (0.7%) in NHs]. CONCLUSIONS AND IMPLICATIONS: CLCs and NHs serve different post-acute care populations. Using the same risk-adjusted NH quality metrics, CLCs provided better post-acute care than community NHs.

Honoring Veterans' Preferences: The Association Between Comfort Care Goals and Care Received at the End of Life.

CONTEXT: As part of its Life-Sustaining Treatment (LST) Decisions Initiative, the Veterans Health Administration (VA) in January 2017 began requiring electronic documentation of goals of care and preferences for Veterans with serious illness and at high risk for life-threatening events. OBJECTIVES: To evaluate whether goals of "to be comfortable" were associated with greater palliative care (PC) use and lesser acute care use. METHODS: We identified Veterans with VA inpatient or nursing home stays overlapping July 2018-January 2019, with LST templates documented by January 31, 2019, and who died by April 30, 2019 (N = 18,163). From template documentation, we identified a "to be comfortable" goal. Using VA and Medicare data, we determined PC use (consultations and hospice) and hospital, intensive care unit, and emergency department use 7 and 30 days before death. Multivariate logistic regression examined the associations of interest. RESULTS: Sixty-four percent of the 18,163 Veterans had comfort-care goals; 80% with comfort care goals received hospice and 57% PC consultations (versus 57% and 46%, respectively, for decedents without comfort-care goals). In adjusted analyses, comfort care documented on the LST template prior to death was associated with significantly lower odds of hospital, intensive care unit, and emergency department use near the end of life. In the last 30 days of life, Veterans with a comfort care goal had 44% lower odds (adjusted odds ratio 0.57; 95% CI: 0.51, 0.63) of being hospitalized. CONCLUSION: Findings support the VA's commitment to honoring of Veterans' preferences post introduction of its Life Sustaining Treatment Decisions Initiative.

Visual process maps to support implementation efforts: a case example.

BACKGROUND: Process mapping is often used in quality improvement work to examine current processes and workflow and to identify areas to intervene to improve quality. Our objective in this paper is to describe process maps as a visual means of understanding modifiable behaviors and activities, in this case example to ensure that goals of care conversations are part of admitting a veteran in long-term care settings. METHODS: We completed site visits to 6 VA nursing homes and reviewed their current admission processes. We conducted interviews to document behaviors and activities that occur when a veteran is referred to a long-term care setting, during admission, and during mandatory VA reassessments. We created visualizations of the data using process mapping approaches. Process maps for each site were created to document the admission activities for each VA nursing home and were reviewed by the research team to identify consistencies across sites and to identify potential opportunities for implementing goals of care conversations. RESULTS: We identified five consistent behaviors that take place when a veteran is referred and admitted in long-term care. These behaviors are assessing, discussing, decision-making, documenting, and re-assessing. CONCLUSIONS: Based on the process maps, it seems feasible that the LST note and order template could be completed along with other routine assessment processes. However, this will require more robust multi-disciplinary collaboration among both prescribing and non-prescribing health care providers. Completing the LST template during the current admission process would increase the likelihood that the template is completed in a timely manner, potentially alleviate the perceived time burden, and help with the provision of veteran-centered care.

Life-Sustaining Treatment Decisions Initiative: Early Implementation Results of a National Veterans Affairs Program to Honor Veterans' Care Preferences.

BACKGROUND: On July 1, 2018, the Veterans Health Administration (VA) National Center for Ethics in Health Care implemented the Life-Sustaining Treatment Decisions Initiative (LSTDI). Its goal is to identify, document, and honor LST decisions of seriously ill veterans. Providers document veterans' goals and decisions using a standardized LST template and order set. OBJECTIVE: Evaluate the first 7 months of LSTDI implementation and identify predictors of LST template completion. DESIGN: Retrospective observational study of clinical and administrative data. We identified all completed LST templates, defined as completion of four required template fields. Templates also include four non-required fields. Results were stratified by risk of hospitalization or death as estimated by the Care Assessment Need (CAN) score. SUBJECTS: All veterans with VA utilization between July 1, 2018, and January 31, 2019. MAIN MEASURES: Completed LST templates, goals and LST preferences, and predictors of documentation. RESULTS: LST templates were documented for 108,145 veterans, and 85% had one or more of the non-required fields completed in addition to the required fields. Approximately half documented a preference for cardiopulmonary resuscitation. Among those who documented specific goals, half wanted to improve or maintain function, independence, and quality of life while 28% had a goal of life prolongation irrespective of risk of hospitalization/death and 45% expressed a goal of comfort. Only 7% expressed a goal of being cured. Predictors of documentation included VA nursing home residence, older age, frailty, and comorbidity, while non-Caucasian race, rural residence, and receipt of care in a lower complexity medical center were predictive of no documentation. CONCLUSIONS: LST decisions were documented for veterans at high risk of hospitalization or death. While few expressed a preference for cure, half desire, cardiopulmonary resuscitation. Predictors of documentation were generally consistent with existing literature. Opportunities to reduce observed disparities exist by leveraging available VA resources and programs.

Designing clinical practice feedback reports: three steps illustrated in Veterans Health Affairs long-term care facilities and programs.

BACKGROUND: User-centered design (UCD) methods are well-established techniques for creating useful artifacts, but few studies illustrate their application to clinical feedback reports. When used as an implementation strategy, the content of feedback reports depends on a foundational audit process involving performance measures and data, but these important relationships have not been adequately described. Better guidance on UCD methods for designing feedback reports is needed. Our objective is to describe the feedback report design method for refining the content of prototype reports. METHODS: We propose a three-step feedback report design method (refinement of measures, data, and display). The three steps follow dependencies such that refinement of measures can require changes to data, which in turn may require changes to the display. We believe this method can be used effectively with a broad range of UCD techniques. RESULTS: We illustrate the three-step method as used in implementation of goals of care conversations in long-term care settings in the U.S. Veterans Health Administration. Using iterative usability testing, feedback report content evolved over cycles of the three steps. Following the steps in the proposed method through 12 iterations with 13 participants, we improved the usability of the feedback reports. CONCLUSIONS: UCD methods can improve feedback report content through an iterative process. When designing feedback reports, refining measures, data, and display may enable report designers to improve the user centeredness of feedback reports.

Hospice Care of Veterans in Medicare Advantage and Traditional Medicare: A Risk-Adjusted Analysis.

OBJECTIVES: To compare the quality of end-of-life care in Medicare Advantage (MA) and traditional Medicare (TM), specifically, receipt and length of hospice care. DESIGN: Retrospective analysis of administrative data. SETTING: Hospice care. PARTICIPANTS: Veterans dually enrolled in the Veterans Health Administration (VHA) and MA or TM who died between 2008 and 2013 (N = 1,515,441). MEASUREMENTS: Outcomes studied included use and duration of hospice care. Use of a VHA-enrolled population allowed for risk adjustment that is otherwise challenging when studying MA. RESULTS: Adjusted analyses revealed that MA beneficiaries were more likely to receive hospice than TM beneficiaries; results corroborate published non-risk-adjusted analyses. MA beneficiaries had shorter hospice duration; this is an opposite direction of effect than non-risk-adjusted analyses. Results were robust to multiple sensitivity analyses limiting the cohort to individuals in MA and TM who had equal opportunity for their comorbidities to be captured. Removing risk adjustment resulted in results that mirrored those in the existing published literature. CONCLUSION: Our work provides two important insights regarding MA that are important to consider as enrollment in this insurance mechanism grows. First, MA beneficiaries received poorer-quality end-of-life care than TM beneficiaries, as ascertained by exposure to hospice. Second, any comparisons made between MA and TM require proper risk adjustment to obtain correct directions of effect. We encourage the Centers for Medicare & Medicaid Services to make comorbidity data specific to MA enrollees available to researchers for these purposes.

Increasing Veterans' Hospice Use: The Veterans Health Administration's Focus On Improving End-Of-Life Care.

In 2009 the Department of Veterans Affairs (VA) began a major, four-year investment in improving the quality of end-of-life care. The Comprehensive End of Life Care Initiative increased the numbers of VA medical center inpatient hospice units and palliative care staff members as well as the amount of palliative care training, quality monitoring, and community outreach. We divided male veterans ages sixty-six and older into categories based on their use of the VA and Medicare and examined whether the increases in their rates of hospice use in the last year of life differed from the concurrent increase among similar nonveterans enrolled in Medicare. After adjusting for age, race and ethnicity, diagnoses, nursing home use in the last year of life, census region, and urbanicity of a person's last residence, we found a 6.9-7.9-percentage-point increase in hospice use over time for the veteran categories, compared to a 5.6-percentage-point increase for nonveterans (the relative increases were 20-42 percent and 16 percent, respectively). The VA's substantial investment in palliative care appears to have resulted in greater hospice use by older male veterans enrolled in the VA, a critical step forward in caring for veterans with serious illnesses.

Iraq and Afghanistan Veterans' Use of Veterans Health Administration and Purchased Care Before and After Veterans Choice Program Implementation.

BACKGROUND: The Veterans Choice Program (VCP), enacted by Congress after concerns surfaced about access, enables veterans to receive care outside Veterans Health Administration (VHA) facilities. Veterans who face long wait times, large driving distances, or particular hardships are eligible for VCP. Prior purchased care programs were comparatively limited in scope. OBJECTIVES: We sought to describe utilization of VHA-provided and purchased outpatient care by veterans eligible for VCP before and after VCP implementation. We focused on veterans recently eligible for VHA as they are of particular policy relevance and might have less established care patterns. RESEARCH DESIGN: We identified all Iraq and Afghanistan veterans who were eligible for VCP in 2015. We tabulated their use of VHA and purchased outpatient care for 3 years before (FY2012-2014) and 1 year after VCP implementation (FY2015). SUBJECTS: Our study population consisted of 214,449 Iraq and Afghanistan veterans who were eligible for VCP due to wait-time, distance, or hardship issues. RESULTS: In the first year of the program, 3821 (2%) of these Iraq and Afghanistan veterans used non-VHA services through VCP. Per capita VHA utilization tended to decline slightly after VCP implementation, but these changes varied by type of outpatient care. CONCLUSIONS: There was low uptake of VCP services in the first year of the program. Data from additional years are needed to better understand the impact of this policy.

School Closure Decisions Made by Local Health Department Officials During the 2009 H1N1 Influenza Outbreak.

OBJECTIVES: The goal of this study was to gain insights into the decision-making processes used by California public health officials during real-time crises. The decision-making processes used by California public health officials during the 2009 H1N1 influenza pandemic were examined by a survey research team from the University of California Berkeley. METHODS: The survey was administered to local public health officials in California. Guidelines published by the Centers for Disease Control and Prevention had recommended school closure, and local public health officials had to decide whether to follow these recommendations. Chi-squared tests were used to make comparisons in the descriptive statistics. RESULTS: The response rate from local public health departments was 79%. A total of 73% of respondents were involved in the decision-making process. Respondents stated whether they used or did not use 15 ethical, logistical, and political preselected criteria. They expressed interest in receiving checklists and additional training in decision-making. CONCLUSIONS: Public health decision-makers do not appear to have a standard process for crisis decision-making and would benefit from having an organized decision-making model. The survey showed that ethical, logistical, and political criteria were considered but were not prioritized in any meaningful way. A new decision-making tool kit for public health decision-makers plus implementation training is warranted.