Characteristics and Health Care Use of Patients Attending Virtual Walk-in Clinics in Ontario, Canada: Cross-sectional Analysis.

BACKGROUND: Funding changes in response to the COVID-19 pandemic supported the growth of direct-to-consumer virtual walk-in clinics in several countries. Little is known about patients who attend virtual walk-in clinics or how these clinics contribute to care continuity and subsequent health care use. OBJECTIVE: The objective of the present study was to describe the characteristics and measure the health care use of patients who attended virtual walk-in clinics compared to the general population and a subset that received any virtual family physician visit. METHODS: This was a retrospective, cross-sectional study in Ontario, Canada. Patients who had received a family physician visit at 1 of 13 selected virtual walk-in clinics from April 1 to December 31, 2020, were compared to Ontario residents who had any virtual family physician visit. The main outcome was postvisit health care use. RESULTS: Virtual walk-in patients (n=132,168) had fewer comorbidities and lower previous health care use than Ontarians with any virtual family physician visit. Virtual walk-in patients were also less likely to have a subsequent in-person visit with the same physician (309/132,168, 0.2% vs 704,759/6,412,304, 11%; standardized mean difference [SMD] 0.48), more likely to have a subsequent virtual visit (40,030/132,168, 30.3% vs 1,403,778/6,412,304, 21.9%; SMD 0.19), and twice as likely to have an emergency department visit within 30 days (11,003/132,168, 8.3% vs 262,509/6,412,304, 4.1%; SMD 0.18), an effect that persisted after adjustment and across urban/rural resident groups. CONCLUSIONS: Compared to Ontarians attending any family physician virtual visit, virtual walk-in patients were less likely to have a subsequent in-person physician visit and were more likely to visit the emergency department. These findings will inform policy makers aiming to ensure the integration of virtual visits with longitudinal primary care.

Characteristics and Health Care Use of Patients Attending Virtual Walk-in Clinics in Ontario, Canada: Cross-sectional Analysis.

BACKGROUND: Funding changes in response to the COVID-19 pandemic supported the growth of direct-to-consumer virtual walk-in clinics in several countries. Little is known about patients who attend virtual walk-in clinics or how these clinics contribute to care continuity and subsequent health care use. OBJECTIVE: The objective of the present study was to describe the characteristics and measure the health care use of patients who attended virtual walk-in clinics compared to the general population and a subset that received any virtual family physician visit. METHODS: This was a retrospective, cross-sectional study in Ontario, Canada. Patients who had received a family physician visit at 1 of 13 selected virtual walk-in clinics from April 1 to December 31, 2020, were compared to Ontario residents who had any virtual family physician visit. The main outcome was postvisit health care use. RESULTS: Virtual walk-in patients (n=132,168) had fewer comorbidities and lower previous health care use than Ontarians with any virtual family physician visit. Virtual walk-in patients were also less likely to have a subsequent in-person visit with the same physician (309/132,168, 0.2% vs 704,759/6,412,304, 11%; standardized mean difference [SMD] 0.48), more likely to have a subsequent virtual visit (40,030/132,168, 30.3% vs 1,403,778/6,412,304, 21.9%; SMD 0.19), and twice as likely to have an emergency department visit within 30 days (11,003/132,168, 8.3% vs 262,509/6,412,304, 4.1%; SMD 0.18), an effect that persisted after adjustment and across urban/rural resident groups. CONCLUSIONS: Compared to Ontarians attending any family physician virtual visit, virtual walk-in patients were less likely to have a subsequent in-person physician visit and were more likely to visit the emergency department. These findings will inform policy makers aiming to ensure the integration of virtual visits with longitudinal primary care.

Implementation and Evaluation of COVIDCare@Home, a Family Medicine-Led Remote Monitoring Program for Patients With COVID-19: Multimethod Cross-sectional Study.

BACKGROUND: COVIDCare@Home (CC@H) is a multifaceted, interprofessional team-based remote monitoring program led by family medicine for patients diagnosed with COVID-19, based at Women's College Hospital (WCH), an ambulatory academic center in Toronto, Canada. CC@H offers virtual visits (phone and video) to address the clinical needs and broader social determinants of the health of patients during the acute phase of COVID-19 infection, including finding a primary care provider (PCP) and support for food insecurity. OBJECTIVE: The objective of this evaluation is to understand the implementation and quality outcomes of CC@H within the Quadruple Aim framework of patient experience, provider experience, cost, and population health. METHODS: This multimethod cross-sectional evaluation follows the Quadruple Aim framework to focus on implementation and service quality outcomes, including feasibility, adoption, safety, effectiveness, equity, and patient centeredness. These measures were explored using clinical and service utilization data, patient experience data (an online survey and a postdischarge questionnaire), provider experience data (surveys, interviews, and focus groups), and stakeholder interviews. Descriptive analysis was conducted for surveys and utilization data. Deductive analysis was conducted for interviews and focus groups, mapping to implementation and quality domains. The Ontario Marginalization Index (ON-Marg) measured the proportion of underserved patients accessing CC@H. RESULTS: In total, 3412 visits were conducted in the first 8 months of the program (April 8-December 8, 2020) for 616 discrete patients, including 2114 (62.0%) visits with family physician staff/residents and 149 (4.4%) visits with social workers/mental health professionals. There was a median of 5 (IQR 4) visits per patient, with a median follow-up of 7 days (IQR 27). The net promoter score was 77. In addition, 144 (23.3%) of the patients were in the most marginalized populations based on the residential postal code (as per ON-Marg). Interviews with providers and stakeholders indicated that the program continued to adapt to meet the needs of patients and the health care system. CONCLUSIONS: Future remote monitoring should integrate support for addressing the social determinants of health and ensure patient-centered care through comprehensive care teams.

Implementation and Evaluation of COVIDCare@Home, a Family Medicine-Led Remote Monitoring Program for Patients With COVID-19: Multimethod Cross-sectional Study.

BACKGROUND: COVIDCare@Home (CC@H) is a multifaceted, interprofessional team-based remote monitoring program led by family medicine for patients diagnosed with COVID-19, based at Women's College Hospital (WCH), an ambulatory academic center in Toronto, Canada. CC@H offers virtual visits (phone and video) to address the clinical needs and broader social determinants of the health of patients during the acute phase of COVID-19 infection, including finding a primary care provider (PCP) and support for food insecurity. OBJECTIVE: The objective of this evaluation is to understand the implementation and quality outcomes of CC@H within the Quadruple Aim framework of patient experience, provider experience, cost, and population health. METHODS: This multimethod cross-sectional evaluation follows the Quadruple Aim framework to focus on implementation and service quality outcomes, including feasibility, adoption, safety, effectiveness, equity, and patient centeredness. These measures were explored using clinical and service utilization data, patient experience data (an online survey and a postdischarge questionnaire), provider experience data (surveys, interviews, and focus groups), and stakeholder interviews. Descriptive analysis was conducted for surveys and utilization data. Deductive analysis was conducted for interviews and focus groups, mapping to implementation and quality domains. The Ontario Marginalization Index (ON-Marg) measured the proportion of underserved patients accessing CC@H. RESULTS: In total, 3412 visits were conducted in the first 8 months of the program (April 8-December 8, 2020) for 616 discrete patients, including 2114 (62.0%) visits with family physician staff/residents and 149 (4.4%) visits with social workers/mental health professionals. There was a median of 5 (IQR 4) visits per patient, with a median follow-up of 7 days (IQR 27). The net promoter score was 77. In addition, 144 (23.3%) of the patients were in the most marginalized populations based on the residential postal code (as per ON-Marg). Interviews with providers and stakeholders indicated that the program continued to adapt to meet the needs of patients and the health care system. CONCLUSIONS: Future remote monitoring should integrate support for addressing the social determinants of health and ensure patient-centered care through comprehensive care teams.

Virtual care use during the COVID-19 pandemic and its impact on healthcare utilization in patients with chronic disease: A population-based repeated cross-sectional study.

PURPOSE: It is currently unclear how the shift towards virtual care during the 2019 novel coronavirus (COVID-19) pandemic may have impacted chronic disease management at a population level. The goals of our study were to provide a description of the levels of use of virtual care services relative to in-person care in patients with chronic disease across Ontario, Canada and to describe levels of healthcare utilization in low versus high virtual care users. METHODS: We used linked health administrative data to conduct a population-based, repeated cross-sectional study of all ambulatory patient visits in Ontario, Canada (January 1, 2018 to January 16, 2021). Further stratifications were also completed to examine patients with COPD, heart failure, asthma, hypertension, diabetes, mental illness, and angina. Patients were classified as low (max 1 virtual care visit) vs. high virtual care users. A time-series analysis was done using interventional autoregressive integrated moving average (ARIMA) modelling on weekly hospitalizations, outpatient visits, and diagnostic tests. RESULTS: The use of virtual care increased across all chronic disease patient populations. Virtual care constituted at least half of the total care in all conditions. Both low and high virtual care user groups experienced a statistically significant reduction in hospitalizations and laboratory testing at the start of the pandemic. Hospitalization volumes increased again only among the high users, while testing increased in both groups. Outpatient visits among high users remained unaffected by the pandemic but dropped in low users. CONCLUSION: The decrease of in-person care during the pandemic was accompanied by an increase in virtual care, which ultimately allowed patients with chronic disease to return to the same visit rate as they had before the onset of the pandemic. Virtual care was adopted across various chronic conditions, but the relative adoption of virtual care varied by condition with highest rates seen in mental health.

Outpatient visit trends for internal medicine ambulatory care sensitive conditions after the COVID-19 pandemic: a time-series analysis.

BACKGROUND: The COVID-19 pandemic led to a dramatic shift in the delivery of outpatient medicine with reduced in-person visits and a transition to predominantly virtual visits. We sought to understand trends in visit patterns for ambulatory care sensitive conditions (ACSCs) commonly seen in internal medicine clinics. METHODS: We included adult outpatients seen for an ACSC between March 15th, 2017 and March 14th, 2021 at a single-centre in Ontario, Canada. Monthly visits were assessed by visit type (new consultation, follow-up), diagnosis, and clinic. Time series analyses compared visit volumes pre- and post-pandemic. Proportion of virtual visits were compared before and during the pandemic. Patient and visit factors were compared between in-person and virtual visits. RESULTS: 8274 patients with 34,021 visits were included. Monthly visits increased by 15% during the pandemic (p <  0.0001). New consultations decreased by 10% (p = 0.0053) but follow-up visits increased by 21% (p <  0.0001). Monthly heart failure visits increased by 43% (p <  0.0001) whereas atrial fibrillation visits decreased. Pre- pandemic, < 1% of visits were virtual compared to 82% during the pandemic (p <  0.0001). Less than half of heart failure visits were virtual whereas > 95% of diabetes visits were virtual. CONCLUSIONS: We found a significant increase in overall visits to internal medicine clinics driven by increased volumes of follow-up visits, which more than offset decreased new consultations. There was variability in visit trends and uptake of virtual care by visit diagnosis, which may indicate challenges with delivery of virtual care for certain conditions.

Identifying optimal frameworks to implement or evaluate digital health interventions: a scoping review protocol.

INTRODUCTION: Digital health interventions (DHIs) are defined as health services delivered electronically through formal or informal care. DHIs can range from electronic medical records used by providers to mobile health apps used by consumers. DHIs involve complex interactions between user, technology and the healthcare team, posing challenges for implementation and evaluation. Theoretical or interpretive frameworks are crucial in providing researchers guidance and clarity on implementation or evaluation approaches; however, there is a lack of standardisation on which frameworks to use in which contexts. Our goal is to conduct a scoping review to identify frameworks to guide the implementation or evaluation of DHIs. METHODS AND ANALYSIS: A scoping review will be conducted using methods outlined by the Joanna Briggs Institute reviewers' manual and will conform to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. Studies will be included if they report on frameworks (ie, theoretical, interpretive, developmental) that are used to guide either implementation or evaluation of DHIs. Electronic databases, including MEDLINE, EMBASE, CINAHL and PsychINFO will be searched in addition to grey literature and reference lists of included studies. Citations and full text articles will be screened independently in Covidence after a reliability check among reviewers. We will use qualitative description to summarise findings and focus on how research objectives and type of DHIs are aligned with the frameworks used. ETHICS AND DISSEMINATION: We engaged an advisory panel of digital health knowledge users to provide input at strategic stages of the scoping review to enhance the relevance of findings and inform dissemination activities. Specifically, they will provide feedback on the eligibility criteria, data abstraction elements, interpretation of findings and assist in developing key messages for dissemination. This study does not require ethical review. Findings from review will support decision making when selecting appropriate frameworks to guide the implementation or evaluation of DHIs.

Virtual care use before and during the COVID-19 pandemic: a repeated cross-sectional study.

BACKGROUND: The coronavirus disease 2019 (COVID-19) pandemic is thought to have increased use of virtual care, but population-based studies are lacking. We aimed to assess the uptake of virtual care during the COVID-19 pandemic using comprehensive population-based data from Ontario. METHODS: This was a repeated cross-sectional study design. We used administrative data to evaluate changes in in-person and virtual visits among all residents of Ontario before (2012-2019) and during (January-August 2020) the COVID-19 pandemic. We included all patients who had an ambulatory care visit in Ontario. We excluded claims for patients who were not Ontario residents or had an invalid or missing health card number. We compared monthly or quarterly virtual care use across age groups, neighbourhood income quintiles and chronic disease subgroups. We also examined physician characteristics that may have been associated with virtual care use. RESULTS: Among all residents of Ontario (population 14.6 million), virtual care increased from 1.6% of total ambulatory visits in the second quarter of 2019 to 70.6% in the second quarter of 2020. The proportion of physicians who provided 1 or more virtual visits per year increased from 7.0% in the second quarter of 2019 to 85.9% in the second quarter of 2020. The proportion of Ontarians who had a virtual visit increased from 1.3% in 2019 to 29.2% in 2020. Older patients were the highest users of virtual care. The proportion of total virtual visits that were provided to patients residing in rural areas (v. urban areas) declined significantly between 2012 and 2020, reflecting a shift in virtual care to a service increasingly used in urban centres. The rates of virtual care use increased similarly across all conditions and across all income quintiles. INTERPRETATION: Our findings show that Ontario's approach to virtual care led to broad adoption across all provider groups, patient age, types of chronic diseases and neighborhood income. These findings have policy implications, including use of virtual care billing codes, for the ongoing use of virtual care during the second wave of the pandemic and beyond.

Building Health Services in a Rapidly Changing Landscape: Lessons in Adaptive Leadership and Pivots in a COVID-19 Remote Monitoring Program.

Adaptive leadership has become an essential skill for leaders in health systems to respond to the COVID-19 pandemic as new knowledge emerges and case counts rise, fall, and rise again. This leadership approach has been described as an iterative process of taking a wide view of the situation, interpreting the meaning of incoming data from multiple directions, and taking real-time action. This process is also common in start-ups, which attempt to create new products or services of uncertain value for consumer markets that may not yet exist. Start-ups manage uncertainty through "pivots," which can include changes in the target group, need, features, or intended benefit of a product or service. Pivots are large changes that account for the high likelihood of getting something wrong during development, and they are distinct from the "tweaks" or small tests of change that define quality improvement methodology. This case study describes three pivots in the launch of a remote monitoring program for COVID-19. Adaptive leadership helped inform strategic decisions, with pivots providing a framework for internal and external stakeholders to articulate options for changes to address shifting needs. There is considerable uncertainty in the appropriate design and implementation of health services, and although this case example focuses on the use of adaptive leadership and pivots during a pandemic, these strategies are relevant for health care leaders at any time.