Development of a Common Data Model for a Multisite and Multiyear Study of Virtual Visit Implementation: A Case Study.

BACKGROUND/OBJECTIVE: In multisite studies, a common data model (CDM) standardizes dataset organization, variable definitions, and variable code structures and can support distributed data processing. We describe the development of a CDM for a study of virtual visit implementation in 3 Kaiser Permanente (KP) regions. METHODS: We conducted several scoping reviews to inform our study's CDM design: (1) virtual visit mode, implementation timing, and scope (targeted clinical conditions and departments); and (2) extant sources of electronic health record data to specify study measures. Our study covered the period from 2017 through June 2021. Integrity of the CDM was assessed by a chart review of random samples of virtual and in-person visits, overall and by specific conditions of interest (neck or back pain, urinary tract infection, major depression). RESULTS: The scoping reviews identified a need to address differences in virtual visit programs across the 3 KP regionsto harmonize measurement specifications for our research analyses. The final CDM contained patient-level, provider-level, and system-level measures on 7,476,604 person-years for KP members aged 19 years and above. Utilization included 2,966,112 virtual visits (synchronous chats, telephone visits, video visits) and 10,004,195 in-person visits. Chart review indicated the CDM correctly identified visit mode on>96% (n=444) of visits, and presenting diagnosis on >91% (n=482) of visits. CONCLUSIONS: Upfront design and implementation of CDMs may be resource intensive. Once implemented, CDMs, like the one we developed for our study, provide downstream programming and analytic efficiencies by harmonizing, in a consistent framework, otherwise idiosyncratic temporal and study site differences in source data.

Differences in COVID-19 testing and adverse outcomes by race, ethnicity, sex, and health system setting in a large diverse US cohort.

BACKGROUND: Racial/ethnic disparities during the first six months of the COVID-19 pandemic led to differences in COVID-19 testing and adverse outcomes. We examine differences in testing and adverse outcomes by race/ethnicity and sex across a geographically diverse and system-based COVID-19 cohort collaboration. METHODS: Observational study among adults (≥18 years) within six US cohorts from March 1, 2020 to August 31, 2020 using data from electronic health record and patient reporting. Race/ethnicity and sex as risk factors were primary exposures, with health system type (integrated health system, academic health system, or interval cohort) as secondary. Proportions measured SARS-CoV-2 testing and positivity; attributed hospitalization and death related to COVID-19. Relative risk ratios (RR) with 95% confidence intervals quantified associations between exposures and main outcomes. RESULTS: 5,958,908 patients were included. Hispanic patients had the highest proportions of SARS-CoV-2 testing (16%) and positivity (18%), while Asian/Pacific Islander patients had the lowest portions tested (11%) and White patients had the lowest positivity rates (5%). Men had a lower likelihood of testing (RR = 0.90 [0.89-0.90]) and a higher positivity risk (RR = 1.16 [1.14-1.18]) compared to women. Black patients were more likely to have COVID-19-related hospitalizations (RR = 1.36 [1.28-1.44]) and death (RR = 1.17 [1.03-1.32]) compared with White patients. Men were more likely to be hospitalized (RR = 1.30 [1.16-1.22]) or die (RR = 1.70 [1.53-1.89]) compared to women. These racial/ethnic and sex differences were reflected in both health system types. CONCLUSIONS: This study supports evidence of disparities by race/ethnicity and sex during the COVID-19 pandemic that persisted even in healthcare settings with reduced barriers to accessing care. Further research is needed to understand and prevent the drivers that resulted in higher burdens of morbidity among certain Black patients and men.

Post-acute sequelae of SARS-CoV-2 with clinical condition definitions and comparison in a matched cohort.

Disease characterization of Post-Acute Sequelae of SARS-CoV-2 (PASC) does not account for pre-existing conditions and time course of incidence. We utilized longitudinal data and matching to a COVID PCR-negative population to discriminate PASC conditions over time within our patient population during 2020. Clinical Classification Software was used to identify PASC condition groupings. Conditions were specified acute and persistent (occurring 0-30 days post COVID PCR and persisted 30-120 days post-test) or late (occurring initially 30-120 days post-test). We matched 3:1 COVID PCR-negative COVIDPCR-positive by age, sex, testing month and service area, controlling for pre-existing conditions up to four years prior; 28,118 PCR-positive to 70,293 PCR-negative patients resulted. We estimated PASC risk from the matched cohort. Risk of any PASC condition was 12% greater for PCR-positive patients in the late period with a significantly higher risk of anosmia, cardiac dysrhythmia, diabetes, genitourinary disorders, malaise, and nonspecific chest pain. Our findings contribute to a more refined PASC definition which can enhance clinical care.

Analysis of Postvaccination Breakthrough COVID-19 Infections Among Adults With HIV in the United States.

Importance: Recommendations for additional doses of COVID-19 vaccines for people with HIV (PWH) are restricted to those with advanced disease or unsuppressed HIV viral load. Understanding SARS-CoV-2 infection risk after vaccination among PWH is essential for informing vaccination guidelines. Objective: To estimate the rate and risk of breakthrough infections among fully vaccinated PWH and people without HIV (PWoH) in the United States. Design, Setting, and Participants: This cohort study used the Corona-Infectious-Virus Epidemiology Team (CIVET)-II (of the North American AIDS Cohort Collaboration on Research and Design [NA-ACCORD], which is part of the International Epidemiology Databases to Evaluate AIDS [IeDEA]), collaboration of 4 prospective, electronic health record-based cohorts from integrated health systems and academic health centers. Adult PWH who were fully vaccinated prior to June 30, 2021, were matched with PWoH on date of full vaccination, age, race and ethnicity, and sex and followed up through December 31, 2021. Exposures: HIV infection. Main Outcomes and Measures: COVID-19 breakthrough infections, defined as laboratory evidence of SARS-CoV-2 infection or COVID-19 diagnosis after a patient was fully vaccinated. Results: Among 113 994 patients (33 029 PWH and 80 965 PWoH), most were 55 years or older (80 017 [70%]) and male (104 967 [92%]); 47 098 (41%) were non-Hispanic Black, and 43 218 (38%) were non-Hispanic White. The rate of breakthrough infections was higher in PWH vs PWoH (55 [95% CI, 52-58] cases per 1000 person-years vs 43 [95% CI, 42-45] cases per 1000 person-years). Cumulative incidence of breakthroughs 9 months after full vaccination was low (3.8% [95% CI, 3.7%-3.9%]), albeit higher in PWH vs PWoH (4.4% vs 3.5%; log-rank P < .001; risk difference, 0.9% [95% CI, 0.6%-1.2%]) and within each vaccine type. Breakthrough infection risk was 28% higher in PWH vs PWoH (adjusted hazard ratio, 1.28 [95% CI, 1.19-1.37]). Among PWH, younger age (<45 y vs 45-54 y), history of COVID-19, and not receiving an additional dose (aHR, 0.71 [95% CI, 0.58-0.88]) were associated with increased risk of breakthrough infections. There was no association of breakthrough with HIV viral load suppression, but high CD4 count (ie, ≥500 cells/mm3) was associated with fewer breakthroughs among PWH. Conclusions and Relevance: In this study, COVID-19 vaccination, especially with an additional dose, was effective against infection with SARS-CoV-2 strains circulating through December 31, 2021. PWH had an increased risk of breakthrough infections compared with PWoH. Expansion of recommendations for additional vaccine doses to all PWH should be considered.

COVID-19 infections post-vaccination by HIV status in the United States.

IMPORTANCE: Recommendations for additional doses of COVID vaccine are restricted to people with HIV who have advanced disease or unsuppressed HIV viral load. Understanding SARS-CoV-2 infection risk post-vaccination among PWH is essential for informing vaccination guidelines. OBJECTIVE: Estimate the risk of breakthrough infections among fully vaccinated people with (PWH) and without (PWoH) HIV in the US. DESIGN SETTING AND PARTICIPANTS: The Corona-Infectious-Virus Epidemiology Team (CIVET)-II cohort collaboration consists of 4 longitudinal cohorts from integrated health systems and academic health centers. Each cohort identified individuals ≥18 years old, in-care, and fully vaccinated for COVID-19 through 30 June 2021. PWH were matched to PWoH on date fully vaccinated, age group, race/ethnicity, and sex at birth. Incidence rates per 1,000 person-years and cumulative incidence of breakthrough infections with 95% confidence intervals ([,]) were estimated by HIV status. Cox proportional hazards models estimated adjusted hazard ratios (aHR) of breakthrough infections by HIV status adjusting for demographic factors, prior COVID-19 illness, vaccine type (BNT162b2, [Pfizer], mRNA-1273 [Moderna], Jansen Ad26.COV2.S [J&J]), calendar time, and cohort. Risk factors for breakthroughs among PWH, were also investigated. EXPOSURE: HIV infection. OUTCOME: COVID-19 breakthrough infections, defined as laboratory evidence of SARS-CoV-2 infection or COVID-19 diagnosis after an individual was fully vaccinated. RESULTS: Among 109,599 individuals (31,840 PWH and 77,759 PWoH), the rate of breakthrough infections was higher in PWH versus PWoH: 44 [41, 48] vs. 31 [29, 33] per 1,000 person-years. Cumulative incidence at 210 days after date fully vaccinated was low, albeit higher in PWH versus PWoH overall (2.8% versus 2.1%, log-rank p<0.001, risk difference=0.7% [0.4%, 1.0%]) and within each vaccine type. Breakthrough infection risk was 41% higher in PWH versus PWoH (aHR=1.41 [1.28, 1.56]). Among PWH, younger age (18-24 versus 45-54), history of COVID-19 prior to fully vaccinated date, and J&J vaccination (versus Pfizer) were associated with increased risk of breakthroughs. There was no association of breakthrough with HIV viral load suppression or CD4 count among PWH. CONCLUSIONS AND RELEVANCE: COVID-19 vaccination is effective against infection with SARS-CoV-2 strains circulating through 30 Sept 2021. PWH have an increased risk of breakthrough infections compared to PWoH. Recommendations for additional vaccine doses should be expanded to all PWH.

Development and Validation of a Healthcare Utilization-Based Algorithm to Identify Acute Exacerbations of Chronic Obstructive Pulmonary Disease.

Introduction: Acute exacerbations of chronic obstructive pulmonary disease (AECOPD) are important events that may precipitate other adverse outcomes. Accurate AECOPD event identification in electronic administrative data is essential for improving population health surveillance and practice management. Objective: Develop codified algorithms to identify moderate and severe AECOPD in two US healthcare systems using administrative data and electronic medical records, and validate their performance by calculating positive predictive value (PPV) and negative predictive value (NPV). Methods: Data from two large regional integrated health systems were used. Eligible patients were identified using International Classification of Diseases (Ninth Edition) COPD diagnosis codes. Two algorithms were developed: one to identify potential moderate AECOPD by selecting outpatient/emergency visits associated with AECOPD-related codes and antibiotic/systemic steroid prescriptions; the other to identify potential severe AECOPD by selecting inpatient visits associated with corresponding codes. Algorithms were validated via patient chart review, adjudicated by a pulmonologist. To estimate PPV, 300 potential moderate AECOPD and 250 potential severe AECOPD events underwent review. To estimate NPV, 200 patients without any AECOPD identified by the algorithms (100 patients each without moderate or severe AECOPD) during the two years following the index date underwent review to identify AECOPD missed by the algorithm (false negatives). Results: The PPVs (95% confidence interval [CI]) for both moderate and severe AECOPD were high: 293/298 (98.3% [96.1-99.5]) and 216/225 (96.0% [92.5-98.2]), respectively. NPV was lower for moderate AECOPD (75.0% [65.3-83.1]) than for severe AECOPD (95.0% [88.7-98.4]). Results were consistent across both healthcare systems. Conclusion: This study developed healthcare utilization-based algorithms to identify moderate and severe AECOPD in two separate healthcare systems. PPV for both algorithms was high; NPV was lower for the moderate algorithm. Replication and consistency of results across two healthcare systems support the external validity of these findings.

Rate of sepsis hospitalizations after misdiagnosis in adult emergency department patients: a look-forward analysis with administrative claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology in an integrated health system.

OBJECTIVES: Delays in sepsis diagnosis can increase morbidity and mortality. Previously, we performed a Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) "look-back" analysis to identify symptoms at risk for delayed sepsis diagnosis. We found treat-and-release emergency department (ED) encounters for fluid and electrolyte disorders (FED) and altered mental status (AMS) were associated with downstream sepsis hospitalizations. In this "look-forward" analysis, we measure the potential misdiagnosis-related harm rate for sepsis among patients with these symptoms. METHODS: Retrospective cohort study using electronic health record and claims data from Kaiser Permanente Mid-Atlantic States (2013-2018). Patients ≥18 years with ≥1 treat-and-release ED encounter for FED or AMS were included. Observed greater than expected sepsis hospitalizations within 30 days of ED treat-and-release encounters were considered potential misdiagnosis-related harms. Temporal analyses were employed to differentiate case and comparison (superficial injury/contusion ED encounters) cohorts. RESULTS: There were 4,549 treat-and-release ED encounters for FED or AMS, 26 associated with a sepsis hospitalization in the next 30 days. The observed (0.57%) minus expected (0.13%) harm rate was 0.44% (absolute) and 4.5-fold increased over expected (relative). There was a spike in sepsis hospitalizations in the week following FED/AMS ED visits. There were fewer sepsis hospitalizations and no spike in admissions in the week following superficial injury/contusion ED visits. Potentially misdiagnosed patients were older and more medically complex. CONCLUSIONS: Potential misdiagnosis-related harms from sepsis are infrequent but measurable using SPADE. This look-forward analysis validated our previous look-back study, demonstrating the SPADE approach can be used to study infectious disease syndromes.

Antecedent treat-and-release diagnoses prior to sepsis hospitalization among adult emergency department patients: a look-back analysis employing insurance claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology.

OBJECTIVES: The aim of this study was to identify delays in early pre-sepsis diagnosis in emergency departments (ED) using the Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) approach. METHODS: SPADE methodology was employed using electronic health record and claims data from Kaiser Permanente Mid-Atlantic States (KPMAS). Study cohort included KPMAS members ≥18 years with ≥1 sepsis hospitalization 1/1/2013-12/31/2018. A look-back analysis identified treat-and-release ED visits in the month prior to sepsis hospitalizations. Top 20 diagnoses associated with these ED visits were identified; two diagnosis categories were distinguished as being linked to downstream sepsis hospitalizations. Observed-to-expected (O:E) and temporal analyses were performed to validate the symptom selection; results were contrasted to a comparison group. Demographics of patients that did and did not experience sepsis misdiagnosis were compared. RESULTS: There were 3,468 sepsis hospitalizations during the study period and 766 treat-and-release ED visits in the month prior to hospitalization. Patients discharged from the ED with fluid and electrolyte disorders (FED) and altered mental status (AMS) were most likely to have downstream sepsis hospitalizations (O:E ratios of 2.66 and 2.82, respectively). Temporal analyses revealed that these symptoms were overrepresented and temporally clustered close to the hospitalization date. Approximately 2% of sepsis hospitalizations were associated with prior FED or AMS ED visits. CONCLUSIONS: Treat-and-release ED encounters for FED and AMS may represent harbingers for downstream sepsis hospitalizations. The SPADE approach can be used to develop performance measures that identify pre-sepsis.

Beyond the HIV Care Continuum and Viral Suppression: Broadening the Scope of Quality Metrics for Total HIV Patient Care.

Assessing quality care for people with HIV (PWH) should not be limited to reporting on HIV Care Continuum benchmarks, particularly viral suppression rates. At Kaiser Permanente Mid-Atlantic States (KPMAS), an integrated health system providing HIV care in the District of Columbia, Maryland, and Virginia, we created a comprehensive measure of HIV quality care, including both preventative measures and clinical outcomes. We included PWH ≥18 years old with ≥6 months KPMAS membership between 2015 and 2018. Process quality metrics (QMs) include: pneumococcal vaccination and influenza vaccination; primary care physician (PCP) and/or HIV/infectious disease (HIV/ID) visits with additional HIV/ID visit; antiretroviral treatment medication fills; and syphilis and gonorrhea/chlamydia screenings. Outcome QMs include HIV RNA <200/mL and other measurements within normal range [blood pressure, body mass index (BMI), hemoglobin, blood sugar, alanine transaminase, low-density lipoproteins, estimated glomerular filtration rate]; no hospitalization/emergency department visit; no new depression diagnosis; remaining or becoming a nonsmoker. Logistic models estimated odds of achieving QMs associated with sex, age, race/ethnicity, insurance type, and HIV risk. A total of 4996 observations were analyzed. 45.6% met all process QMs, while 19.6% met all outcome QMs. Least frequently met process QM was PCP or HIV/ID visit (74.5%); least met outcome QM was BMI (60.2%). Significantly lower odds of achieving all QMs among women {odds ratio (OR) = 0.63 [95% confidence interval (CI): 0.49-0.81]} and those with Medicaid and Medicare [vs. commercial; OR = 0.48 (95% CI: 0.30-0.76) and 0.47 (95% CI: 0.31-0.71)]. Broadening the scope of HIV patient care QMs beyond viral suppression helps identify opportunities for improvement. Successful process metrics do not necessarily coincide with greater outcome metrics.

Impact of Alternative Encounter Types on HIV Viral Suppression Rates in an Integrated Health System.

Kaiser Permanente Mid-Atlantic States (KPMAS) members are increasingly utilizing electronic encounter types, such as telephone appointments and secure messaging for healthcare purposes, although their impact on health outcomes is unknown. We evaluated whether use of alternative encounters by adult human immunodeficiency virus (HIV)-infected patients affected the likelihood of achieving viral suppression (VS). Our study population of 3114 patients contributed 6520 patient-years between 2014 and 2016. We compared VS (HIV RNA <200 copies/mL) by number of in-person visits (1 or ≥2), with further stratification for additional phone and/or e-mail encounters (none, phone only, e-mail only, and both phone and e-mail). Rate ratios (RRs) for VS by number of in-person visits and encounter types were obtained from Poisson modeling, adjusting for age, sex, race/ethnicity, and HIV risk. Compared to those with ≥2 visits, patients with one in-person visit alone were significantly less likely to achieve VS (RR = 0.93; 95% confidence interval, CI: [0.87-1.00]), as were those with one in-person visit plus a telephone encounter (0.93; [0.90-0.97]). We did not find significant differences in VS comparing patients with one in-person visit plus e-mail only (RR = 1.00; 95% CI: [0.97-1.02]) or plus e-mail and telephone (0.99; [0.97-1.01]) to those with ≥2 in-person visits. If supplemented by e-mail communications (with or without telephone contact), patients with one in-person visit per year had similar estimated rates of VS compared with ≥2 in-person visits. More research is needed to know if these findings apply to other care systems.