OpenSAFELY: A platform for analysing electronic health records designed for reproducible research.

Electronic health records (EHRs) and other administrative health data are increasingly used in research to generate evidence on the effectiveness, safety, and utilisation of medical products and services, and to inform public health guidance and policy. Reproducibility is a fundamental step for research credibility and promotes trust in evidence generated from EHRs. At present, ensuring research using EHRs is reproducible can be challenging for researchers. Research software platforms can provide technical solutions to enhance the reproducibility of research conducted using EHRs. In response to the COVID-19 pandemic, we developed the secure, transparent, analytic open-source software platform OpenSAFELY designed with reproducible research in mind. OpenSAFELY mitigates common barriers to reproducible research by: standardising key workflows around data preparation; removing barriers to code-sharing in secure analysis environments; enforcing public sharing of programming code and codelists; ensuring the same computational environment is used everywhere; integrating new and existing tools that encourage and enable the use of reproducible working practices; and providing an audit trail for all code that is run against the real data to increase transparency. This paper describes OpenSAFELY's reproducibility-by-design approach in detail.

Incidence and treatment of group A streptococcal infections during covid-19 pandemic and 2022 outbreak: retrospective cohort study in England using OpenSAFELY-TPP.

Objective: To investigate the effect of the covid-19 pandemic on the number of patients with group A streptococcal infections and related antibiotic prescriptions. Design: Retrospective cohort study in England using OpenSAFELY-TPP. Setting: Primary care practices in England that used TPP SystmOne software, 1 January 2018 to 31 March 2023, with the approval of NHS England. Participants: Patients registered at a TPP practice at the start of each month of the study period. Patients with missing data for sex or age were excluded, resulting in a population of 23 816 470 in January 2018, increasing to 25 541 940 by March 2023. Main outcome measures: Monthly counts and crude rates of patients with group A streptococcal infections (sore throat or tonsillitis, scarlet fever, and invasive group A streptococcal infections), and recommended firstline, alternative, and reserved antibiotic prescriptions linked with a group A streptococcal infection before (pre-April 2020), during, and after (post-April 2021) covid-19 restrictions. Maximum and minimum count and rate for each infectious season (time from September to August), as well as the rate ratio of the 2022-23 season compared with the last comparably high season (2017-18). Results: The number of patients with group A streptococcal infections, and antibiotic prescriptions linked to an indication of group A streptococcal infection, peaked in December 2022, higher than the peak in 2017-18. The rate ratios for monthly sore throat or tonsillitis (possible group A streptococcal throat infection), scarlet fever, and invasive group A streptococcal infection in 2022-23 relative to 2017-18 were 1.39 (95% confidence interval (CI) 1.38 to 1.40), 2.68 (2.59 to 2.77), and 4.37 (2.94 to 6.48), respectively. The rate ratio for prescriptions of first line, alternative, and reserved antibiotics to patients with group A streptococcal infections in 2022-23 relative to 2017-18 were 1.37 (95% CI 1.35 to 1.38), 2.30 (2.26 to 2.34), and 2.42 (2.24 to 2.61), respectively. For individual antibiotic prescriptions in 2022-23, azithromycin showed the greatest relative increase versus 2017-18, with a rate ratio of 7.37 (6.22 to 8.74). This finding followed a marked decrease in the recording of patients with group A streptococcal infections and associated prescriptions during the period of covid-19 restrictions where the maximum count and rates were lower than any minimum rates before the covid-19 pandemic. Conclusions: Recording of rates of scarlet fever, sore throat or tonsillitis, and invasive group A streptococcal infections, and associated antibiotic prescribing, peaked in December 2022. Primary care data can supplement existing infectious disease surveillance through linkages with relevant prescribing data and detailed analysis of clinical and demographic subgroups.

The impact of COVID-19 on medication reviews in English primary care. An OpenSAFELY-TPP analysis of 20 million adult electronic health records.

AIMS: The COVID-19 pandemic caused significant disruption to routine activity in primary care. Medication reviews are an important primary care activity ensuring safety and appropriateness of prescribing. A disruption could have significant negative implications for patient care. Using routinely collected data, our aim was first to describe codes used to record medication review activity and then to report the impact of COVID-19 on the rates of medication reviews. METHODS: With the approval of NHS England, we conducted a cohort study of 20 million adult patient records in general practice, in-situ using the OpenSAFELY platform. For each month, between April 2019 and March 2022, we report the percentage of patients with a medication review coded monthly and in the previous 12 months with breakdowns by regional, clinical and demographic subgroups and those prescribed high-risk medications. RESULTS: In April 2019, 32.3% of patients had a medication review coded in the previous 12 months. During the first COVID-19 lockdown, monthly activity decreased (-21.1% April 2020), but the 12-month rate was not substantially impacted (-10.5% March 2021). The rate of structured medication review in the last 12 months reached 2.9% by March 2022, with higher percentages in high-risk groups (care home residents 34.1%, age 90+ years 13.1%, high-risk medications 10.2%). The most used medication review code was Medication review done 314530002 (59.5%). CONCLUSIONS: There was a substantial reduction in the monthly rate of medication reviews during the pandemic but rates recovered by the end of the study period. Structured medication reviews were prioritized for high-risk patients.

During the COVID-19 pandemic 20 000 prostate cancer diagnoses were missed in England.

OBJECTIVES: To investigate the effect of the COVID-19 pandemic on prostate cancer incidence, prevalence, and mortality in England. PATIENTS AND METHODS: With the approval of NHS England and using the OpenSAFELY-TPP dataset of 24 million patients, we undertook a cohort study of men diagnosed with prostate cancer. We visualised monthly rates in prostate cancer incidence, prevalence, and mortality per 100 000 adult men from January 2015 to July 2023. To assess the effect of the pandemic, we used generalised linear models and the pre-pandemic data to predict the expected rates from March 2020 as if the pandemic had not occurred. The 95% confidence intervals (CIs) of the predicted values were used to estimate the significance of the difference between the predicted and observed rates. RESULTS: In 2020, there was a drop in recorded incidence by 4772 (31%) cases (15 550 vs 20 322; 95% CI 19 241-21 403). In 2021, the incidence started to recover, and the drop was 3148 cases (18%, 17 950 vs 21 098; 95% CI 19 740-22 456). By 2022, the incidence returned to the levels that would be expected. During the pandemic, the age at diagnosis shifted towards older men. In 2020, the average age was 71.6 (95% CI 71.5-71.8) years, in 2021 it was 71.8 (95% CI 71.7-72.0) years as compared to 71.3 (95% CI 71.1-71.4) years in 2019. CONCLUSIONS: Given that our dataset represents 40% of the population, we estimate that proportionally the pandemic led to 20 000 missed prostate cancer diagnoses in England alone. The increase in incidence recorded in 2023 was not enough to account for the missed cases. The prevalence of prostate cancer remained lower throughout the pandemic than expected. As the recovery efforts continue, healthcare should focus on finding the men who were affected. The research should focus on investigating the potential harms to men diagnosed at older age.

Weight trends amongst adults with diabetes or hypertension during the COVID-19 pandemic: an observational study using OpenSAFELY.

BACKGROUND: COVID-19 pandemic restrictions may have influenced behaviours related to weight. AIMS: To describe patterns of weight change amongst adults living in England with Type 2 Diabetes (T2D) and/or hypertension during the COVID-19 pandemic. Design and Setting With the approval of NHS England, we conducted an observational cohort study using the routinely collected health data of approximately 40% of adults living in England, accessed through the OpenSAFELY service inside TPP. METHOD: We investigated clinical and sociodemographic characteristics associated with rapid weight gain (>0·5kg/m2/year) using multivariable logistic regression. RESULTS: We extracted data on adults with T2D (n=1,231,455, 44% female, 76% white British) or hypertension (n=3,558,405, 50% female, 84% white British). Adults with T2D lost weight overall (median δ = -0.1kg/m2/year [IQR: -0.7, 0.4]), however, rapid weight gain was common (20.7%) and associated with sex (male vs female: aOR 0.78[95%CI 0.77, 0.79]); age, older age reduced odds (e.g. 60-69-year-olds vs 18-29-year-olds: aOR 0.66[0.61, 0.71]); deprivation, (least-deprived-IMD vs most-deprived-IMD: aOR 0.87[0.85, 0.89]); white ethnicity (Black vs White: aOR 0.95[0.92, 0.98]); mental health conditions (e.g. depression: aOR 1.13 [1.12, 1.15]); and diabetes treatment (non-insulin treatment vs no pharmacological treatment: aOR 0.68[0.67, 0.69]). Adults with hypertension maintained stable weight overall (median δ = 0.0kg/m2/year [ -0.6, 0.5]), however, rapid weight gain was common (24.7%) and associated with similar characteristics as in T2D. CONCLUSION: Amongst adults living in England with T2D and/or hypertension, rapid pandemic weight gain was more common amongst females, younger adults, those living in more deprived areas, and those with mental health condition.

Impact of the COVID-19 pandemic on antipsychotic prescribing in individuals with autism, dementia, learning disability, serious mental illness or living in a care home: a federated analysis of 59 million patients' primary care records in situ using OpenSAFELY.

BACKGROUND: The COVID-19 pandemic affected how care was delivered to vulnerable patients, such as those with dementia or learning disability. OBJECTIVE: To explore whether this affected antipsychotic prescribing in at-risk populations. METHODS: With the approval of NHS England, we completed a retrospective cohort study, using the OpenSAFELY platform to explore primary care data of 59 million patients. We identified patients in five at-risk groups: autism, dementia, learning disability, serious mental illness and care home residents. We calculated the monthly prevalence of antipsychotic prescribing in these groups, as well as the incidence of new prescriptions in each month. FINDINGS: The average monthly rate of antipsychotic prescribing increased in dementia from 82.75 patients prescribed an antipsychotic per 1000 patients (95% CI 82.30 to 83.19) in January-March 2019 to 90.1 (95% CI 89.68 to 90.60) in October-December 2021 and from 154.61 (95% CI 153.79 to 155.43) to 166.95 (95% CI 166.23 to 167.67) in care homes. There were notable spikes in the rate of new prescriptions issued to patients with dementia and in care homes. In learning disability and autism groups, the rate of prescribing per 1000 decreased from 122.97 (95% CI 122.29 to 123.66) to 119.29 (95% CI 118.68 to 119.91) and from 54.91 (95% CI 54.52 to 55.29) to 51.04 (95% CI 50.74 to 51.35), respectively. CONCLUSION AND IMPLICATIONS: We observed a spike in antipsychotic prescribing in the dementia and care home groups, which correlated with lockdowns and was likely due to prescribing of antipsychotics for palliative care. We observed gradual increases in antipsychotic use in dementia and care home patients and decreases in their use in patients with learning disability or autism.

Healthcare in England was affected by the COVID-19 pandemic across the pancreatic cancer pathway: A cohort study using OpenSAFELY-TPP.

Background: Healthcare across all sectors, in the UK and globally, was negatively affected by the COVID-19 pandemic. We analysed healthcare services delivered to people with pancreatic cancer from January 2015 to March 2023 to investigate the effect of the COVID-19 pandemic. Methods: With the approval of NHS England, and drawing from a nationally representative OpenSAFELY-TPP dataset of 24 million patients (over 40% of the English population), we undertook a cohort study of people diagnosed with pancreatic cancer. We queried electronic healthcare records for information on the provision of healthcare services across the pancreatic cancer pathway. To estimate the effect of the COVID-19 pandemic, we predicted the rates of healthcare services if the pandemic had not happened. We used generalised linear models and the pre-pandemic data from January 2015 to February 2020 to predict rates in March 2020 to March 2023. The 95% confidence intervals of the predicted values were used to estimate the significance of the difference between the predicted and observed rates. Results: The rate of pancreatic cancer and diabetes diagnoses in the cohort was not affected by the pandemic. There were 26,840 people diagnosed with pancreatic cancer from January 2015 to March 2023. The mean age at diagnosis was 72 (±11 SD), 48% of people were female, 95% were of White ethnicity, and 40% were diagnosed with diabetes. We found a reduction in surgical resections by 25-28% during the pandemic. In addition, 20%, 10%, and 4% fewer people received body mass index, glycated haemoglobin, and liver function tests, respectively, before they were diagnosed with pancreatic cancer. There was no impact of the pandemic on the number of people making contact with primary care, but the number of contacts increased on average by 1-2 per person amongst those who made contact. Reporting of jaundice decreased by 28%, but recovered within 12 months into the pandemic. Emergency department visits, hospital admissions, and deaths were not affected. Conclusions: The pandemic affected healthcare in England across the pancreatic cancer pathway. Positive lessons could be learnt from the services that were resilient and those that recovered quickly. The reductions in healthcare experienced by people with cancer have the potential to lead to worse outcomes. Current efforts should focus on addressing the unmet needs of people with cancer. Funding: This work was jointly funded by the Wellcome Trust (222097/Z/20/Z); MRC (MR/V015757/1, MC_PC-20059, MR/W016729/1); NIHR (NIHR135559, COV-LT2-0073), and Health Data Research UK (HDRUK2021.000, 2021.0157). This work was funded by Medical Research Council (MRC) grant reference MR/W021390/1 as part of the postdoctoral fellowship awarded to AL and undertaken at the Bennett Institute, University of Oxford. The views expressed are those of the authors and not necessarily those of the NIHR, NHS England, UK Health Security Agency (UKHSA), or the Department of Health and Social Care. Funders had no role in the study design, collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication.

Eleven key measures for monitoring general practice clinical activity during COVID-19: A retrospective cohort study using 48 million adults' primary care records in England through OpenSAFELY.

Background: The COVID-19 pandemic has had a significant impact on delivery of NHS care. We have developed the OpenSAFELY Service Restoration Observatory (SRO) to develop key measures of primary care activity and describe the trends in these measures throughout the COVID-19 pandemic. Methods: With the approval of NHS England, we developed an open source software framework for data management and analysis to describe trends and variation in clinical activity across primary care electronic health record (EHR) data on 48 million adults.We developed SNOMED-CT codelists for key measures of primary care clinical activity such as blood pressure monitoring and asthma reviews, selected by an expert clinical advisory group and conducted a population cohort-based study to describe trends and variation in these measures January 2019-December 2021, and pragmatically classified their level of recovery one year into the pandemic using the percentage change in the median practice level rate. Results: We produced 11 measures reflective of clinical activity in general practice. A substantial drop in activity was observed in all measures at the outset of the COVID-19 pandemic. By April 2021, the median rate had recovered to within 15% of the median rate in April 2019 in six measures. The remaining measures showed a sustained drop, ranging from a 18.5% reduction in medication reviews to a 42.0% reduction in blood pressure monitoring. Three measures continued to show a sustained drop by December 2021. Conclusions: The COVID-19 pandemic was associated with a substantial change in primary care activity across the measures we developed, with recovery in most measures. We delivered an open source software framework to describe trends and variation in clinical activity across an unprecedented scale of primary care data. We will continue to expand the set of key measures to be routinely monitored using our publicly available NHS OpenSAFELY SRO dashboards with near real-time data. Funding: This research used data assets made available as part of the Data and Connectivity National Core Study, led by Health Data Research UK in partnership with the Office for National Statistics and funded by UK Research and Innovation (grant ref MC_PC_20058).The OpenSAFELY Platform is supported by grants from the Wellcome Trust (222097/Z/20/Z); MRC (MR/V015757/1, MC_PC-20059, MR/W016729/1); NIHR (NIHR135559, COV-LT2-0073), and Health Data Research UK (HDRUK2021.000, 2021.0157).

Changes in medication safety indicators in England throughout the covid-19 pandemic using OpenSAFELY: population based, retrospective cohort study of 57 million patients using federated analytics.

Objective: To implement complex, PINCER (pharmacist led information technology intervention) prescribing indicators, on a national scale with general practice data to describe the impact of the covid-19 pandemic on safe prescribing. Design: Population based, retrospective cohort study using federated analytics. Setting: Electronic general practice health record data from 56.8 million NHS patients by use of the OpenSAFELY platform, with the approval of the National Health Service (NHS) England. Participants: NHS patients (aged 18-120 years) who were alive and registered at a general practice that used TPP or EMIS computer systems and were recorded as at risk of at least one potentially hazardous PINCER indicator. Main outcome measure: Between 1 September 2019 and 1 September 2021, monthly trends and between practice variation for compliance with 13 PINCER indicators, as calculated on the first of every month, were reported. Prescriptions that do not adhere to these indicators are potentially hazardous and can cause gastrointestinal bleeds; are cautioned against in specific conditions (specifically heart failure, asthma, and chronic renal failure); or require blood test monitoring. The percentage for each indicator is formed of a numerator of patients deemed to be at risk of a potentially hazardous prescribing event and the denominator is of patients for which assessment of the indicator is clinically meaningful. Higher indicator percentages represent potentially poorer performance on medication safety. Results: The PINCER indicators were successfully implemented across general practice data for 56.8 million patient records from 6367 practices in OpenSAFELY. Hazardous prescribing remained largely unchanged during the covid-19 pandemic, with no evidence of increases in indicators of harm as captured by the PINCER indicators. The percentage of patients at risk of potentially hazardous prescribing, as defined by each PINCER indicator, at mean quarter 1 (Q1) 2020 (representing before the pandemic) ranged from 1.11% (age ≥65 years and non-steroidal anti-inflammatory drugs) to 36.20% (amiodarone and no thyroid function test), while Q1 2021 (representing after the pandemic) percentages ranged from 0.75% (age ≥65 years and non-steroidal anti-inflammatory drugs) to 39.23% (amiodarone and no thyroid function test). Transient delays occurred in blood test monitoring for some medications, particularly angiotensin-converting enzyme inhibitors (where blood monitoring worsened from a mean of 5.16% in Q1 2020 to 12.14% in Q1 2021, and began to recover in June 2021). All indicators substantially recovered by September 2021. We identified 1 813 058 patients (3.1%) at risk of at least one potentially hazardous prescribing event. Conclusion: NHS data from general practices can be analysed at national scale to generate insights into service delivery. Potentially hazardous prescribing was largely unaffected by the covid-19 pandemic in primary care health records in England.

Impact of COVID-19 on broad-spectrum antibiotic prescribing for common infections in primary care in England: a time-series analyses using OpenSAFELY and effects of predictors including deprivation.

Background: The COVID-19 pandemic impacted the healthcare systems, adding extra pressure to reduce antimicrobial resistance. Therefore, we aimed to evaluate changes in antibiotic prescription patterns after COVID-19 started. Methods: With the approval of NHS England, we used the OpenSAFELY platform to access the TPP SystmOne electronic health record (EHR) system in primary care and selected patients prescribed antibiotics from 2019 to 2021. To evaluate the impact of COVID-19 on broad-spectrum antibiotic prescribing, we evaluated prescribing rates and its predictors and used interrupted time series analysis by fitting binomial logistic regression models. Findings: Over 32 million antibiotic prescriptions were extracted over the study period; 8.7% were broad-spectrum. The study showed increases in broad-spectrum antibiotic prescribing (odds ratio [OR] 1.37; 95% confidence interval [CI] 1.36-1.38) as an immediate impact of the pandemic, followed by a gradual recovery with a 1.1-1.2% decrease in odds of broad-spectrum prescription per month. The same pattern was found within subgroups defined by age, sex, region, ethnicity, and socioeconomic deprivation quintiles. More deprived patients were more likely to receive broad-spectrum antibiotics, which differences remained stable over time. The most significant increase in broad-spectrum prescribing was observed for lower respiratory tract infection (OR 2.33; 95% CI 2.1-2.50) and otitis media (OR 1.96; 95% CI 1.80-2.13). Interpretation: An immediate reduction in antibiotic prescribing and an increase in the proportion of broad-spectrum antibiotic prescribing in primary care was observed. The trends recovered to pre-pandemic levels, but the consequence of the COVID-19 pandemic on AMR needs further investigation. Funding: This work was supported by Health Data Research UK and by National Institute for Health Research.

First dose COVID-19 vaccine coverage amongst adolescents and children in England: an analysis of 3.21 million patients' primary care records in situ using OpenSAFELY.

Background: The coronavirus disease 2019 (COVID-19) vaccination programme in England was extended to include all adolescents and children by April 2022. The aim of this paper is to describe trends and variation in vaccine coverage in different clinical and demographic groups amongst adolescents and children in England by August 2022. Methods: With the approval of NHS England, a cohort study was conducted of 3.21 million children and adolescents' records in general practice in England,  in situ and within the infrastructure of the electronic health record software vendor TPP using OpenSAFELY. Vaccine coverage across various demographic (sex, deprivation index and ethnicity) and clinical (risk status) populations is described. Results: Coverage is higher amongst adolescents than it is amongst children, with 53.5% adolescents and 10.8% children having received their first dose of the COVID-19 vaccine. Within those groups, coverage varies by ethnicity, deprivation index and risk status; there is no evidence of variation by sex. Conclusion: First dose COVID-19 vaccine coverage is shown to vary amongst various demographic and clinical groups of children and adolescents.

The impact of lidocaine plaster prescribing reduction strategies: A comparison of two national health services in Europe.

AIMS: In 2017, two distinct interventions were implemented in Ireland and England to reduce prescribing of lidocaine medicated plasters. In Ireland, restrictions on reimbursement were introduced through implementation of an application system for reimbursement. In England, updated guidance on items which should not be routinely prescribed in primary care, including lidocaine plasters, was published. This study aims to compare how the interventions impacted prescribing of lidocaine plasters in these countries. METHODS: We conducted an interrupted time-series study using general practice data. For Ireland, monthly dispensing data (2015-2019) from the means-tested General Medical Services (GMS) scheme was used. For England, data covered all patients. Outcomes were the rate of dispensings, quantity and costs of lidocaine plasters, and we modelled level and trend changes from the first full month of the policy/guidance change. RESULTS: Ireland had higher rates of lidocaine dispensings compared to England throughout the study period; this was 15.22/1000 population immediately pre-intervention, and there was equivalent to a 97.2% immediate reduction following the intervention. In England, the immediate pre-intervention dispensing rate was 0.36/1000, with an immediate reduction of 0.0251/1000 (a 5.8% decrease), followed by a small but significant decrease in the monthly trend relative to the pre-intervention trend of 0.0057 per month. CONCLUSIONS: Among two different interventions aiming to decrease low-value lidocaine plaster prescribing, there was a substantially larger impact in Ireland of reimbursement restriction compared to issuing guidance in England. However, this is in the context of much higher baseline rates of use in Ireland compared to England.

The impact of COVID-19 on antibiotic prescribing in primary care in England: Evaluation and risk prediction of appropriateness of type and repeat prescribing.

BACKGROUND: This study aimed to predict risks of potentially inappropriate antibiotic type and repeat prescribing and assess changes during COVID-19. METHODS: With the approval of NHS England, we used OpenSAFELY platform to access the TPP SystmOne electronic health record (EHR) system and selected patients prescribed antibiotics from 2019 to 2021. Multinomial logistic regression models predicted patient's probability of receiving inappropriate antibiotic type or repeat antibiotic course for each common infection. RESULTS: The population included 9.1 million patients with 29.2 million antibiotic prescriptions. 29.1% of prescriptions were identified as repeat prescribing. Those with same day incident infection coded in the EHR had considerably lower rates of repeat prescribing (18.0%) and 8.6% had potentially inappropriate type. No major changes in the rates of repeat antibiotic prescribing during COVID-19 were found. In the 10 risk prediction models, good levels of calibration and moderate levels of discrimination were found. CONCLUSIONS: Our study found no evidence of changes in level of inappropriate or repeat antibiotic prescribing after the start of COVID-19. Repeat antibiotic prescribing was frequent and varied according to regional and patient characteristics. There is a need for treatment guidelines to be developed around antibiotic failure and clinicians provided with individualised patient information.

Challenges in Estimating the Effectiveness of COVID-19 Vaccination Using Observational Data.

The COVID-19 vaccines were developed and rigorously evaluated in randomized trials during 2020. However, important questions, such as the magnitude and duration of protection, their effectiveness against new virus variants, and the effectiveness of booster vaccination, could not be answered by randomized trials and have therefore been addressed in observational studies. Analyses of observational data can be biased because of confounding and because of inadequate design that does not consider the evolution of the pandemic over time and the rapid uptake of vaccination. Emulating a hypothetical "target trial" using observational data assembled during vaccine rollouts can help manage such potential sources of bias. This article describes 2 approaches to target trial emulation. In the sequential approach, on each day, eligible persons who have not yet been vaccinated are matched to a vaccinated person. The single-trial approach sets a single baseline at the start of the rollout and considers vaccination as a time-varying variable. The nature of the confounding depends on the analysis strategy: Estimating "per-protocol" effects (accounting for vaccination of initially unvaccinated persons after baseline) may require adjustment for both baseline and "time-varying" confounders. These issues are illustrated by using observational data from 2 780 931 persons in the United Kingdom aged 70 years or older to estimate the effect of a first dose of a COVID-19 vaccine. Addressing the issues discussed in this article should help authors of observational studies provide robust evidence to guide clinical and policy decisions.

OpenSAFELY NHS Service Restoration Observatory 2: changes in primary care clinical activity in England during the COVID-19 pandemic.

BACKGROUND: The COVID-19 pandemic has disrupted healthcare activity across a broad range of clinical services. The NHS stopped non-urgent work in March 2020, later recommending services be restored to near-normal levels before winter where possible. AIM: To describe changes in the volume and variation of coded clinical activity in general practice across six clinical areas: cardiovascular disease, diabetes, mental health, female and reproductive health, screening and related procedures, and processes related to medication. DESIGN AND SETTING: With the approval of NHS England, a cohort study was conducted of 23.8 million patient records in general practice, in situ using OpenSAFELY. METHOD: Common primary care activities were analysed using Clinical Terms Version 3 codes and keyword searches from January 2019 to December 2020, presenting median and deciles of code usage across practices per month. RESULTS: Substantial and widespread changes in clinical activity in primary care were identified since the onset of the COVID-19 pandemic, with generally good recovery by December 2020. A few exceptions showed poor recovery and warrant further investigation, such as mental health (for example, for 'Depression interim review' the median occurrences across practices in December 2020 was down by 41.6% compared with December 2019). CONCLUSION: Granular NHS general practice data at population-scale can be used to monitor disruptions to healthcare services and guide the development of mitigation strategies. The authors are now developing real-time monitoring dashboards for the key measures identified in this study, as well as further studies using primary care data to monitor and mitigate the indirect health impacts of COVID-19 on the NHS.

Data-Driven Identification of Unusual Prescribing Behavior: Analysis and Use of an Interactive Data Tool Using 6 Months of Primary Care Data From 6500 Practices in England.

BACKGROUND: Approaches to addressing unwarranted variation in health care service delivery have traditionally relied on the prospective identification of activities and outcomes, based on a hypothesis, with subsequent reporting against defined measures. Practice-level prescribing data in England are made publicly available by the National Health Service (NHS) Business Services Authority for all general practices. There is an opportunity to adopt a more data-driven approach to capture variability and identify outliers by applying hypothesis-free, data-driven algorithms to national data sets. OBJECTIVE: This study aimed to develop and apply a hypothesis-free algorithm to identify unusual prescribing behavior in primary care data at multiple administrative levels in the NHS in England and to visualize these results using organization-specific interactive dashboards, thereby demonstrating proof of concept for prioritization approaches. METHODS: Here we report a new data-driven approach to quantify how "unusual" the prescribing rates of a particular chemical within an organization are as compared to peer organizations, over a period of 6 months (June-December 2021). This is followed by a ranking to identify which chemicals are the most notable outliers in each organization. These outlying chemicals are calculated for all practices, primary care networks, clinical commissioning groups, and sustainability and transformation partnerships in England. Our results are presented via organization-specific interactive dashboards, the iterative development of which has been informed by user feedback. RESULTS: We developed interactive dashboards for every practice (n=6476) in England, highlighting the unusual prescribing of 2369 chemicals (dashboards are also provided for 42 sustainability and transformation partnerships, 106 clinical commissioning groups, and 1257 primary care networks). User feedback and internal review of case studies demonstrate that our methodology identifies prescribing behavior that sometimes warrants further investigation or is a known issue. CONCLUSIONS: Data-driven approaches have the potential to overcome existing biases with regard to the planning and execution of audits, interventions, and policy making within NHS organizations, potentially revealing new targets for improved health care service delivery. We present our dashboards as a proof of concept for generating candidate lists to aid expert users in their interpretation of prescribing data and prioritize further investigations and qualitative research in terms of potential targets for improved performance.

Changes in COVID-19-related mortality across key demographic and clinical subgroups in England from 2020 to 2022: a retrospective cohort study using the OpenSAFELY platform.

BACKGROUND: COVID-19 has been shown to differently affect various demographic and clinical population subgroups. We aimed to describe trends in absolute and relative COVID-19-related mortality risks across clinical and demographic population subgroups during successive SARS-CoV-2 pandemic waves. METHODS: We did a retrospective cohort study in England using the OpenSAFELY platform with the approval of National Health Service England, covering the first five SARS-CoV-2 pandemic waves (wave one [wild-type] from March 23 to May 30, 2020; wave two [alpha (B.1.1.7)] from Sept 7, 2020, to April 24, 2021; wave three [delta (B.1.617.2)] from May 28 to Dec 14, 2021; wave four [omicron (B.1.1.529)] from Dec 15, 2021, to April 29, 2022; and wave five [omicron] from June 24 to Aug 3, 2022). In each wave, we included people aged 18-110 years who were registered with a general practice on the first day of the wave and who had at least 3 months of continuous general practice registration up to this date. We estimated crude and sex-standardised and age-standardised wave-specific COVID-19-related death rates and relative risks of COVID-19-related death in population subgroups. FINDINGS: 18 895 870 adults were included in wave one, 19 014 720 in wave two, 18 932 050 in wave three, 19 097 970 in wave four, and 19 226 475 in wave five. Crude COVID-19-related death rates per 1000 person-years decreased from 4·48 deaths (95% CI 4·41-4·55) in wave one to 2·69 (2·66-2·72) in wave two, 0·64 (0·63-0·66) in wave three, 1·01 (0·99-1·03) in wave four, and 0·67 (0·64-0·71) in wave five. In wave one, the standardised COVID-19-related death rates were highest in people aged 80 years or older, people with chronic kidney disease stage 5 or 4, people receiving dialysis, people with dementia or learning disability, and people who had received a kidney transplant (ranging from 19·85 deaths per 1000 person-years to 44·41 deaths per 1000 person-years, compared with from 0·05 deaths per 1000 person-years to 15·93 deaths per 1000 person-years in other subgroups). In wave two compared with wave one, in a largely unvaccinated population, the decrease in COVID-19-related mortality was evenly distributed across population subgroups. In wave three compared with wave one, larger decreases in COVID-19-related death rates were seen in groups prioritised for primary SARS-CoV-2 vaccination, including people aged 80 years or older and people with neurological disease, learning disability, or severe mental illness (90-91% decrease). Conversely, smaller decreases in COVID-19-related death rates were observed in younger age groups, people who had received organ transplants, and people with chronic kidney disease, haematological malignancies, or immunosuppressive conditions (0-25% decrease). In wave four compared with wave one, the decrease in COVID-19-related death rates was smaller in groups with lower vaccination coverage (including younger age groups) and conditions associated with impaired vaccine response, including people who had received organ transplants and people with immunosuppressive conditions (26-61% decrease). INTERPRETATION: There was a substantial decrease in absolute COVID-19-related death rates over time in the overall population, but demographic and clinical relative risk profiles persisted and worsened for people with lower vaccination coverage or impaired immune response. Our findings provide an evidence base to inform UK public health policy for protecting these vulnerable population subgroups. FUNDING: UK Research and Innovation, Wellcome Trust, UK Medical Research Council, National Institute for Health and Care Research, and Health Data Research UK.

Trends, variation, and clinical characteristics of recipients of antiviral drugs and neutralising monoclonal antibodies for covid-19 in community settings: retrospective, descriptive cohort study of 23.4 million people in OpenSAFELY.

Objective: To ascertain patient eligibility status and describe coverage of antiviral drugs and neutralising monoclonal antibodies (nMAB) as treatment for covid-19 in community settings in England. Design: Retrospective, descriptive cohort study, approved by NHS England. Setting: Routine clinical data from 23.4 million people linked to data on covid-19 infection and treatment, within the OpenSAFELY-TPP database. Participants: Outpatients with covid-19 at high risk of severe outcomes. Interventions: Nirmatrelvir/ritonavir (paxlovid), sotrovimab, molnupiravir, casirivimab/imdevimab, or remdesivir, used in the community by covid-19 medicine delivery units. Results: 93 870 outpatients with covid-19 were identified between 11 December 2021 and 28 April 2022 to be at high risk of severe outcomes and therefore potentially eligible for antiviral or nMAB treatment (or both). Of these patients, 19 040 (20%) received treatment (sotrovimab, 9660 (51%); molnupiravir, 4620 (24%); paxlovid, 4680 (25%); casirivimab/imdevimab, 50 (<1%); and remdesivir, 30 (<1%)). The proportion of patients treated increased from 9% (190/2220) in the first week of treatment availability to 29% (460/1600) in the latest week. The proportion treated varied by high risk group, being lowest in those with liver disease (16%; 95% confidence interval 15% to 17%); by treatment type, with sotrovimab favoured over molnupiravir and paxlovid in all but three high risk groups (Down's syndrome (35%; 30% to 39%), rare neurological conditions (45%; 43% to 47%), and immune deficiencies (48%; 47% to 50%)); by age, ranging from ≥80 years (13%; 12% to 14%) to 50-59 years (23%; 22% to 23%); by ethnic group, ranging from black (11%; 10% to 12%) to white (21%; 21% to 21%); by NHS region, ranging from 13% (12% to 14%) in Yorkshire and the Humber to 25% (24% to 25%) in the East of England); and by deprivation level, ranging from 15% (14% to 15%) in the most deprived areas to 23% (23% to 24%) in the least deprived areas. Groups that also had lower coverage included unvaccinated patients (7%; 6% to 9%), those with dementia (6%; 5% to 7%), and care home residents (6%; 6% to 7%). Conclusions: Using the OpenSAFELY platform, we were able to identify patients with covid-19 at high risk of severe outcomes who were potentially eligible to receive treatment and assess the coverage of these new treatments among these patients. In the context of a rapid deployment of a new service, the NHS analytical code used to determine eligibility could have been over-inclusive and some of the eligibility criteria not fully captured in healthcare data. However targeted activity might be needed to resolve apparent lower treatment coverage observed among certain groups, in particular (at present): different NHS regions, ethnic groups, people aged ≥80 years, those living in socioeconomically deprived areas, and care home residents.

Clinical and health inequality risk factors for non-COVID-related sepsis during the global COVID-19 pandemic: a national case-control and cohort study.

Background: Sepsis, characterised by significant morbidity and mortality, is intricately linked to socioeconomic disparities and pre-admission clinical histories. This study aspires to elucidate the association between non-COVID-19 related sepsis and health inequality risk factors amidst the pandemic in England, with a secondary focus on their association with 30-day sepsis mortality. Methods: With the approval of NHS England, we harnessed the OpenSAFELY platform to execute a cohort study and a 1:6 matched case-control study. A sepsis diagnosis was identified from the incident hospital admissions record using ICD-10 codes. This encompassed 248,767 cases with non-COVID-19 sepsis from a cohort of 22.0 million individuals spanning January 1, 2019, to June 31, 2022. Socioeconomic deprivation was gauged using the Index of Multiple Deprivation score, reflecting indicators like income, employment, and education. Hospitalisation-related sepsis diagnoses were categorised as community-acquired or hospital-acquired. Cases were matched to controls who had no recorded diagnosis of sepsis, based on age (stepwise), sex, and calendar month. The eligibility criteria for controls were established primarily on the absence of a recorded sepsis diagnosis. Associations between potential predictors and odds of developing non-COVID-19 sepsis underwent assessment through conditional logistic regression models, with multivariable regression determining odds ratios (ORs) for 30-day mortality. Findings: The study included 224,361 (10.2%) cases with non-COVID-19 sepsis and 1,346,166 matched controls. The most socioeconomic deprived quintile was associated with higher odds of developing non-COVID-19 sepsis than the least deprived quintile (crude OR 1.80 [95% CI 1.77-1.83]). Other risk factors (after adjusting comorbidities) such as learning disability (adjusted OR 3.53 [3.35-3.73]), chronic liver disease (adjusted OR 3.08 [2.97-3.19]), chronic kidney disease (stage 4: adjusted OR 2.62 [2.55-2.70], stage 5: adjusted OR 6.23 [5.81-6.69]), cancer, neurological disease, immunosuppressive conditions were also associated with developing non-COVID-19 sepsis. The incidence rate of non-COVID-19 sepsis decreased during the COVID-19 pandemic and rebounded to pre-pandemic levels (April 2021) after national lockdowns had been lifted. The 30-day mortality risk in cases with non-COVID-19 sepsis was higher for the most deprived quintile across all periods. Interpretation: Socioeconomic deprivation, comorbidity and learning disabilities were associated with an increased odds of developing non-COVID-19 related sepsis and 30-day mortality in England. This study highlights the need to improve the prevention of sepsis, including more precise targeting of antimicrobials to higher-risk patients. Funding: The UK Health Security Agency, Health Data Research UK, and National Institute for Health Research.

Identifying Patterns of Clinical Interest in Clinicians' Treatment Preferences: Hypothesis-free Data Science Approach to Prioritizing Prescribing Outliers for Clinical Review.

BACKGROUND: Data analysis is used to identify signals suggestive of variation in treatment choice or clinical outcome. Analyses to date have generally focused on a hypothesis-driven approach. OBJECTIVE: This study aimed to develop a hypothesis-free approach to identify unusual prescribing behavior in primary care data. We aimed to apply this methodology to a national data set in a cross-sectional study to identify chemicals with significant variation in use across Clinical Commissioning Groups (CCGs) for further clinical review, thereby demonstrating proof of concept for prioritization approaches. METHODS: Here we report a new data-driven approach to identify unusual prescribing behaviour in primary care data. This approach first applies a set of filtering steps to identify chemicals with prescribing rate distributions likely to contain outliers, then applies two ranking approaches to identify the most extreme outliers amongst those candidates. This methodology has been applied to three months of national prescribing data (June-August 2017). RESULTS: Our methodology provides rankings for all chemicals by administrative region. We provide illustrative results for 2 antipsychotic drugs of particular clinical interest: promazine hydrochloride and pericyazine, which rank highly by outlier metrics. Specifically, our method identifies that, while promazine hydrochloride and pericyazine are barely used by most clinicians (with national prescribing rates of 11.1 and 6.2 per 1000 antipsychotic prescriptions, respectively), they make up a substantial proportion of antipsychotic prescribing in 2 small geographic regions in England during the study period (with maximum regional prescribing rates of 298.7 and 241.1 per 1000 antipsychotic prescriptions, respectively). CONCLUSIONS: Our hypothesis-free approach is able to identify candidates for audit and review in clinical practice. To illustrate this, we provide 2 examples of 2 very unusual antipsychotics used disproportionately in 2 small geographic areas of England.