Adoption by clinicians of electronic order communications in NHS secondary care: a descriptive account.

BACKGROUND: Due to the rapid advancement in information technology, changes to communication modalities are increasingly implemented in healthcare. One such modality is Computerised Provider Order Entry (CPOE) systems which replace paper, verbal or telephone orders with electronic booking of requests. We aimed to understand the uptake, and user acceptability, of CPOE in a large National Health Service hospital system. METHODS: This retrospective single-centre study investigates the longitudinal uptake of communications through the Prescribing, Information and Communication System (PICS). The development and configuration of PICS are led by the doctors, nurses and allied health professionals that use it and requests for CPOE driven by clinical need have been described.Records of every request (imaging, specialty review, procedure, laboratory) made through PICS were collected between October 2008 and July 2019 and resulting counts were presented. An estimate of the proportion of completed requests made through the system has been provided for three example requests. User surveys were completed. RESULTS: In the first 6 months of implementation, a total of 832 new request types (imaging types and specialty referrals) were added to the system. Subsequently, an average of 6.6 new request types were added monthly. In total, 8 035 132 orders were requested through PICS. In three example request types (imaging, endoscopy and full blood count), increases in the proportion of requests being made via PICS were seen. User feedback at 6 months reported improved communications using the electronic system. CONCLUSION: CPOE was popular, rapidly adopted and diversified across specialties encompassing wide-ranging requests.

A Comparative Biomechanical Study of Alternative Medial Collateral Ligament Reconstruction Techniques.

BACKGROUND: There is little evidence of the biomechanical performance of medial collateral ligament (MCL) reconstructions for restoring stability to the MCL-deficient knee regarding valgus, external rotation (ER), and anteromedial rotatory instability (AMRI). HYPOTHESIS: A short isometric reconstruction will better restore stability than a longer superficial MCL (sMCL) reconstruction, and an additional deep MCL (dMCL) graft will better control ER and AMRI than single-strand reconstructions. STUDY DESIGN: Controlled laboratory study. METHODS: Nine cadaveric human knees were tested in a kinematics rig that allowed tibial loading while the knee was flexed-extended 0° to 100°. Optical markers were placed on the femur and tibia and displacements were measured using a stereo camera system. The knee was tested intact, and then after MCL (sMCL + dMCL) transection, and loaded in anterior tibial translation (ATT), ER, varus-valgus, and combined ATT + ER (AMRI loading). Five different isometric MCL reconstructions were tested: isolated long sMCL, a short construct, each with and without dMCL addition, and isolated dMCL reconstruction, using an 8 mm-wide synthetic graft. RESULTS: MCL deficiency caused an increase in ER of 4° at 0° of flexion (P = .271) up to 14° at 100° of flexion (P = .002), and valgus laxity increased by 5° to 8° between 0° and 100° of flexion (P < .024 at 0°-90°). ATT did not increase significantly in isolated MCL deficiency (P > .999). All 5 reconstructions restored native stability across the arc of flexion apart from the isolated long sMCL, which demonstrated residual ER instability (P≤ .047 vs other reconstructions). CONCLUSION: All tested techniques apart from the isolated long sMCL graft are satisfactory in the context of restoring the valgus, ER, and AMRI stability to the MCL-deficient knee in a cadaveric model. CLINICAL RELEVANCE: Contemporary MCL reconstruction techniques fail to control ER and therefore AMRI as they use a long sMCL graft and do not address the dMCL. This study compares 5 MCL reconstruction techniques. Both long and short isometric constructs other than the long sMCL achieved native stability in valgus and ER/AMRI. Double-strand reconstructions (sMCL + dMCL) tended to provide more stability. This study shows which reconstructions demonstrate the best biomechanical performance, informs surgical reconstruction techniques for AMRI, and questions the efficacy of current popular techniques.

A "Short Isometric Construct" Reconstruction Technique for the Medial Collateral Ligament of the Knee.

Recently there has been increased focus on the medial collateral ligament (MCL) and the role the medial ligament complex plays in preventing valgus and external rotation, especially in the setting of a combined ligament injury. Multiple surgical techniques purport to reproduce "normal anatomy"; however, only one technique addresses the deep MCL fibers and the prevention of external rotation. Thus we describe the "short isometric construct" MCL reconstruction which is stiffer than the anatomic reconstructions. The "short isometric construct" technique resists valgus throughout range of motion whereas its obliquity resists tibial external rotation, helping to reduce the risk of anterior cruciate ligament graft re-rupture.

Klarigi: Characteristic explanations for semantic biomedical data.

Annotation of biomedical entities with ontology classes provides for formal semantic analysis and mobilisation of background knowledge in determining their relationships. To date, enrichment analysis has been routinely employed to identify classes that are over-represented in annotations across sets of groups, such as biosample gene expression profiles or patient phenotypes, and is useful for a range of tasks including differential diagnosis and causative variant prioritisation. These approaches, however, usually consider only univariate relationships, make limited use of the semantic features of ontologies, and provide limited information and evaluation of the explanatory power of both singular and grouped candidate classes. Moreover, they are not designed to solve the problem of deriving cohesive, characteristic, and discriminatory sets of classes for entity groups. We have developed a new tool, called Klarigi, which introduces multiple scoring heuristics for identification of classes that are both compositional and discriminatory for groups of entities annotated with ontology classes. The tool includes a novel algorithm for derivation of multivariable semantic explanations for entity groups, makes use of semantic inference through live use of an ontology reasoner, and includes a classification method for identifying the discriminatory power of candidate sets, in addition to significance testing apposite to traditional enrichment approaches. We describe the design and implementation of Klarigi, including its scoring and explanation determination methods, and evaluate its use in application to two test cases with clinical significance, comparing and contrasting methods and results with literature-based and enrichment analysis methods. We demonstrate that Klarigi produces characteristic and discriminatory explanations for groups of biomedical entities in two settings. We also show that these explanations recapitulate and extend the knowledge held in existing biomedical databases and literature for several diseases. We conclude that Klarigi provides a distinct and valuable perspective on biomedical datasets when compared with traditional enrichment methods, and therefore constitutes a new method by which biomedical datasets can be explored, contributing to improved insight into semantic data.

Does acute kidney injury alerting improve patient outcomes?

BACKGROUND: Electronic alerts (e-alerts) for Acute Kidney Injury (AKI) have been implemented into a variety of different Electronic Health Records (EHR) systems worldwide in order to improve recognition and encourage early appropriate management of AKI. We were interested in the impact on patient safety, specialist referral and clinical management. METHODS: All patients admitted to our institution with AKI were included in the study. We studied AKI progression, dialysis dependency, length of hospital stay, emergency readmission, ICU readmission, and death, before and after the introduction of electronic alerts. The impact on prescription of high risk drugs, fluid administration, and referral to renal services was also analysed. RESULTS: After the introduction of the e-alert, progression to higher AKI stage, emergency readmission to hospital and death during admission were significantly reduced. More prescriptions were stopped for drugs that adversely affect renal function in AKI and there was a significant increase in the ICU admissions and in the number of patients having dialysis, especially in earlier stages. Longer term mortality, renal referrals, and fluid alteration did not change significantly after the AKI e-alert introduction. CONCLUSIONS: AKI e-alerts can improve clinical outcomes in hospitalised patients.

Benefits of electronic charts in intensive care and during a world health pandemic: advantages of the technology age.

AIMS AND OBJECTIVES: This study sets out to describe benefits from the implementation of electronic observation charting in intensive care units (ICU). This was an extension to the existing hospital wide digital health system. We evaluated error reduction, time-savings and the costs associated with conversion from paper to digital records. The world health emergency of COVID-19 placed extraordinary strain on ICU and staff opinion was evaluated to test how well the electronic system performed. METHODS: A clinically led project group working directly with programmers developed an electronic patient record for intensive care. Data error rates, time to add data and to make calculations were studied before and after the introduction of electronic charts. User feedback was sought pre and post go-live (during the COVID-19 pandemic) and financial implications were calculated by the hospital finance teams. RESULTS: Error rates equating to 219 000/year were avoided by conversion to electronic charts. Time saved was the equivalent of a nursing shift each day. Recurrent cost savings per year were estimated to be £257k. Staff were overwhelmingly positive about electronic charts in ICU, even during a health pandemic and despite redeployment into intensive care where they were using the electronic charts for the first time. DISCUSSION: Electronic ICU charts have been successfully introduced into our institution with benefits in terms of patient safety through error reduction and improved care through release of nursing time. Costs have been reduced. Staff feel supported by the digital system and report it to be helpful even during redeployment and in the unfamiliar environment of intensive care.

Effectiveness of clinical decision support in controlling inappropriate red blood cell and platelet transfusions, speciality specific responses and behavioural change.

BACKGROUND: Electronic clinical decision support (CDS) within Electronic Health Records has been used to improve patient safety, including reducing unnecessary blood product transfusions. We assessed the effectiveness of CDS in controlling inappropriate red blood cell (RBC) and platelet transfusion in a large acute hospital and how speciality specific behaviours changed in response. METHODS: We used segmented linear regression of interrupted time series models to analyse the instantaneous and long term effect of introducing blood product electronic warnings to prescribers. We studied the impact on transfusions for patients in critical care (CC), haematology/oncology (HO) and elsewhere. RESULTS: In non-CC or HO, there was significant and sustained decrease in the numbers of RBC transfusions after introduction of alerts. In CC the alerts reduced transfusions but this was not sustained, and in HO there was no impact on RBC transfusion. For platelet transfusions outside of CC and HO, the introduction of alerts stopped a rising trend of administration of platelets above recommended targets. In CC, alerts reduced platelet transfusions, but in HO alerts had little impact on clinician prescribing. CONCLUSION: The findings suggest that CDS can result in immediate change in user behaviour which is more obvious outside specialist settings of CC and HO. It is important that this is then sustained. In CC and HO, blood transfusion practices differ. CDS thus needs to take specific circumstances into account. In this case there are acceptable reasons to transfuse outside of these crude targets and CDS should take these into account.

Variability and performance of NHS England's 'reason to reside' criteria in predicting hospital discharge in acute hospitals in England: a retrospective, observational cohort study.

OBJECTIVES: NHS England (NHSE) advocates 'reason to reside' (R2R) criteria to support discharge planning. The proportion of patients without R2R and their rate of discharge are reported daily by acute hospitals in England. R2R has no interoperable standardised data model (SDM), and its performance has not been validated. We aimed to understand the degree of intercentre and intracentre variation in R2R-related metrics reported to NHSE, define an SDM implemented within a single centre Electronic Health Record to generate an electronic R2R (eR2R) and evaluate its performance in predicting subsequent discharge. DESIGN: Retrospective observational cohort study using routinely collected health data. SETTING: 122 NHS Trusts in England for national reporting and an acute hospital in England for local reporting. PARTICIPANTS: 6 602 706 patient-days were analysed using 3-month national data and 1 039 592 patient-days, using 3-year single centre data. MAIN OUTCOME MEASURES: Variability in R2R-related metrics reported to NHSE. Performance of eR2R in predicting discharge within 24 hours. RESULTS: There were high levels of intracentre and intercentre variability in R2R-related metrics (p<0.0001) but not in eR2R. Informedness of eR2R for discharge within 24 hours was low (J-statistic 0.09-0.12 across three consecutive years). In those remaining in hospital without eR2R, 61.2% met eR2R criteria on subsequent days (76% within 24 hours), most commonly due to increased NEWS2 (21.9%) or intravenous therapy administration (32.8%). CONCLUSIONS: Reported R2R metrics are highly variable between and within acute Trusts in England. Although case-mix or community care provision may account for some variability, the absence of a SDM prevents standardised reporting. Following the development of a SDM in one acute Trust, the variability reduced. However, the performance of eR2R was poor, prone to change even when negative and unable to meaningfully contribute to discharge planning.

Rates and Levels of Elite Sport Participation at 5 Years After Revision ACL Reconstruction.

BACKGROUND: There is a paucity of data regarding return to play (RTP), level of competition, and longevity of play after revision of anterior cruciate ligament (ACL) reconstruction (ACLR) in elite athletes. PURPOSE: To report RTP rates and competition levels in elite athletes at the point of RTP, as well as at 2 and 5 years after revision ACLR, and the effect of meniscal and chondral pathology at revision surgery on these outcomes. STUDY DESIGN: Case series; Level of evidence, 4. METHODS: A retrospective review of a consecutive series of all revision ACLRs undertaken by the senior author between 2009 and 2019, with a minimum 2-year follow-up, was carried out. Outcome measures were RTP rates and competition level. RESULTS: A total of 49 knees in 48 elite athletes met the inclusion criteria. After revision ACLR, 43 (87.8%) elite athletes achieved RTP, of whom 75.5% were at the same level. At 2 years after surgery, 39 (79.6%) were still playing, 25 (51%) at the same level; at 5 years after surgery, 20 (44.4%) were still playing, 9 (20%) at the same level. Elite athletes with <50% thickness or no articular cartilage lesions were more likely to RTP (94.6% vs 66.7%; P = .026), as well as return to the same competition level (83.8% vs 50%; P = .047), compared with those with ≥50% thickness chondral lesions. Those without medial meniscal pathology were more likely to RTP at the same level after revision surgery (94.4% vs 64.5%; P = .036). The median time elite athletes continued to play after revision ACLR was 73 months (95% CI, 43.4-102.6); 23 months at the same level (95% CI, 13.6-32.4). The probability of still playing at 5 years after surgery was 55.9%, with a 22.5% chance of maintaining preinjury competition level. CONCLUSION: In elite athletes, RTP rates and competition level decreased over time after revision ACLR. The presence of >50% thickness chondral pathology was associated with lower RTP rates and competition level at RTP time, while medial meniscal pathology was associated with lower competition level at RTP.

The impact of changes in coding on mortality reports using the example of sepsis.

OBJECTIVES: NHS Digital issued new guidance on sepsis coding in April 2017 which was further modified in April 2018. During these timeframes some centres reported increased sepsis associated mortality, whilst others reported reduced mortality, in some cases coincident with specific quality improvement programmes. We hypothesised that changes in reported mortality could not be separated from changes in coding practice. METHODS: Hospital Episode Statistics from the Admitted Patient Care dataset for NHS hospitals in England, from April 2016 to March 2020 were analysed. Admissions of adults with sepsis: an International Classification of Diseases 10 (ICD-10) code associated with the Agency for Healthcare Research and Quality Clinical Classifications Software class 'Septicaemia (except in labour)', were assessed. Patient comorbidities were defined by other ICD-10 codes recorded within the admission episode. RESULTS: 1,081,565 hospital episodes with a coded diagnosis of sepsis were studied. After April 2017 there was a significant increase in admission episodes with sepsis coded as the primary reason for admission. There were significant changes in the case-mix of patients with a primary diagnosis of sepsis after April 2017. An analysis of case-mix, hospital and year treated as random effects, defined a small reduction in sepsis associated mortality across England following the first change in coding guidance. No centre specific improvement in outcome could be separated from these random-effects. CONCLUSION: Changes in sepsis coding practice altered case-mix and case selection, in ways that varied between centres. This was associated with changes in centre-specific sepsis associated mortality, over time. According to the direction of change these may be interpreted either as requiring local investigation for cause or as supporting coincident changes in clinical practice. A whole system analysis showed that centre specific changes in mortality cannot be separated from system-wide changes. Caution is therefore required when interpreting sepsis outcomes in England, particularly when using single centre studies to inform or support guidance or policy.

Functional outcomes in patient specific instrumentation vs. conventional instrumentation for total knee arthroplasty; a systematic review and meta-analysis of prospective studies.

BACKGROUND: Total Knee Arthroplasty (TKA) is an established surgical option for knee osteoarthritis (OA). There are varying perceptions of the most suitable surgical technique for making bone cuts in TKA. Conventional Instrumentation (CI) uses generic cutting guides (extra- and intra-medullary) for TKA; however, patient specific instrumentation (PSI) has become a popular alternative amongst surgeons. METHODS: A literature search of electronic databases Embase, Medline and registry platform portals was conducted on the 16th May 2021. The search was performed using a predesigned search strategy. Eligible studies were critically appraised for methodological quality. The primary outcome measure was Knee Society Function Score. Functional scores were also collected for the secondary outcome measures: Oxford Knee Score (OKS), Western Ontario and McMaster Universities Arthritis Index (WOMAC), Knee Injury and Osteoarthritis Outcome Score (KOOS) and Visual Analog Scale (VAS) for pain. Review Manager 5.3 was used for all data synthesis and analysis. RESULTS: There is no conclusive evidence in the literature to suggest that PSI or CI instrumentation is better for functional outcomes. 23 studies were identified for inclusion in this study. Twenty-two studies (18 randomised controlled trials and 4 prospective studies) were included in the meta analysis, with a total of 2277 total knee arthroplasties. There were 1154 PSI TKA and 1123 CI TKA. The majority of outcomes at 3-months, 6-months and 12 show no statistical difference. There was statistical significance at 24 months in favour of PSI group for KSS function (mean difference 4.36, 95% confidence interval 1.83-6.89). The mean difference did not exceed the MCID of 6.4. KSS knee scores demonstrated statistical significance at 24 months (mean difference 2.37, 95% confidence interval (CI) 0.42-4.31), with a MCID of 5.9. WOMAC scores were found to be statistically significant favouring PSI group at 12 months (mean difference -3.47, 95% confidence interval (CI) -6.57- -0.36) and 24 months (mean difference -0.65, 95% confidence interval (CI) -1.28--0.03), with high level of bias noted in the studies and a MCID of 10. CONCLUSIONS: This meta-analysis of level 1 and level 2 evidence shows there is no clinical difference when comparing PSI and CI KSS function scores for TKA at definitive post operative time points (3 months, 6 months, 12 months and 24 months). Within the secondary outcomes for this study, there was no clinical difference between PSI and CI for TKA. Although there was no clinical difference between PSI and CI for TKA, there was statistical significance noted at 24 months in favour of PSI compared to CI for TKA when considering KSS function, KSS knee scores and WOMAC scores. Studies included in this meta-analysis were of limited cohort size and prospective studies were prone to methodological bias. The current literature is limited and insufficiently robust to make explicit conclusions and therefore further high-powered robust RCTs are required at specific time points.

Machine learning of COVID-19 clinical data identifies population structures with therapeutic potential.

Clinical outcomes for patients with COVID-19 are heterogeneous and there is interest in defining subgroups for prognostic modeling and development of treatment algorithms. We obtained 28 demographic and laboratory variables in patients admitted to hospital with COVID-19. These comprised a training cohort (n = 6099) and two validation cohorts during the first and second waves of the pandemic (n = 996; n = 1011). Uniform manifold approximation and projection (UMAP) dimension reduction and Gaussian mixture model (GMM) analysis was used to define patient clusters. 29 clusters were defined in the training cohort and associated with markedly different mortality rates, which were predictive within confirmation datasets. Deconvolution of clinical features within clusters identified unexpected relationships between variables. Integration of large datasets using UMAP-assisted clustering can therefore identify patient subgroups with prognostic information and uncovers unexpected interactions between clinical variables. This application of machine learning represents a powerful approach for delineating disease pathogenesis and potential therapeutic interventions.

A Triple-Strand Anatomic Medial Collateral Ligament Reconstruction Restores Knee Stability More Completely Than a Double-Strand Reconstruction: A Biomechanical Study In Vitro.

BACKGROUND: There are many descriptions of medial collateral ligament (MCL) reconstruction, but they may not reproduce the anatomic structures and there is little evidence of their biomechanical performance. PURPOSE: To investigate the ability of "anatomic" MCL reconstruction to restore native stability after grade III MCL plus posteromedial capsule/posterior oblique ligament injuries in vitro. STUDY DESIGN: Controlled laboratory study. METHODS: Twelve cadaveric knees were mounted in a kinematic testing rig to impose tibial displacing loads while the knee was flexed-extended: 88-N anteroposterior translation, 5-N·m internal-external rotation, 8-N·m valgus-varus, and combined anterior translation plus external rotation (anteromedial rotatory instability). Joint motion was measured via optical trackers with the knee intact; after superficial MCL (sMCL), deep MCL (dMCL), and posterior oblique ligament transection; and then after MCL double- and triple-strand reconstructions. Double strands reproduced the sMCL and posterior oblique ligament and triple-strands the sMCL, dMCL, and posterior oblique ligament. The sMCL was placed 5 mm posterior to the epicondyle in the double-strand technique and at the epicondyle in the triple-strand technique. Kinematic changes were examined by repeated measures 2-way analysis of variance with posttesting. RESULTS: Transection of the sMCL, dMCL, and posterior oblique ligament increased valgus rotation (5° mean) and external rotation (9° mean). The double-strand reconstruction controlled valgus in extension but allowed 5° excess valgus in flexion and did not restore external rotation (7° excess). The triple-strand reconstruction restored both external rotation and valgus throughout flexion. CONCLUSION: In a cadaveric model, a triple-strand reconstruction including a dMCL graft restored native external rotation, while a double-strand reconstruction without a dMCL graft did not. A reconstruction with the sMCL graft placed isometrically on the medial epicondyle restored valgus rotation across the arc of knee flexion, whereas a reconstruction with a more posteriorly placed sMCL graft slackened with knee flexion. CLINICAL RELEVANCE: An MCL injury may rupture the anteromedial capsule and dMCL, causing anteromedial rotatory instability. Persistent MCL instability increases the likelihood of ACL graft failure after combined injury. A reconstruction with an anteromedial dMCL graft restored native external rotation, which may help to unload/protect an ACL graft. It is important to locate the sMCL graft isometrically at the femoral epicondyle to restore valgus across flexion.

Medial Collateral Ligament Reconstruction for Anteromedial Instability of the Knee: A Biomechanical Study In Vitro.

BACKGROUND: Although a medial collateral ligament (MCL) injury is associated with anteromedial rotatory instability (AMRI) and often with an anterior cruciate ligament (ACL) injury, there has been little work to develop anteromedial (AM) reconstruction to address this laxity. PURPOSE: To measure the ability of a novel "anatomic" AM reconstruction technique to restore native knee laxity for isolated AM insufficiency and combined AM plus posteromedial insufficiency. STUDY DESIGN: Controlled laboratory study. METHODS: A total of 12 cadaveric knees were mounted in a kinematic testing rig that allowed the tibia to be loaded while the knee flexed-extended 0° to 100° with 88-N anteroposterior translation, 5-N·m internal rotation-external rotation (ER), 8-N·m valgus, and combined anterior translation plus ER to simulate AMRI. Joint motion was measured using optical trackers with the knee intact, after superficial MCL (sMCL) and deep MCL (dMCL) transection, and after AM reconstruction of the sMCL and dMCL with semitendinosus autografts. The posteromedial capsule (PMC)/posterior oblique ligament (POL) was then transected to induce a grade 3 medial injury, and kinematic measurements were repeated afterward and again after removing the grafts. Laxity changes were examined using repeated-measures analysis of variance and post-testing. RESULTS: sMCL and dMCL deficiency increased valgus, ER, and AMRI laxities. These laxities did not differ from native values after AM reconstruction. Additional PMC/POL deficiency did not increase these laxities significantly but did increase internal rotation laxity near knee extension; this was not controlled by AM reconstruction. CONCLUSION: AM reconstruction eliminated AMRI after transection of the dMCL and sMCL, and also eliminated AMRI after additional PMC/POL transection. CLINICAL RELEVANCE: Many MCL injuries occur in combination with ACL injuries, causing AMRI. These injuries may rupture the AM capsule and dMCL. Unaddressed MCL deficiency leads to an increased ACL reconstruction failure rate. A dMCL construct oriented anterodistally across the medial joint line, along with an sMCL graft, can restore native knee ER laxity. PMC/POL lesions did not contribute to AMRI.

Evaluation of NEWS2 response thresholds in a retrospective observational study from a UK acute hospital.

OBJECTIVE: Use of National Early Warning Score 2 (NEWS2) has been mandated in adults admitted to acute hospitals in England. Urgent clinical review is recommended at NEWS2 ≥5. This policy is recognised as requiring ongoing evaluation. We assessed NEWS2 acquisition, alerting at key thresholds and patient outcomes, to understand how response recommendations would affect clinical resource allocation. SETTING: Adult acute hospital in England. DESIGN: Retrospective observational cohort study. PARTICIPANTS: 100 362 consecutive admissions between November 2018 and July 2019. OUTCOME: Death or admission to intensive care unit within 24 hours of a score. METHODS: NEWS2 were assembled as single scores from consecutive 24-hour time frames, (the first NEWS2 termed 'Index-NEWS2'), or as all scores from the admission (termed All-NEWS2). Scores were excluded when a patient was in intensive care, in the presence of a decision not to attempt cardiopulmonary resuscitation, or on day 1 of elective admission. RESULTS: A mean of 4.5 NEWS2 were acquired per patient per day. The outcome rate following an Index-NEWS2 was 0.22/100 patient-days. The sensitivity of outcome prediction at Index-NEWS2 ≥5=0.46, and number needed to evaluate (NNE)=52. At this threshold, a mean of 37.6 alerts/100 patient-days would be generated, occurring in 12.3% of patients on any single day. Threshold changes to increase sensitivity by 0.1, would result in a twofold increase in alert rate and 1.5-fold increase in NNE. Overall, NEWS2 classification performance was significantly worse on Index-scores than All-scores (c-statistic=0.78 vs 0.85; p<0.001). CONCLUSIONS: The combination of low event-rate, high alert-rate and low sensitivity, in patients for cardiopulmonary resuscitation, means that at current NEWS2 thresholds, resource demand would be sufficient to meaningfully compete with other pathways to clinical evaluation. In analyses that epitomise in-patient screening, NEWS2 performance suggests a need for re-evaluation of current response recommendations in this population.

Evaluating semantic similarity methods for comparison of text-derived phenotype profiles.

BACKGROUND: Semantic similarity is a valuable tool for analysis in biomedicine. When applied to phenotype profiles derived from clinical text, they have the capacity to enable and enhance 'patient-like me' analyses, automated coding, differential diagnosis, and outcome prediction. While a large body of work exists exploring the use of semantic similarity for multiple tasks, including protein interaction prediction, and rare disease differential diagnosis, there is less work exploring comparison of patient phenotype profiles for clinical tasks. Moreover, there are no experimental explorations of optimal parameters or better methods in the area. METHODS: We develop a platform for reproducible benchmarking and comparison of experimental conditions for patient phentoype similarity. Using the platform, we evaluate the task of ranking shared primary diagnosis from uncurated phenotype profiles derived from all text narrative associated with admissions in the medical information mart for intensive care (MIMIC-III). RESULTS: 300 semantic similarity configurations were evaluated, as well as one embedding-based approach. On average, measures that did not make use of an external information content measure performed slightly better, however the best-performing configurations when measured by area under receiver operating characteristic curve and Top Ten Accuracy used term-specificity and annotation-frequency measures. CONCLUSION: We identified and interpreted the performance of a large number of semantic similarity configurations for the task of classifying diagnosis from text-derived phenotype profiles in one setting. We also provided a basis for further research on other settings and related tasks in the area.

Introduction of Systematized Nomenclature of Medicine-Clinical Terms Coding Into an Electronic Health Record and Evaluation of its Impact: Qualitative and Quantitative Study.

BACKGROUND: This study describes the conversion within an existing electronic health record (EHR) from the International Classification of Diseases, Tenth Revision coding system to the SNOMED-CT (Systematized Nomenclature of Medicine-Clinical Terms) for the collection of patient histories and diagnoses. The setting is a large acute hospital that is designing and building its own EHR. Well-designed EHRs create opportunities for continuous data collection, which can be used in clinical decision support rules to drive patient safety. Collected data can be exchanged across health care systems to support patients in all health care settings. Data can be used for research to prevent diseases and protect future populations. OBJECTIVE: The aim of this study was to migrate a current EHR, with all relevant patient data, to the SNOMED-CT coding system to optimize clinical use and clinical decision support, facilitate data sharing across organizational boundaries for national programs, and enable remodeling of medical pathways. METHODS: The study used qualitative and quantitative data to understand the successes and gaps in the project, clinician attitudes toward the new tool, and the future use of the tool. RESULTS: The new coding system (tool) was well received and immediately widely used in all specialties. This resulted in increased, accurate, and clinically relevant data collection. Clinicians appreciated the increased depth and detail of the new coding, welcomed the potential for both data sharing and research, and provided extensive feedback for further development. CONCLUSIONS: Successful implementation of the new system aligned the University Hospitals Birmingham NHS Foundation Trust with national strategy and can be used as a blueprint for similar projects in other health care settings.

An informatics consult approach for generating clinical evidence for treatment decisions.

BACKGROUND: An Informatics Consult has been proposed in which clinicians request novel evidence from large scale health data resources, tailored to the treatment of a specific patient. However, the availability of such consultations is lacking. We seek to provide an Informatics Consult for a situation where a treatment indication and contraindication coexist in the same patient, i.e., anti-coagulation use for stroke prevention in a patient with both atrial fibrillation (AF) and liver cirrhosis. METHODS: We examined four sources of evidence for the effect of warfarin on stroke risk or all-cause mortality from: (1) randomised controlled trials (RCTs), (2) meta-analysis of prior observational studies, (3) trial emulation (using population electronic health records (N = 3,854,710) and (4) genetic evidence (Mendelian randomisation). We developed prototype forms to request an Informatics Consult and return of results in electronic health record systems. RESULTS: We found 0 RCT reports and 0 trials recruiting for patients with AF and cirrhosis. We found broad concordance across the three new sources of evidence we generated. Meta-analysis of prior observational studies showed that warfarin use was associated with lower stroke risk (hazard ratio [HR] = 0.71, CI 0.39-1.29). In a target trial emulation, warfarin was associated with lower all-cause mortality (HR = 0.61, CI 0.49-0.76) and ischaemic stroke (HR = 0.27, CI 0.08-0.91). Mendelian randomisation served as a drug target validation where we found that lower levels of vitamin K1 (warfarin is a vitamin K1 antagonist) are associated with lower stroke risk. A pilot survey with an independent sample of 34 clinicians revealed that 85% of clinicians found information on prognosis useful and that 79% thought that they should have access to the Informatics Consult as a service within their healthcare systems. We identified candidate steps for automation to scale evidence generation and to accelerate the return of results. CONCLUSION: We performed a proof-of-concept Informatics Consult for evidence generation, which may inform treatment decisions in situations where there is dearth of randomised trials. Patients are surprised to know that their clinicians are currently not able to learn in clinic from data on 'patients like me'. We identify the key challenges in offering such an Informatics Consult as a service.

Rapid adaptation of a local healthcare digital system to COVID-19: The experience in Birmingham (UK).

BACKGROUND: The COVID-19 pandemic created unprecedented pressure on hospitals globally. Digital tools developed before the crisis provided novel aspects of management, and new digital tools were rapidly developed as the crisis progressed. In our institution, a digitally mature NHS Trust in England which builds software systems, development during the early months of the crisis allowed increased patient safety and care, efficient management of the hospital and publication of data. The aim of this paper is to present this experience as a case study, describing development and lessons learned applicable to wider electronic healthcare record development. METHODS: Request, triage, build and test processes for the digital systems were altered in response to the pandemic. Senior Responsible Officers appointed for the emergency triaged all changes and were supported by expert opinion and research active clinicians. Build and test cycles were compressed. New tools were built or existing ones modified in the central Electronic Healthcare Record, PICS (Prescribing, Information and Communication System), Clinical Dashboards and video platforms for remote consultation were developed. FINDINGS: 2236 patients were admitted to UHB with suspected COVID-19 between March and May 2020. Dashboards and visualisation tools enabled by efficient real-time data collection for all new patients, contributed to strategic, operational and clinical decision making.Over 70 urgent changes were made to digital systems, including a screening proforma, improved infection control functions, help and order panels, data dashboards, and updated prescribing features. Novel uses were found for existing functions. INTERPRETATION: Digital tools contributed to a co-ordinated response to COVID-19 in an area with a high disease burden. Change management processes were modified during the pandemic and successfully delivered rapid software modifications and new tools. Principal benefits came from the ability to adapt systems to rapidly changing clinical situations. Lessons learned from this intense development period are widely applicable to EHR development. LAY SUMMARY: Digital tools, which are well designed, can help clinicians and safeguard patients. Health crises such as the COVID pandemic drove rapid development of digital tools. This case study outlines accelerated development within a governance framework that successfully reused existing tools and built new ones. The lessons from this development are generalizable to digital developments in healthcare.

Multi-faceted semantic clustering with text-derived phenotypes.

Identification of ontology concepts in clinical narrative text enables the creation of phenotype profiles that can be associated with clinical entities, such as patients or drugs. Constructing patient phenotype profiles using formal ontologies enables their analysis via semantic similarity, in turn enabling the use of background knowledge in clustering or classification analyses. However, traditional semantic similarity approaches collapse complex relationships between patient phenotypes into a unitary similarity scores for each pair of patients. Moreover, single scores may be based only on matching terms with the greatest information content (IC), ignoring other dimensions of patient similarity. This process necessarily leads to a loss of information in the resulting representation of patient similarity, and is especially apparent when using very large text-derived and highly multi-morbid phenotype profiles. Moreover, it renders finding a biological explanation for similarity very difficult; the black box problem. In this article, we explore the generation of multiple semantic similarity scores for patients based on different facets of their phenotypic manifestation, which we define through different sub-graphs in the Human Phenotype Ontology. We further present a new methodology for deriving sets of qualitative class descriptions for groups of entities described by ontology terms. Leveraging this strategy to obtain meaningful explanations for our semantic clusters alongside other evaluation techniques, we show that semantic clustering with ontology-derived facets enables the representation, and thus identification of, clinically relevant phenotype relationships not easily recoverable using overall clustering alone. In this way, we demonstrate the potential of faceted semantic clustering for gaining a deeper and more nuanced understanding of text-derived patient phenotypes.