Geographical validation of the Smart Triage Model by age group.

Infectious diseases in neonates account for half of the under-five mortality in low- and middle-income countries. Data-driven algorithms such as clinical prediction models can be used to efficiently detect critically ill children in order to optimize care and reduce mortality. Thus far, only a handful of prediction models have been externally validated and are limited to neonatal in-hospital mortality. The aim of this study is to externally validate a previously derived clinical prediction model (Smart Triage) using a combined prospective baseline cohort from Uganda and Kenya with a composite endpoint of hospital admission, mortality, and readmission. We evaluated model discrimination using area under the receiver-operator curve (AUROC) and visualized calibration plots with age subsets (< 30 days, ≤ 2 months, ≤ 6 months, and < 5 years). Due to reduced performance in neonates (< 1 month), we re-estimated the intercept and coefficients and selected new thresholds to maximize sensitivity and specificity. 11595 participants under the age of five (under-5) were included in the analysis. The proportion with an endpoint ranged from 8.9% in all children under-5 (including neonates) to 26% in the neonatal subset alone. The model achieved good discrimination for children under-5 with AUROC of 0.81 (95% CI: 0.79-0.82) but poor discrimination for neonates with AUROC of 0.62 (95% CI: 0.55-0.70). Sensitivity at the low-risk thresholds (CI) were 85% (83%-87%) and 68% (58%-76%) for children under-5 and neonates, respectively. After model revision for neonates, we achieved an AUROC of 0.83 (95% CI: 0.79-0.87) with 13% and 41% as the low- and high-risk thresholds, respectively. The updated Smart Triage performs well in its predictive ability across different age groups and can be incorporated into current triage guidelines at local healthcare facilities. Additional validation of the model is indicated, especially for the neonatal model.

External validation of a paediatric Smart triage model for use in resource limited facilities.

Models for digital triage of sick children at emergency departments of hospitals in resource poor settings have been developed. However, prior to their adoption, external validation should be performed to ensure their generalizability. We externally validated a previously published nine-predictor paediatric triage model (Smart Triage) developed in Uganda using data from two hospitals in Kenya. Both discrimination and calibration were assessed, and recalibration was performed by optimizing the intercept for classifying patients into emergency, priority, or non-urgent categories based on low-risk and high-risk thresholds. A total of 2539 patients were eligible at Hospital 1 and 2464 at Hospital 2, and 5003 for both hospitals combined; admission rates were 8.9%, 4.5%, and 6.8%, respectively. The model showed good discrimination, with area under the receiver-operator curve (AUC) of 0.826, 0.784 and 0.821, respectively. The pre-calibrated model at a low-risk threshold of 8% achieved a sensitivity of 93% (95% confidence interval, (CI):89%-96%), 81% (CI:74%-88%), and 89% (CI:85%-92%), respectively, and at a high-risk threshold of 40%, the model achieved a specificity of 86% (CI:84%-87%), 96% (CI:95%-97%), and 91% (CI:90%-92%), respectively. Recalibration improved the graphical fit, but new risk thresholds were required to optimize sensitivity and specificity.The Smart Triage model showed good discrimination on external validation but required recalibration to improve the graphical fit of the calibration plot. There was no change in the order of prioritization of patients following recalibration in the respective triage categories. Recalibration required new site-specific risk thresholds that may not be needed if prioritization based on rank is all that is required. The Smart Triage model shows promise for wider application for use in triage for sick children in different settings.

Smart triage: triage and management of sepsis in children using the point-of-care Pediatric Rapid Sepsis Trigger (PRST) tool.

BACKGROUND: Sepsis is the leading cause of death and disability in children. Every hour of delay in treatment is associated with an escalating risk of morbidity and mortality. The burden of sepsis is greatest in low- and middle-income countries where timely treatment may not occur due to delays in diagnosis and prioritization of critically ill children. To circumvent these challenges, we propose the development and clinical evaluation of a digital triage tool that will identify high risk children and reduce time to treatment. We will also implement and clinically validate a Radio-Frequency Identification system to automate tracking of patients. The mobile platform (mobile device and dashboard) and automated patient tracking system will create a low cost, highly scalable solution for critically ill children, including those with sepsis. METHODS: This is pre-post intervention study consisting of three phases. Phase I will be a baseline period where data is collected on key predictors and outcomes before implementation of the digital triage tool. In Phase I, there will be no changes to healthcare delivery processes in place at the study hospitals. Phase II will involve model derivation, technology development, and usability testing. Phase III will be the intervention period where data is collected on key predictors and outcomes after implementation of the digital triage tool. The primary outcome, time to treatment initiation, will be compared to assess effectiveness of the digital health intervention. DISCUSSION: Smart technology has the potential to overcome the barrier of limited clinical expertise in the identification of the child at risk. This mobile health platform, with sensors and data-driven applications, will provide real-time individualized risk prediction to rapidly triage patients and facilitate timely access to life-saving treatments for children in low- and middle-income countries, where specialists are not regularly available and deaths from sepsis are common. TRIAL REGISTRATION: Clinical Trials.gov Identifier: NCT04304235, Registered 11 March 2020.

Derivation and internal validation of a data-driven prediction model to guide frontline health workers in triaging children under-five in Nairobi, Kenya.

Background: Many hospitalized children in developing countries die from infectious diseases. Early recognition of those who are critically ill coupled with timely treatment can prevent many deaths. A data-driven, electronic triage system to assist frontline health workers in categorizing illness severity is lacking. This study aimed to develop a data-driven parsimonious triage algorithm for children under five years of age. Methods: This was a prospective observational study of children under-five years of age presenting to the outpatient department of Mbagathi Hospital in Nairobi, Kenya between January and June 2018. A study nurse examined participants and recorded history and clinical signs and symptoms using a mobile device with an attached low-cost pulse oximeter sensor. The need for hospital admission was determined independently by the facility clinician and used as the primary outcome in a logistic predictive model. We focused on the selection of variables that could be quickly and easily assessed by low skilled health workers. Results: The admission rate (for more than 24 hours) was 12% (N=138/1,132). We identified an eight-predictor logistic regression model including continuous variables of weight, mid-upper arm circumference, temperature, pulse rate, and transformed oxygen saturation, combined with dichotomous signs of difficulty breathing, lethargy, and inability to drink or breastfeed. This model predicts overnight hospital admission with an area under the receiver operating characteristic curve of 0.88 (95% CI 0.82 to 0.94). Low- and high-risk thresholds of 5% and 25%, respectively were selected to categorize participants into three triage groups for implementation.  Conclusion: A logistic regression model comprised of eight easily understood variables may be useful for triage of children under the age of five based on the probability of need for admission. This model could be used by frontline workers with limited skills in assessing children. External validation is needed before adoption in clinical practice.