Inter-rater and intrarater reliability of the South African Triage Scale in low-resource settings of Haiti and Afghanistan.

OBJECTIVE: The South African Triage Scale (SATS) has demonstrated good validity in the EDs of Médecins Sans Frontières (MSF)-supported sites in Afghanistan and Haiti; however, corresponding reliability in these settings has not yet been reported on. This study set out to assess the inter-rater and intrarater reliability of the SATS in four MSF-supported EDs in Afghanistan and Haiti (two trauma-only EDs and two mixed (including both medical and trauma cases) EDs). METHODS: Under classroom conditions between December 2013 and February 2014, ED nurses at each site assigned triage ratings to a set of context-specific vignettes (written case reports of ED patients). Inter-rater reliability was assessed by comparing triage ratings among nurses; intrarater reliability was assessed by asking the nurses to retriage 10 random vignettes from the original set and comparing these duplicate ratings. Inter-rater reliability was calculated using the unweighted kappa, linearly weighted kappa and quadratically weighted kappa (QWK) statistics, and the intraclass correlation coefficient (ICC). Intrarater reliability was calculated according to the percentage of exact agreement and the percentage of agreement allowing for one level of discrepancy in triage ratings. The correlation between years of nursing experience and reliability of the SATS was assessed based on comparison of ICCs and the respective 95% CIs. RESULTS: A total of 67 nurses agreed to participate in the study: In Afghanistan there were 19 nurses from Kunduz Trauma Centre and nine from Ahmed Shah Baba; in Haiti, there were 20 nurses from Martissant Emergency Centre and 19 from Tabarre Surgical and Trauma Centre. Inter-rater agreement was moderate across all sites (ICC range: 0.50-0.60; QWK range: 0.50-0.59) apart from the trauma ED in Haiti where it was moderate to substantial (ICC: 0.58; QWK: 0.61). Intrarater agreement was similar across the four sites (68%-74% exact agreement); when allowing for a one-level discrepancy in triage ratings, intrarater reliability was near perfect across all sites (96%-99%). No significant correlation was found between years of nursing experience and reliability. CONCLUSION: The SATS has moderate reliability in different EDs in Afghanistan and Haiti. These findings, together with concurrent findings showing that the SATS has good validity in the same settings, provide evidence to suggest that SATS is suitable in trauma-only and mixed EDs in low-resource settings.

Is the South African Triage Scale valid for use in Afghanistan, Haiti and Sierra Leone?

OBJECTIVE: To assess the validity of the South African Triage Scale (SATS) in four Médecins Sans Frontières (MSF)-supported emergency departments (ED, two trauma-only sites, one mixed site (both medical and trauma cases) and one paediatric-only site) in Afghanistan, Haiti and Sierra Leone. METHODS: This was a retrospective cohort study conducted between June 2013 and June 2014. Validity was assessed by comparing patients' SATS ratings with their final ED outcome (ie, hospital admission, death or discharge). RESULTS: In the two trauma settings, the SATS demonstrated good validity: it accurately predicted an increase in the likelihood of mortality and hospitalisation across incremental acuity levels (p<0.001) and ED outcomes for 'green' and 'red' patients matched the predicted ED outcomes in 84%-99% of cases. In the mixed ED, the SATS was able to predict an incremental increase in hospitalisation (p<0.001) across both trauma and non-trauma cases. In the paediatric-only settings, SATS was able to predict an incremental increase in hospitalisation in the non-trauma cases only (p<0.001). However, 87% (non-trauma) and 94% (trauma) of 'red' patients in the mixed-medical setting were overtriaged and 76% (non-trauma) and 100% (trauma) of 'green' patients in the paediatric settings were undertriaged. CONCLUSION: The SATS is a valid tool for trauma-only settings in low-resource countries. Its use in mixed settings seems justified, but context-specific assessments would seem prudent. Finally, in paediatric settings with endemic malaria, adding haemoglobin level to the SATS discriminator list may help to improve the undertriage of patients with malaria.

The modified south African triage scale system for mortality prediction in resource-constrained emergency surgical centers: a retrospective cohort study.

BACKGROUND: The South African Triage Scale (SATS) was developed to facilitate patient triage in emergency departments (EDs) and is used by Médecins Sans Frontières (MSF) in low-resource environments. The aim was to determine if SATS data, reason for admission, and patient age can be used to develop and validate a model predicting the in-hospital risk of death in emergency surgical centers and to compare the model's discriminative power with that of the four SATS categories alone. METHODS: We used data from a cohort hospitalized at the Nap Kenbe Surgical Hospital in Haiti from January 2013 to June 2015. We based our analysis on a multivariate logistic regression of the probability of death. Age cutoff, reason for admission categorized into nine groups according to MSF classifications, and SATS triage category (red, orange, yellow, and green) were used as candidate parameters for the analysis of factors associated with mortality. Stepwise backward elimination was performed for the selection of risk factors with retention of predictors with P < 0.05, and bootstrapping was used for internal validation. The likelihood ratio test was used to compare the combined and restricted models. These models were also applied to data from a cohort of patients from the Kunduz Trauma Center, Afghanistan, to validate mortality prediction in an external trauma patients population. RESULTS: A total of 7618 consecutive hospitalized patients from the Nap Kenbe Hospital were analyzed. Variables independently associated with in-hospital mortality were age > 45 and < = 65 years (odds ratio, 2.04), age > 65 years (odds ratio, 5.15) and the red (odds ratio, 65.08), orange (odds ratio, 3.5), and non-trauma (odds ratio, 3.15) categories. The combined model had an area under the receiver operating characteristic curve (AUROC) of 0.8723 and an AUROC corrected for optimism of 0.8601. The AUROC of the model run on the external data-set was 0.8340. The likelihood ratio test was highly significant in favor of the combined model for both the original and external data-sets. CONCLUSIONS: SATS category, patient age, and reason for admission can be used to predict in-hospital mortality. This predictive model had good discriminative ability to identify ED patients at a high risk of death and performed better than the SATS alone.

Regional Anesthesia for Painful Injuries after Disasters (RAPID): study protocol for a randomized controlled trial.

BACKGROUND: Lower extremity trauma during earthquakes accounts for the largest burden of disaster-related injuries. Insufficient pain management is common in resource-limited disaster settings, and regional anesthesia (RA) may reduce pain in injured patients beyond current standards of care. To date, no controlled trials have been conducted to evaluate the use of RA for pain management in a disaster setting. METHODS/DESIGN: The Regional Anesthesia for Painful Injuries after Disasters (RAPID) study aims to evaluate whether regional anesthesia (RA), either with or without ultrasound (US) guidance, can reduce pain from earthquake-related lower limb injuries in a disaster setting. The proposed study is a blinded, randomized controlled equivalence trial among earthquake victims with serious lower extremity injuries in a resource-limited setting. After obtaining informed consent, study participants will be randomized in a 1:1:1 allocation to either: standard care (parenteral morphine at 0.1 mg/kg); standard care plus a landmark-guided fascia iliaca compartment block (FICB); or standard care plus an US-guided femoral nerve block. General practice humanitarian response providers who have undergone a focused training in RA will perform nerve blocks with 20 ml 0.5 % levobupivacaine. US sham activities will be used in the standard care and FICB arms and a normal saline injection will be given to the control group to blind both participants and nonresearch team providers. The primary outcome measure will be the summed pain intensity difference calculated using a standard 11-point Numerical Rating Scale reported by patients over 24 h of follow-up. Secondary outcome measures will include overall analgesic requirements, adverse events, and participant satisfaction. DISCUSSION: Given the high burden of lower extremity injuries in the aftermath of earthquakes and the currently limited treatment options, research into adjuvant interventions for pain management of these injuries is necessary. While anecdotal reports on the use of RA for patients injured during earthquakes exist, no controlled studies have been undertaken. If demonstrated to be effective in a disaster setting, RA has the potential to significantly assist in reducing both acute suffering and long-term complications for survivors of earthquake trauma. TRIAL REGISTRATION: ClinicalTrials.gov ( NCT02698228 ), registered on 16 February 2016.

Emergency department care for trauma patients in settings of active conflict versus urban violence: all of the same calibre?

BACKGROUND: Trauma is a leading cause of death and represents a major problem in developing countries where access to good quality emergency care is limited. Médecins Sans Frontières delivered a standard package of care in two trauma emergency departments (EDs) in different violence settings: Kunduz, Afghanistan, and Tabarre, Haiti. This study aims to assess whether this standard package resulted in similar performance in these very different contexts. METHODS: A cross-sectional study using routine programme data, comparing patient characteristics and outcomes in two EDs over the course of 2014. RESULTS: 31 158 patients presented to the EDs: 22 076 in Kunduz and 9082 in Tabarre. Patient characteristics, such as delay in presentation (29.6% over 24 h in Kunduz, compared to 8.4% in Tabarre), triage score, and morbidity pattern differed significantly between settings. Nevertheless, both EDs showed an excellent performance, demonstrating low proportions of mortality (0.1% for both settings) and left without being seen (1.3% for both settings), and acceptable triage performance. Physicians' maximum working capacity was exceeded in both centres, and mainly during rush hours. CONCLUSIONS: This study supports for the first time the plausibility of using the same ED package in different settings. Mapping of patient attendance is essential for planning of human resources needs.

Providing emergency care and assessing a patient triage system in a referral hospital in Somaliland: a cross-sectional study.

BACKGROUND: In resource-poor settings, where health systems are frequently stretched to their capacity, access to emergency care is often limited. Triage systems have been proposed as a tool to ensure efficiency and optimal use of emergency resources in such contexts. However, evidence on the practice of emergency care and the implementation of triage systems in such settings, is scarce. This study aimed to assess emergency care provision in the Burao district hospital in Somaliland, including the application of the South African Triage Scale (SATS) tool. METHODS: A cross-sectional descriptive study was undertaken. Routine programme data of all patients presenting at the Emergency Department (ED) of Burao Hospital during its first year of service (January to December 2012) were analysed. The American College of Surgeons Committee on Trauma (ACSCOT) indicators were used as SATS targets for high priority emergency cases ("high acuity" proportion), overtriage and undertriage (with thresholds of >25%, <50% and <10%, respectively). RESULTS: In 2012, among 7212 patients presented to the ED, 41% were female, and 18% were aged less than five. Only 21% of these patients sought care at the ED within 24 hours of developing symptoms. The high acuity proportion was 22.3%, while the overtriage (40%) and undertriage (9%) rates were below the pre-set thresholds. The overall mortality rate was 1.3% and the abandon rate 2.0%. The outcomes of patients corresponds well with the color code assigned using SATS. CONCLUSION: This is the first study assessing the implementation of SATS in a post-conflict and resource-limited African setting showing that most indicators met the expected standards. In particular, specific attention is needed to improve the relatively low rate of true emergency cases, delays in patient presentation and in timely provision of care within the ED. This study also highlights the need for development of emergency care thresholds that are more adapted to resource-poor contexts. These issues are discussed.

Reliability and accuracy of the South African Triage Scale when used by nurses in the emergency department of Timergara Hospital, Pakistan.

BACKGROUND: Triage is one of the core requirements for the provision of effective emergency care and has been shown to reduce patient mortality. However, in low- and middle-income countries this strategy is underused, under-resourced and poorly researched. OBJECTIVE: To assess the inter- and intra-rater reliability and accuracy of nurse triage ratings when using the South African Triage Scale (SATS) in an emergency department (ED) in Timergara, Pakistan. METHODS: Fifteen ED nurses assigned triage ratings to a set of 42 reference vignettes (written case reports of ED patients) under classroom conditions. Inter-rater reliability was assessed by comparing these triage ratings; intra-rater reliability was assessed by asking the nurses to re-triage 10 random vignettes from the original set of 42 vignettes and comparing these duplicate ratings. Accuracy of the nurse ratings was measured against the reference standard. RESULTS: Inter-rater reliability was substantial (intraclass correlation coefficient 0.77; 95% confidence interval (CI) 0.69 - 0.85). The intra-rater agreement was also high with 87% exact agreement (95% CI 67 - 100) and 100% agreement allowing for a one-level discrepancy in triage ratings. Overall, the SATS had high specificity (97%) and moderate sensitivity (70%). Across all acuity levels the proportion of over-triage did not exceed the acceptable threshold of 30 - 50%. Under-triage was acceptable for all except emergency cases (66%). CONCLUSION: ED nurses in Pakistan can reliably use the SATS to assign triage acuity ratings. While the tool is accurate for 'very urgent' and 'routine' cases, importantly, it may under-triage 'emergency' cases requiring immediate attention. Approaches that will improve accuracy and validity are discussed.