Sensitivity and specificity of alternative screening methods for systematic reviews using text mining tools.

OBJECTIVES: To evaluate the impact of text mining (TM) on the sensitivity and specificity of title and abstract screening strategies for systematic reviews (SRs). STUDY DESIGN AND SETTING: Twenty reviewers each evaluated a 500-citation set. We compared five screening methods: conventional double screen (CDS), single screen, double screen with TM, combined double screen and single screen with TM, and single screen with TM. Rayyan, Abstrackr, and SWIFT-Review were used for each TM method. The results of a published SR were used as the reference standard. RESULTS: The mean sensitivity and specificity achieved by CDS were 97.0% (95% confidence interval [CI]: 94.7, 99.3) and 95.0% (95% CI: 93.0, 97.1). When compared with single screen, CDS provided a greater sensitivity without a decrease in specificity. Rayyan, Abstrackr, and SWIFT-Review identified all relevant studies. Specificity was often higher for TM-assisted methods than that for CDS, although with mean differences of only one-to-two percentage points. For every 500 citations not requiring manual screening, 216 minutes (95% CI: 169, 264) could be saved. CONCLUSION: TM-assisted screening methods resulted in similar sensitivity and modestly improved specificity as compared to CDS. The time saved with TM makes this a promising new tool for SR.

The effect of the COVID-19 pandemic on pediatric asthma-related emergency department visits and hospital admissions in Montréal, Quebec: a retrospective cohort study.

BACKGROUND: Asthma is a chronic respiratory condition that affects 10% of Canadian children and is often exacerbated by viral respiratory infections, prompting concerns about the severity of SARS-CoV-2 disease in children with asthma. We compared sociodemographic and clinical characteristics of children presenting to the emergency department and the incidence of these visits, before and during the pandemic. METHODS: We included children aged 0 to 17 years presenting with asthma to 2 tertiary pediatric emergency departments in Montréal, Quebec, between the prepandemic (Jan. 1, 2017, to Mar. 31, 2020) and pandemic (Apr. 1, 2020, to June 30, 2021) periods. We compared the number of emergency department visits and hospital admissions with an interrupted time series analysis and compared the sociodemographic characteristics based on the Canadian Index of Multiple Deprivation (CIMD) and clinical characteristics (including triage level, intensive care admissions, etc.) with Mann-Whitney and χ2 tests. RESULTS: We examined 22 746 asthma-related emergency department visits. During the pandemic, a greater proportion of patients presented a triage level 1 or 2 (19.3% v. 14.7%) and were admitted to the intensive care unit (2.5% v. 1.3%). The patients' CIMD quintile distributions did not differ between the 2 periods. We found a 47% decrease (relative risk [RR] 0.53, 95% confidence interval [CI] 0.37 to 0.76) in emergency department visits and a 49% decrease (RR 0.51, 95% CI 0.34 to 0.76) in hospital admissions during the pandemic. INTERPRETATION: The decrease in asthma-related emergency department visits was observed through the third wave of the pandemic, but children presented with a higher acuity and with no identified sociodemographic changes. Future studies are required to understand individual behaviours that may have led to the increased acuity at presentation observed in this study.

Validation of a Portable Game Controller to Assess Peak Expiratory Flow Against Conventional Spirometry in Children: Cross-sectional Study.

BACKGROUND: International asthma guidelines recommend the monitoring of peak expiratory flow (PEF) as part of asthma self-management in children and adolescents who poorly perceive airflow obstruction, those with a history of severe exacerbations, or those who have difficulty controlling asthma. Measured with a peak flow meter, PEF represents a person's maximum speed of expiration and helps individuals to follow their disease evolution and, ultimately, to prevent asthma exacerbations. However, patient adherence to regular peak flow meter use is poor, particularly in pediatric populations. To address this, we developed an interactive tablet-based game with a portable game controller that can transduce a signal from the user's breath to generate a PEF value. OBJECTIVE: The purpose of this study was to evaluate the concordance between PEF values obtained with the game controller and various measures derived from conventional pulmonary function tests (ie, spirometry) and to synthesize the participants' feedback. METHODS: In this cross-sectional multicenter study, 158 children (aged 8-15 years old) with a diagnosis or suspicion of asthma performed spirometry and played the game in one of two hospital university centers. We evaluated the correlation between PEF measured by both the game controller and spirometry, forced expiratory volume at 1 second (FEV1), and forced expiratory flow at 25%-75% of pulmonary volume (FEF25-75), using Spearman correlation. A Bland-Altman plot was generated for comparison of PEF measured by the game controller against PEF measured by spirometry. A post-game user feedback questionnaire was administered and analyzed. RESULTS: The participants had a mean age of 10.9 (SD 2.5) years, 44% (71/158) were female, and 88% (139/158) were White. On average, the pulmonary function of the participants was normal, including FEV1, PEF, and FEV1/forced vital capacity (FVC). The PEF measured by the game controller was reproducible in 96.2% (152/158) of participants according to standardized criteria. The PEF measured by the game controller presented a good correlation with PEF measured by spirometry (r=0.83, P<.001), with FEV1 (r=0.74, P<.001), and with FEF25-75 (r=0.65, P<.001). The PEF measured by the game controller presented an expected mean bias of -36.4 L/min as compared to PEF measured by spirometry. The participants' feedback was strongly positive, with 78.3% (123/157) reporting they would use the game if they had it at home. CONCLUSIONS: The game controller we developed is an interactive tool appreciated by children with asthma, and the PEF values measured by the game controller are reproducible, with a good correlation to values measured by conventional spirometry. Future studies are necessary to evaluate the clinical impact this novel tool might have on asthma management and its potential use in an out-of-hospital setting.