Sensitivity and specificity of alternative screening methods for systematic reviews using text mining tools.

OBJECTIVES: To evaluate the impact of text mining (TM) on the sensitivity and specificity of title and abstract screening strategies for systematic reviews (SRs). STUDY DESIGN AND SETTING: Twenty reviewers each evaluated a 500-citation set. We compared five screening methods: conventional double screen (CDS), single screen, double screen with TM, combined double screen and single screen with TM, and single screen with TM. Rayyan, Abstrackr, and SWIFT-Review were used for each TM method. The results of a published SR were used as the reference standard. RESULTS: The mean sensitivity and specificity achieved by CDS were 97.0% (95% confidence interval [CI]: 94.7, 99.3) and 95.0% (95% CI: 93.0, 97.1). When compared with single screen, CDS provided a greater sensitivity without a decrease in specificity. Rayyan, Abstrackr, and SWIFT-Review identified all relevant studies. Specificity was often higher for TM-assisted methods than that for CDS, although with mean differences of only one-to-two percentage points. For every 500 citations not requiring manual screening, 216 minutes (95% CI: 169, 264) could be saved. CONCLUSION: TM-assisted screening methods resulted in similar sensitivity and modestly improved specificity as compared to CDS. The time saved with TM makes this a promising new tool for SR.

The co-occurrence of epilepsy and autism: A systematic review.

OBJECTIVE: We aimed to review the literature to determine the incidence and prevalence of autism in epilepsy and epilepsy in autism, conditions that are often comorbid. METHODS: We adhered to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) standards, and the protocol was registered with PROSPERO. MEDLINE, Embase, PsycINFO, and the Cochrane Database of Systematic Reviews were searched from inception until July 4, 2016. Studies were included if they reported an incidence or prevalence of autism in epilepsy or epilepsy in autism. These estimates were described using mean, standard deviation, median, and interquartile range. RESULTS: Seventy-four studies reporting on 283,549 patients were included. The median overall period prevalence of epilepsy in people with autism was 12.1% while the median overall period prevalence of autism in people with epilepsy was 9.0% when including all population types. When excluding studies that investigated patients with syndromic epilepsy or developmental delay, the median overall period prevalence of epilepsy in people with autism was 11.2% while the median overall period prevalence of autism in people with epilepsy was 8.1%. We observed trends for sex as the prevalence of autism in epilepsy was higher in males while the prevalence of epilepsy in autism was higher in females. It is important to interpret these estimates with caution, as there was significant heterogeneity between studies. Meta-regression found no association between study quality and prevalence or incidence estimates (all p-values > 0.05). CONCLUSIONS: The period prevalence of epilepsy in people with autism, and vice versa, was consistently higher than previously reported estimates of the occurrence of these disorders in the general population. These findings highlight the importance of screening for autism in people who have epilepsy and epilepsy in people who have autism and may help shed light on shared pathogenesis between these conditions.

Signs and symptoms of the postictal period in epilepsy: A systematic review and meta-analysis.

OBJECTIVE: The postictal period has many physical, behavioral, and cognitive manifestations associated with it. These signs and symptoms are common, can be quite debilitating, and can have a continued impact long after the seizure has ended. The purpose of this systematic review was to quantify the occurrence of postictal signs and symptoms, along with their frequency and duration in persons with epilepsy. METHODS: Cochrane Database of Systematic Reviews, CINAHL, EMBASE, MEDLINE, PsycINFO, Web of Science, and Scopus were searched from inception to November 29, 2017. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) reporting standards were followed. Search terms included subject headings and text words such as convulsion, epilepsy, seizure, postictal, post seizure, seizure recovery, seizure end, Todd's paresis, and Todd's paralysis. Standardized forms were used to collect various study variables. Abstract and full-text review, data abstraction, and quality assessment were all done in duplicate. Study heterogeneity was assessed using the I-squared test, and a random effects model was used to determine estimates. Publication bias was evaluated using funnel plots. RESULTS: From 7811 abstracts reviewed, 78 articles met eligibility criteria, with 31 postictal manifestations (signs and/or symptoms) described and 45 studies included in the meta-analysis. The majority of studies described postictal headaches, migraines, and psychoses, with mean weighted frequency of 33.0% [95% confidence interval (CI) 26.0-40.0], 16.0% [95% CI 10.0-22.0], and 4.0% [95% CI 2.0-5.0], respectively. The mean weighted proportions of manifestations ranged from 0.5% (subacute postictal aggression) to 96.2% (postictal unresponsiveness) with symptom duration usually lasting <24 h but up to 2 months for physical and cognitive/behavioral symptoms respectively. SIGNIFICANCE: Examining data on the various signs and symptoms of the postictal period will have practical applications for physicians by raising their awareness about these manifestations and informing them about the importance of optimizing their prevention and treatment in epilepsy.

Does the Medical College Admission Test (MCAT) predict licensing examination performance in the Canadian context?

BACKGROUND: Research on the predictive validity of the Medical College Admissions Test (MCAT) on licensing examination performance is varied in its conclusions, with only a few studies examining this relationship in a Canadian context. We assessed the predictive validity of the MCAT on successful performance on the Medical Council of Canada Qualifying Examination (MCCQE) Part 1 by students attending the Cumming School of Medicine. METHODS: Prospective data were collected on MCAT score and sub-section scores, MCCQE decision, multiple mini interview (MMI) performance, gender, and age. The cohort was divided into a derivation cohort (2013 and 2014) and validation cohort (2015 and 2016). Students were dichotomized into pass or fail on MCCQE. Multiple logistic regression in which our dependent variable was MCCQE Part I examination success at the first attempt was used, and potential explanatory variables were age, gender, MCAT total score, and sub-scores for the biological sciences (MCAT-BS), physical sciences, and verbal reasoning, GPA, and MMI ratings. RESULTS: For the derivation cohort MCAT-BS was associated with success on the MCCQE Part I. The odds ratio for this association of 1.37 (95% confidence interval [1.01, 1.85], p = 0.04). When we applied the MCAT-BS to our validation cohort the odds ratio of MCCQE Part I examination success was 1.42 [1.10, 1.83], p = 0.007) and the area under the ROC curve was 0.66 [0.54, 0.79]). CONCLUSION: The MCAT-BS predicted successful performance on the MCCQE Part 1 Examination in the Canadian setting.

Accuracy of an online tool to assess appropriateness for an epilepsy surgery evaluation-A population-based Swedish study.

OBJECTIVE: The Canadian Appropriateness of Epilepsy Surgery (CASES) tool was developed to help physicians identify patients who should be referred for an epilepsy surgery evaluation. The aim of this study was to determine the accuracy of this tool using a population-based cohort registry (the Swedish National Epilepsy Surgery Register) of patients who underwent epilepsy surgery between 1990 and 2012. METHODS: Overall, 1044 patients met eligibility criteria for the study and were deemed to be surgical candidates by epilepsy experts. Demographic and epilepsy related characteristics were examined and summarized using descriptive statistics. A CASES appropriateness score was calculated for each of these patients. Chi squared analyses or fisher's exact tests were used to determine if there were any relationships between demographic and epilepsy related characteristics not captured in the tool and appropriateness scores. RESULTS: The mean appropriateness score was 8.6 and 985 (Sensitivity: 94.35%; 95% CI, 92.77%-95.60%) patients were appropriate, 46 (4.41%; 95% CI, 3.31%-5.84%) were uncertain, and 13 (1.25%; 95% CI, 0.72%-2.13%) were inappropriate for an epilepsy surgery evaluation. The mean necessity score, which was only calculated for the 985 appropriate patients, was 8.7. All 13 inappropriate patients had tried less than two anti-epileptic drugs (AEDs). In addition, age at onset of epilepsy and age at epilepsy surgery were both significantly associated with appropriateness score. CONCLUSIONS: These results demonstrate that the CASES tool is highly sensitive as it designated 94.3% of epilepsy surgery patients as appropriate for an epilepsy surgery evaluation. All of those classified as inappropriate were not drug resistant, as they had not yet tried two AEDs.

Olive Oil and Soybean Oil Based Intravenous Lipid Emulsions, Liver Biochemistry and Clinical Outcomes.

Intravenous lipid emulsions are an essential component of parenteral nutrition (PN). Omega-6 reducing strategies may improve outcomes, including reduced PN associated liver disease, however evidence to support this recommendation is insufficient. The primary objective was to compare serum alkaline phosphatase (ALP), among patients provided with either soybean oil (Intralipid) or predominantly olive oil (Clinoleic) lipid emulsions. In this quasi-experimental study, we reviewed the medical records of surgical and medical adult patients who received lipid emulsions for at least seven consecutive days. Among the 206 patients (110-Intralipid, 96-Clinoleic) there was no significant difference in ALP and remaining liver function tests within 2 weeks of PN therapy initiation between groups, even after control for lipid doses. Macronutrient dosing was similar. Triglyceride level was higher by 0.7 mmol/L in the Clinoleic group; confidence interval 0.21 to 1.1; p = 0.004. The 30-day mortality, length of hospital stay, and proportion of patients admitted to intensive care were not significantly different. The Clinoleic group had a higher infection rate (36% vs. 22%, p = 0.031) and longer intensive care stays (p = 0.045). Well-designed randomized clinical trials comparing these lipid emulsions are necessary to confirm Intralipid superiority over Clinoleic in relation to infections and serum triglycerides.

A longitudinal cohort study on the impact of the clobazam shortage on patients with epilepsy.

OBJECTIVE: Drug shortages are occurring at an increasing rate. From May to October 2016, there was a shortage of a level I critical antiepileptic drug, clobazam. We aimed to study the impact of this shortage on patients with epilepsy. METHODS: Adult patients from Calgary's Comprehensive Epilepsy Program who were taking clobazam were approached to participate in the study. Baseline data from the clinic prospective registry included clinical variables and presurvey patient-reported outcomes (PROs) such as the Global Assessment of Severity of Epilepsy, the Global Assessment of Disability Associated with Seizures, and the Quality of Life in Epilepsy questionnaire. We used a mixed-methods cross-sectional questionnaire via telephone. We analyzed quantitative data using descriptive methods and qualitative data using a phenomenological approach. RESULTS: Of the 85 eligible patients, 84% (n = 71) agreed to participate. Participants ranged from 18 to 78 years old, and 59.2% of participants were female. Overall, 80% of participants experienced some form of medication change due to the shortage. No significant differences were found in the pre- and during-shortage PRO data. However, 6 important themes emerged regarding the impact of the antiepileptic drug shortage on patients: (1) communication and awareness, (2) burden on patients and caregivers, (3) physical impact, (4) psychological impact, (5) health care provider assistance in navigating the shortage, and (6) policy change. SIGNIFICANCE: We examined the impact of the clobazam shortage on patients with epilepsy from the patient's perspective and identified 6 important themes. As a result, we were able to gain insight into what patients need to cope with drug shortages and make recommendations that can help mitigate the impact of shortages on patients in the future. Further research is needed to better understand drug shortages from the patient's perspective in various settings and conditions.

Online tools for individuals with depression and neurologic conditions: A scoping review.

BACKGROUND: Patients with neurologic conditions commonly have depression. Online tools have the potential to improve outcomes in these patients in an efficient and accessible manner. We aimed to identify evidence-informed online tools for patients with comorbid neurologic conditions and depression. METHODS: A scoping review of online tools (free, publicly available, and not requiring a facilitator) for patients with depression and epilepsy, Parkinson disease (PD), multiple sclerosis (MS), traumatic brain injury (TBI), or migraine was conducted. MEDLINE, EMBASE, PsycINFO, Cochrane Database of Systematic Reviews, and Cochrane CENTRAL Register of Controlled Trials were searched from database inception to January 2017 for all 5 neurologic conditions. Gray literature using Google and Google Scholar as well as app stores for both Android and Apple devices were searched. Self-management or self-efficacy online tools were not included unless they were specifically targeted at depression and one of the neurologic conditions and met the other eligibility criteria. RESULTS: Only 4 online tools were identified. Of these 4 tools, 2 were web-based self-management programs for patients with migraine or MS and depression. The other 2 were mobile apps for patients with PD or TBI and depression. No online tools were found for epilepsy. CONCLUSIONS: There are limited depression tools for people with neurologic conditions that are evidence-informed, publicly available, and free. Future research should focus on the development of high-quality, evidence-based online tools targeted at neurologic patients.

Depression screening tools in persons with epilepsy: A systematic review of validated tools.

OBJECTIVE: Depression affects approximately 25% of epilepsy patients. However, the optimal tool to screen for depression in epilepsy has not been definitively established. The purpose of this study was to systematically review the literature on the validity of depression-screening tools in epilepsy. METHODS: MEDLINE, EMBASE, and PsycINFO were searched until April 4, 2016 with no restriction on dates. Abstract, full-text review and data abstraction were conducted in duplicate. We included studies that evaluated the validity of depression-screening tools and reported measures of diagnostic accuracy (e.g., sensitivity, specificity, and negative and positive predictive values) in epilepsy. Study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies Version 2. Medians and ranges for estimates of diagnostic accuracy were calculated when appropriate. RESULTS: A total of 16,070 abstracts were screened, and 38 articles met eligibility criteria. Sixteen screening tools were validated in 13 languages. The most commonly validated screening tool was the Neurological Disorders Depression Inventory for Epilepsy (NDDI-E) (n = 26). The Mini International Neuropsychiatric Interview (MINI) (n = 19) was the most common reference standard used. At the most common cutpoint of >15 (n = 12 studies), the NDDI-E had a median sensitivity of 80.5% (range 64.0-100.0) and specificity of 86.2 (range 81.0-95.6). Meta-analyses were not possible due to variability in cutpoints assessed, reference standards used, and lack of confidence intervals reported. SIGNIFICANCE: A number of studies validated depression screening tools; however, estimates of diagnostic accuracy were inconsistently reported. The validity of scales in practice may have been overestimated, as cutpoints were often selected post hoc based on the study sample. The NDDI-E, which performed well, was the most commonly validated screening tool, is free to the public, and is validated in multiple languages and is easy to administer, although selection of the best tool may vary depending on the setting and available resources.

Quality and safety in adult epilepsy monitoring units: A systematic review and meta-analysis.

OBJECTIVE: The epilepsy monitoring unit (EMU) is a valuable resource for optimizing management of persons with epilepsy, but may place patients at risk for adverse events due to withdrawal of treatment and induction of symptoms. The purpose of this study was to synthesize data on the safety and quality of care in EMUs to inform the development of quality indicators for EMUs. METHODS: A systematic review was conducted according to the Preferred Reporting and Items for Systematic Review and Meta-Analysis (PRISMA) statement. The search strategy, which included broad search terms and synonyms pertaining to the EMU, was run in six medical databases and included conference proceedings. Data abstracted included patient and EMU demographics and quality and safety variables. Study quality was evaluated using a modified 15-item Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) checklist. Descriptive statistics and meta-analyses were used to describe and synthesize the evidence. RESULTS: The search yielded 7,601 references, of which 604 were reviewed in full text. One-hundred thirty-five studies were included. The quality and safety data came from 181,823 patients and reported on 34 different quality and safety variables. Included studies commonly reported the number of patients (108 studies; median number patients, 171.5), age (49 studies; mean age 35.7 years old), and the reason for admission (34 studies). The most common quality and safety data reported were the utility of the EMU admission (38 studies). Thirty-three studies (24.4%) reported on adverse events, and yielded a pooled proportion of adverse events of 7% (95% confidence interval [CI] 5-9%). The mean quality score was 73.3% (standard deviation [SD] 17.2). SIGNIFICANCE: This study demonstrates that there is a great deal of variation in the reporting of quality and safety measures and in the quality and safety in EMUs. Study quality also varied considerably from one study to the next. These findings highlight the need to develop evidence-based, consensus-driven quality indicators for EMUs.

Identifying real and perceived barriers to therapeutic education programs for individuals with inflammatory arthritis.

Therapeutic Education Programs (TEPs) grounded in self-management principles have been shown to improve quality of life of patients with chronic conditions and reduce patient-related healthcare costs. Though these programs are becoming more readily available, patients often experience barriers in participating. This study sought to identify barriers faced by inflammatory arthritis (IA) patients in attending a TEP and understand how patients overcame perceived barriers. A mixed-method study design was used. Questionnaires were distributed to individuals with IA who were invited to attend a TEP between 2010 and 2013. Respondents were those that chose not to attend (group A), individuals who attended ≤4 of 10 sessions (group B), individuals who attended ≥5 of 10 sessions prior to May 2013 (group C), and individuals who attended ≥5 of 10 sessions from June 2013 to November 2013 (group D). Individuals in group D were also invited to participate in focus groups to discuss how they had overcome perceived barriers. Real barriers identified by individuals in groups A and B included time, distance, and cost associated with attendance. Individuals who overcame perceived barriers (groups C and D) discussed strategies they used to do so. Aspects of the overall program experience and access to clinic and program also contributed to patients being able to overcome barriers. Time, distance, and cost are external barriers that prevented individuals from utilizing self-management education opportunities. These barriers were overcome if and when individuals had resources available to them. Readiness for behavior change also influenced commitment to participate in the program.