The effect of responsive neurostimulation (RNS) on neuropsychiatric and psychosocial outcomes in drug-resistant epilepsy.

OBJECTIVE: The impact of responsive neurostimulation (RNS) on neuropsychiatric and psychosocial outcomes has not been extensively evaluated outside of the original clinical trials and post-approval studies. The goal of this study was to ascertain the potential real-world effects of RNS on cognitive, psychiatric, and quality of life (QOL) outcomes in relation to seizure outcomes by examining 50 patients undergoing RNS implantation for drug-resistant epilepsy (DRE). METHODS: We performed a retrospective review of all patients treated at our institution with RNS for DRE with at least 12 months of follow-up. In addition to baseline demographic and disease-related characteristics, we collected cognitive (Full-Scale Intelligence Quotient, Verbal Comprehension, and Perceptual Reasoning Index), psychiatric (Beck Depression and Anxiety Inventory Scores), and QOL (QOLIE-31) outcomes at 6 and 12 months after RNS implantation and correlated them with seizure outcomes. RESULTS: Fifty patients (median age 39.5 years, 64% female) were treated with RNS for DRE in our institution from 2005 to 2020. Of the 37 of them who had well-documented pre and post-implantation seizure diaries, the 6-month median seizure frequency reduction was 88%, the response rate (50% or greater seizure frequency reduction) was 78%, and 32% of patients were free of disabling seizures in this timeframe. There was no statistically significant difference at a group level in any of the evaluated cognitive, psychiatric, and QOL outcomes at 6 and 12 months post-implantation compared to the pre-implantation baseline, irrespective of seizure outcomes, although a subset of patients experienced a decline in mood or cognitive variables. SIGNIFICANCE: Responsive neurostimulation does not appear to have a statistically significant negative or positive impact on neuropsychiatric and psychosocial status at the group level. We observed significant variability in outcome, with a minority of patients experiencing worse behavioral outcomes, which seemed related to RNS implantation. Careful outcome monitoring is required to identify the subset of patients experiencing a poor response and to make appropriate adjustments in care.

Development of Expert-Level Classification of Seizures and Rhythmic and Periodic Patterns During EEG Interpretation.

BACKGROUND AND OBJECTIVES: Seizures (SZs) and other SZ-like patterns of brain activity can harm the brain and contribute to in-hospital death, particularly when prolonged. However, experts qualified to interpret EEG data are scarce. Prior attempts to automate this task have been limited by small or inadequately labeled samples and have not convincingly demonstrated generalizable expert-level performance. There exists a critical unmet need for an automated method to classify SZs and other SZ-like events with expert-level reliability. This study was conducted to develop and validate a computer algorithm that matches the reliability and accuracy of experts in identifying SZs and SZ-like events, known as "ictal-interictal-injury continuum" (IIIC) patterns on EEG, including SZs, lateralized and generalized periodic discharges (LPD, GPD), and lateralized and generalized rhythmic delta activity (LRDA, GRDA), and in differentiating these patterns from non-IIIC patterns. METHODS: We used 6,095 scalp EEGs from 2,711 patients with and without IIIC events to train a deep neural network, SPaRCNet, to perform IIIC event classification. Independent training and test data sets were generated from 50,697 EEG segments, independently annotated by 20 fellowship-trained neurophysiologists. We assessed whether SPaRCNet performs at or above the sensitivity, specificity, precision, and calibration of fellowship-trained neurophysiologists for identifying IIIC events. Statistical performance was assessed by the calibration index and by the percentage of experts whose operating points were below the model's receiver operating characteristic curves (ROCs) and precision recall curves (PRCs) for the 6 pattern classes. RESULTS: SPaRCNet matches or exceeds most experts in classifying IIIC events based on both calibration and discrimination metrics. For SZ, LPD, GPD, LRDA, GRDA, and "other" classes, SPaRCNet exceeds the following percentages of 20 experts-ROC: 45%, 20%, 50%, 75%, 55%, and 40%; PRC: 50%, 35%, 50%, 90%, 70%, and 45%; and calibration: 95%, 100%, 95%, 100%, 100%, and 80%, respectively. DISCUSSION: SPaRCNet is the first algorithm to match expert performance in detecting SZs and other SZ-like events in a representative sample of EEGs. With further development, SPaRCNet may thus be a valuable tool for an expedited review of EEGs. CLASSIFICATION OF EVIDENCE: This study provides Class II evidence that among patients with epilepsy or critical illness undergoing EEG monitoring, SPaRCNet can differentiate (IIIC) patterns from non-IIIC events and expert neurophysiologists.

Interrater Reliability of Expert Electroencephalographers Identifying Seizures and Rhythmic and Periodic Patterns in EEGs.

BACKGROUND AND OBJECTIVES: The validity of brain monitoring using electroencephalography (EEG), particularly to guide care in patients with acute or critical illness, requires that experts can reliably identify seizures and other potentially harmful rhythmic and periodic brain activity, collectively referred to as "ictal-interictal-injury continuum" (IIIC). Previous interrater reliability (IRR) studies are limited by small samples and selection bias. This study was conducted to assess the reliability of experts in identifying IIIC. METHODS: This prospective analysis included 30 experts with subspecialty clinical neurophysiology training from 18 institutions. Experts independently scored varying numbers of ten-second EEG segments as "seizure (SZ)," "lateralized periodic discharges (LPDs)," "generalized periodic discharges (GPDs)," "lateralized rhythmic delta activity (LRDA)," "generalized rhythmic delta activity (GRDA)," or "other." EEGs were performed for clinical indications at Massachusetts General Hospital between 2006 and 2020. Primary outcome measures were pairwise IRR (average percent agreement [PA] between pairs of experts) and majority IRR (average PA with group consensus) for each class and beyond chance agreement (κ). Secondary outcomes were calibration of expert scoring to group consensus, and latent trait analysis to investigate contributions of bias and noise to scoring variability. RESULTS: Among 2,711 EEGs, 49% were from women, and the median (IQR) age was 55 (41) years. In total, experts scored 50,697 EEG segments; the median [range] number scored by each expert was 6,287.5 [1,002, 45,267]. Overall pairwise IRR was moderate (PA 52%, κ 42%), and majority IRR was substantial (PA 65%, κ 61%). Noise-bias analysis demonstrated that a single underlying receiver operating curve can account for most variation in experts' false-positive vs true-positive characteristics (median [range] of variance explained ([Formula: see text]): 95 [93, 98]%) and for most variation in experts' precision vs sensitivity characteristics ([Formula: see text]: 75 [59, 89]%). Thus, variation between experts is mostly attributable not to differences in expertise but rather to variation in decision thresholds. DISCUSSION: Our results provide precise estimates of expert reliability from a large and diverse sample and a parsimonious theory to explain the origin of disagreements between experts. The results also establish a standard for how well an automated IIIC classifier must perform to match experts. CLASSIFICATION OF EVIDENCE: This study provides Class II evidence that an independent expert review reliably identifies ictal-interictal injury continuum patterns on EEG compared with expert consensus.

Translating Phenomenology of Psychogenic Nonepileptic Seizures Into Nosology: Insights From Patients' and Caregivers' Profiles.

BACKGROUND: Patients with psychogenic nonepileptic seizures (PNES) can be semiologically dichotomized into those with hyperkinetic and those with paucikinetic events. The objective of this study was to compare characteristics of patients with diverse phenomenology and their caregivers to evaluate for differences that could inform about disease nosology. METHODS: Patients and caregivers monitored at the Epilepsy Monitoring Unit completed surveys about sociodemographic and disease characteristics, treatment and health care utilization, physical and psychosocial impact, and epilepsy knowledge. Patients were classified into hyperkinetic versus paucikinetic based on their recorded events. Comparison of the 2 populations was performed using Student t test for continuous variables and Fischer exact test for categorical variables. RESULTS: Forty-three patients with Epilepsy Monitoring Unit confirmed PNES and 28 caregivers were enrolled. Patients with hyperkinetic events were more commonly non-White patients and necessitated greater caregiving time. Otherwise, no statistically significant differences were seen between the 2 semiologically diverse groups of patients and caregivers in their sociodemographic (age, sex, employment, income, marital, and education) and disease (age of onset, duration, seizures frequency) characteristics, treatment (number of antiseizure medications before diagnosis, side effects) and health care utilization (emergency room visits, hospitalizations, clinic visits), physical (injuries) and psychosocial (depression, anxiety, quality of life, stigma, burden) characteristics, nor in their knowledge about seizures. CONCLUSIONS: Hyperkinetic events were more frequently encountered in non-White patients and required more caregiving time. Further research is required to elucidate if phenomenological dichotomy of PNES can inform about their nosological basis, and if it can guide treatment and define prognosis.

Validation of the 2HELPS2B Seizure Risk Score in Acute Brain Injury Patients.

BACKGROUND AND OBJECTIVE: Seizures are common after traumatic brain injury (TBI), aneurysmal subarachnoid hemorrhage (aSAH), subdural hematoma (SDH), and non-traumatic intraparenchymal hemorrhage (IPH)-collectively defined herein as acute brain injury (ABI). Most seizures in ABI are subclinical, meaning that they are only detectable with EEG. A method is required to identify patients at greatest risk of seizures and thereby in need of prolonged continuous EEG monitoring. 2HELPS2B is a simple point system developed to address this need. 2HELPS2B estimates seizure risk for hospitalized patients using five EEG findings and one clinical finding (pre-EEG seizure). The initial 2HELPS2B study did not specifically assess the ABI subpopulation. In this study, we aim to validate the 2HELPS2B score in ABI and determine its relative predictive accuracy compared to a broader set of clinical and electrographic factors. METHODS: We queried the Critical Care EEG Monitoring Research Consortium database for ABI patients age ≥ 18 with > 6 h of continuous EEG monitoring; data were collected between February 2013 and November 2018. The primary outcome was electrographic seizure. Clinical factors considered were age, coma, encephalopathy, ABI subtype, and acute suspected or confirmed pre-EEG clinical seizure. Electrographic factors included 18 EEG findings. Predictive accuracy was assessed using a machine-learning paradigm with area under the receiver operator characteristic (ROC) curve as the primary outcome metric. Three models (clinical factors alone, EEG factors alone, EEG and clinical factors combined) were generated using elastic-net logistic regression. Models were compared to each other and to the 2HELPS2B model. All models were evaluated by calculating the area under the curve (AUC) of a ROC analysis and then compared using permutation testing of AUC with bootstrapping to generate confidence intervals. RESULTS: A total of 1528 ABI patients were included. Total seizure incidence was 13.9%. Seizure incidence among ABI subtype varied: IPH 17.2%, SDH 19.1%, aSAH 7.6%, TBI 9.2%. Age ≥ 65 (p = 0.015) and pre-cEEG acute clinical seizure (p < 0.001) positively affected seizure incidence. Clinical factors AUC = 0.65 [95% CI 0.60-0.71], EEG factors AUC = 0.82 [95% CI 0.77-0.87], and EEG and clinical factors combined AUC = 0.84 [95% CI 0.80-0.88]. 2HELPS2B AUC = 0.81 [95% CI 0.76-0.85]. The 2HELPS2B AUC did not differ from EEG factors (p = 0.51), or EEG and clinical factors combined (p = 0.23), but was superior to clinical factors alone (p < 0.001). CONCLUSIONS: Accurate seizure risk forecasting in ABI requires the assessment of EEG markers of pathologic electro-cerebral activity (e.g., sporadic epileptiform discharges and lateralized periodic discharges). The 2HELPS2B score is a reliable and simple method to quantify these EEG findings and their associated risk of seizure.

Comparison of machine learning models for seizure prediction in hospitalized patients.

OBJECTIVE: To compare machine learning methods for predicting inpatient seizures risk and determine the feasibility of 1-h screening EEG to identify low-risk patients (<5% seizures risk in 48 h). METHODS: The Critical Care EEG Monitoring Research Consortium (CCEMRC) multicenter database contains 7716 continuous EEGs (cEEG). Neural networks (NN), elastic net logistic regression (EN), and sparse linear integer model (RiskSLIM) were trained to predict seizures. RiskSLIM was used previously to generate 2HELPS2B model of seizure predictions. Data were divided into training (60% for model fitting) and evaluation (40% for model evaluation) cohorts. Performance was measured using area under the receiver operating curve (AUC), mean risk calibration (CAL), and negative predictive value (NPV). A secondary analysis was performed using Monte Carlo simulation (MCS) to normalize all EEG recordings to 48 h and use only the first hour of EEG as a "screening EEG" to generate predictions. RESULTS: RiskSLIM recreated the 2HELPS2B model. All models had comparable AUC: evaluation cohort (NN: 0.85, EN: 0.84, 2HELPS2B: 0.83) and MCS (NN: 0.82, EN; 0.82, 2HELPS2B: 0.81) and NPV (absence of seizures in the group that the models predicted to be low risk): evaluation cohort (NN: 97%, EN: 97%, 2HELPS2B: 97%) and MCS (NN: 97%, EN: 99%, 2HELPS2B: 97%). 2HELPS2B model was able to identify the largest proportion of low-risk patients. INTERPRETATION: For seizure risk stratification of hospitalized patients, the RiskSLIM generated 2HELPS2B model compares favorably to the complex NN and EN generated models. 2HELPS2B is able to accurately and quickly identify low-risk patients with only a 1-h screening EEG.

The use and yield of continuous EEG in critically ill patients: A comparative study of three centers.

OBJECTIVE: Continuous EEG (cEEG) monitoring of critically ill patients has gained widespread use, but there is substantial reported variability in its use. We analyzed cEEG and antiseizure drug (ASD) usage at three high volume centers. METHODS: We utilized a multicenter cEEG database used daily as a clinical reporting tool in three tertiary care sites (Emory Hospital, Brigham and Women's Hospital and Yale - New Haven Hospital). We compared the cEEG usage patterns, seizure frequency, detection of rhythmic/periodic patterns (RPP), and ASD use between the sites. RESULTS: 5792 cEEG sessions were analyzed. Indication for cEEG monitoring and recording duration were similar between the sites. Seizures detection rate was nearly identical between the three sites, ranging between 12.3% and 13.6%. Median time to first seizure and detection rate of RPPs were similar. There were significant differences in doses of levetiracetam, valproic acid, and lacosamide used between the three sites. CONCLUSIONS: There was remarkable uniformity in seizure detection rates within three high volume centers. In contrast, dose of ASD used frequently differed between the three sites. SIGNIFICANCE: These large volume data are in line with recent guidelines regarding cEEG use. Difference in ASD use suggests discrepancies in how cEEG results influence patient management.

Development and Feasibility Testing of a Critical Care EEG Monitoring Database for Standardized Clinical Reporting and Multicenter Collaborative Research.

PURPOSE: The rapid expansion of the use of continuous critical care electroencephalogram (cEEG) monitoring and resulting multicenter research studies through the Critical Care EEG Monitoring Research Consortium has created the need for a collaborative data sharing mechanism and repository. The authors describe the development of a research database incorporating the American Clinical Neurophysiology Society standardized terminology for critical care EEG monitoring. The database includes flexible report generation tools that allow for daily clinical use. METHODS: Key clinical and research variables were incorporated into a Microsoft Access database. To assess its utility for multicenter research data collection, the authors performed a 21-center feasibility study in which each center entered data from 12 consecutive intensive care unit monitoring patients. To assess its utility as a clinical report generating tool, three large volume centers used it to generate daily clinical critical care EEG reports. RESULTS: A total of 280 subjects were enrolled in the multicenter feasibility study. The duration of recording (median, 25.5 hours) varied significantly between the centers. The incidence of seizure (17.6%), periodic/rhythmic discharges (35.7%), and interictal epileptiform discharges (11.8%) was similar to previous studies. The database was used as a clinical reporting tool by 3 centers that entered a total of 3,144 unique patients covering 6,665 recording days. CONCLUSIONS: The Critical Care EEG Monitoring Research Consortium database has been successfully developed and implemented with a dual role as a collaborative research platform and a clinical reporting tool. It is now available for public download to be used as a clinical data repository and report generating tool.