Decoding information about cognitive health from the brainwaves of sleep.

Sleep electroencephalogram (EEG) signals likely encode brain health information that may identify individuals at high risk for age-related brain diseases. Here, we evaluate the correlation of a previously proposed brain age biomarker, the "brain age index" (BAI), with cognitive test scores and use machine learning to develop and validate a series of new sleep EEG-based indices, termed "sleep cognitive indices" (SCIs), that are directly optimized to correlate with specific cognitive scores. Three overarching cognitive processes were examined: total, fluid (a measure of cognitive processes involved in reasoning-based problem solving and susceptible to aging and neuropathology), and crystallized cognition (a measure of cognitive processes involved in applying acquired knowledge toward problem-solving). We show that SCI decoded information about total cognition (Pearson's r = 0.37) and fluid cognition (Pearson's r = 0.56), while BAI correlated only with crystallized cognition (Pearson's r = - 0.25). Overall, these sleep EEG-derived biomarkers may provide accessible and clinically meaningful indicators of neurocognitive health.

Sound and light levels in intensive care units in a large urban hospital in the United States.

Intensive care units (ICUs) may disrupt sleep. Quantitative ICU studies of concurrent and continuous sound and light levels and timings remain sparse in part due to the lack of ICU equipment that monitors sound and light. Here, we describe sound and light levels across three adult ICUs in a large urban United States tertiary care hospital using a novel sensor. The novel sound and light sensor is composed of a Gravity Sound Level Meter for sound level measurements and an Adafruit TSL2561 digital luminosity sensor for light levels. Sound and light levels were continuously monitored in the room of 136 patients (mean age = 67.0 (8.7) years, 44.9% female) enrolled in the Investigation of Sleep in the Intensive Care Unit study (ICU-SLEEP; Clinicaltrials.gov: #NCT03355053), at the Massachusetts General Hospital. The hours of available sound and light data ranged from 24.0 to 72.2 hours. Average sound and light levels oscillated throughout the day and night. On average, the loudest hour was 17:00 and the quietest hour was 02:00. Average light levels were brightest at 09:00 and dimmest at 04:00. For all participants, average nightly sound levels exceeded the WHO guideline of < 35 decibels. Similarly, mean nightly light levels varied across participants (minimum: 1.00 lux, maximum: 577.05 lux). Sound and light events were more frequent between 08:00 and 20:00 than between 20:00 and 08:00 and were largely similar on weekdays and weekend days. Peaks in distinct alarm frequencies (Alarm 1) occurred at 01:00, 06:00, and at 20:00. Alarms at other frequencies (Alarm 2) were relatively consistent throughout the day and night, with a small peak at 20:00. In conclusion, we present a sound and light data collection method and results from a cohort of critically ill patients, demonstrating excess sound and light levels across multiple ICUs in a large tertiary care hospital in the United States. ClinicalTrials.gov, #NCT03355053. Registered 28 November 2017, https://clinicaltrials.gov/ct2/show/NCT03355053.

Classification of neurologic outcomes from medical notes using natural language processing.

Neurologic disability level at hospital discharge is an important outcome in many clinical research studies. Outside of clinical trials, neurologic outcomes must typically be extracted by labor intensive manual review of clinical notes in the electronic health record (EHR). To overcome this challenge, we set out to develop a natural language processing (NLP) approach that automatically reads clinical notes to determine neurologic outcomes, to make it possible to conduct larger scale neurologic outcomes studies. We obtained 7314 notes from 3632 patients hospitalized at two large Boston hospitals between January 2012 and June 2020, including discharge summaries (3485), occupational therapy (1472) and physical therapy (2357) notes. Fourteen clinical experts reviewed notes to assign scores on the Glasgow Outcome Scale (GOS) with 4 classes, namely 'good recovery', 'moderate disability', 'severe disability', and 'death' and on the Modified Rankin Scale (mRS), with 7 classes, namely 'no symptoms', 'no significant disability', 'slight disability', 'moderate disability', 'moderately severe disability', 'severe disability', and 'death'. For 428 patients' notes, 2 experts scored the cases generating interrater reliability estimates for GOS and mRS. After preprocessing and extracting features from the notes, we trained a multiclass logistic regression model using LASSO regularization and 5-fold cross validation for hyperparameter tuning. The model performed well on the test set, achieving a micro average area under the receiver operating characteristic and F-score of 0.94 (95% CI 0.93-0.95) and 0.77 (0.75-0.80) for GOS, and 0.90 (0.89-0.91) and 0.59 (0.57-0.62) for mRS, respectively. Our work demonstrates that an NLP algorithm can accurately assign neurologic outcomes based on free text clinical notes. This algorithm increases the scale of research on neurological outcomes that is possible with EHR data.

Sleep staging in the ICU with heart rate variability and breathing signals. An exploratory cross-sectional study using deep neural networks.

Introduction: To measure sleep in the intensive care unit (ICU), full polysomnography is impractical, while activity monitoring and subjective assessments are severely confounded. However, sleep is an intensely networked state, and reflected in numerous signals. Here, we explore the feasibility of estimating conventional sleep indices in the ICU with heart rate variability (HRV) and respiration signals using artificial intelligence methods Methods: We used deep learning models to stage sleep with HRV (through electrocardiogram) and respiratory effort (through a wearable belt) signals in critically ill adult patients admitted to surgical and medical ICUs, and in age and sex-matched sleep laboratory patients Results: We studied 102 adult patients in the ICU across multiple days and nights, and 220 patients in a clinical sleep laboratory. We found that sleep stages predicted by HRV- and breathing-based models showed agreement in 60% of the ICU data and in 81% of the sleep laboratory data. In the ICU, deep NREM (N2 + N3) proportion of total sleep duration was reduced (ICU 39%, sleep laboratory 57%, p < 0.01), REM proportion showed heavy-tailed distribution, and the number of wake transitions per hour of sleep (median 3.6) was comparable to sleep laboratory patients with sleep-disordered breathing (median 3.9). Sleep in the ICU was also fragmented, with 38% of sleep occurring during daytime hours. Finally, patients in the ICU showed faster and less variable breathing patterns compared to sleep laboratory patients Conclusion: The cardiovascular and respiratory networks encode sleep state information, which, together with artificial intelligence methods, can be utilized to measure sleep state in the ICU.

High prevalence of sleep-disordered breathing in the intensive care unit - a cross-sectional study.

PURPOSE: Sleep-disordered breathing may be induced by, exacerbate, or complicate recovery from critical illness. Disordered breathing during sleep, which itself is often fragmented, can go unrecognized in the intensive care unit (ICU). The objective of this study was to investigate the prevalence, severity, and risk factors of sleep-disordered breathing in ICU patients using a single respiratory belt and oxygen saturation signals. METHODS: Patients in three ICUs at Massachusetts General Hospital wore a thoracic respiratory effort belt as part of a clinical trial for up to 7 days and nights. Using a previously developed machine learning algorithm, we processed respiratory and oximetry signals to measure the 3% apnea-hypopnea index (AHI) and estimate AH-specific hypoxic burden and periodic breathing. We trained models to predict AHI categories for 12-h segments from risk factors, including admission variables and bio-signals data, available at the start of these segments. RESULTS: Of 129 patients, 68% had an AHI ≥ 5; 40% an AHI > 15, and 19% had an AHI > 30 while critically ill. Median [interquartile range] hypoxic burden was 2.8 [0.5, 9.8] at night and 4.2 [1.0, 13.7] %min/h during the day. Of patients with AHI ≥ 5, 26% had periodic breathing. Performance of predicting AHI-categories from risk factors was poor. CONCLUSIONS: Sleep-disordered breathing and sleep apnea events while in the ICU are common and are associated with substantial burden of hypoxia and periodic breathing. Detection is feasible using limited bio-signals, such as respiratory effort and SpO2 signals, while risk factors were insufficient to predict AHI severity.

EEG-based grading of immune effector cell-associated neurotoxicity syndrome.

CAR-T cell therapy is an effective cancer therapy for multiple refractory/relapsed hematologic malignancies but is associated with substantial toxicity, including Immune Effector Cell Associated Neurotoxicity Syndrome (ICANS). Improved detection and assessment of ICANS could improve management and allow greater utilization of CAR-T cell therapy, however, an objective, specific biomarker has not been identified. We hypothesized that the severity of ICANS can be quantified based on patterns of abnormal brain activity seen in electroencephalography (EEG) signals. We conducted a retrospective observational study of 120 CAR-T cell therapy patients who had received EEG monitoring. We determined a daily ICANS grade for each patient through chart review. We used visually assessed EEG features and machine learning techniques to develop the Visual EEG-Immune Effector Cell Associated Neurotoxicity Syndrome (VE-ICANS) score and assessed the association between VE-ICANS and ICANS. We also used it to determine the significance and relative importance of the EEG features. We developed the Visual EEG-ICANS (VE-ICANS) grading scale, a grading scale with a physiological basis that has a strong correlation to ICANS severity (R = 0.58 [0.47-0.66]) and excellent discrimination measured via area under the receiver operator curve (AUC = 0.91 for ICANS ≥ 2). This scale shows promise as a biomarker for ICANS which could help to improve clinical care through greater accuracy in assessing ICANS severity.

Identifying Patients With Delirium Based on Unstructured Clinical Notes: Observational Study.

BACKGROUND: Delirium in hospitalized patients is a syndrome of acute brain dysfunction. Diagnostic (International Classification of Diseases [ICD]) codes are often used in studies using electronic health records (EHRs), but they are inaccurate. OBJECTIVE: We sought to develop a more accurate method using natural language processing (NLP) to detect delirium episodes on the basis of unstructured clinical notes. METHODS: We collected 1.5 million notes from >10,000 patients from among 9 hospitals. Seven experts iteratively labeled 200,471 sentences. Using these, we trained three NLP classifiers: Support Vector Machine, Recurrent Neural Networks, and Transformer. Testing was performed using an external data set. We also evaluated associations with delirium billing (ICD) codes, medications, orders for restraints and sitters, direct assessments (Confusion Assessment Method [CAM] scores), and in-hospital mortality. F1 scores, confusion matrices, and areas under the receiver operating characteristic curve (AUCs) were used to compare NLP models. We used the φ coefficient to measure associations with other delirium indicators. RESULTS: The transformer NLP performed best on the following parameters: micro F1=0.978, macro F1=0.918, positive AUC=0.984, and negative AUC=0.992. NLP detections exhibited higher correlations (φ) than ICD codes with deliriogenic medications (0.194 vs 0.073 for ICD codes), restraints and sitter orders (0.358 vs 0.177), mortality (0.216 vs 0.000), and CAM scores (0.256 vs -0.028). CONCLUSIONS: Clinical notes are an attractive alternative to ICD codes for EHR delirium studies but require automated methods. Our NLP model detects delirium with high accuracy, similar to manual chart review. Our NLP approach can provide more accurate determination of delirium for large-scale EHR-based studies regarding delirium, quality improvement, and clinical trails.

Optimal spindle detection parameters for predicting cognitive performance.

STUDY OBJECTIVES: Alterations in sleep spindles have been linked to cognitive impairment. This finding has contributed to a growing interest in identifying sleep-based biomarkers of cognition and neurodegeneration, including sleep spindles. However, flexibility surrounding spindle definitions and algorithm parameter settings present a methodological challenge. The aim of this study was to characterize how spindle detection parameter settings influence the association between spindle features and cognition and to identify parameters with the strongest association with cognition. METHODS: Adult patients (n = 167, 49 ± 18 years) completed the NIH Toolbox Cognition Battery after undergoing overnight diagnostic polysomnography recordings for suspected sleep disorders. We explored 1000 combinations across seven parameters in Luna, an open-source spindle detector, and used four features of detected spindles (amplitude, density, duration, and peak frequency) to fit linear multiple regression models to predict cognitive scores. RESULTS: Spindle features (amplitude, density, duration, and mean frequency) were associated with the ability to predict raw fluid cognition scores (r = 0.503) and age-adjusted fluid cognition scores (r = 0.315) with the best spindle parameters. Fast spindle features generally showed better performance relative to slow spindle features. Spindle features weakly predicted total cognition and poorly predicted crystallized cognition regardless of parameter settings. CONCLUSIONS: Our exploration of spindle detection parameters identified optimal parameters for studies of fluid cognition and revealed the role of parameter interactions for both slow and fast spindles. Our findings support sleep spindles as a sleep-based biomarker of fluid cognition.

VE-CAM-S: Visual EEG-Based Grading of Delirium Severity and Associations With Clinical Outcomes.

To develop a physiologic grading system for the severity of acute encephalopathy manifesting as delirium or coma, based on EEG, and to investigate its association with clinical outcomes. DESIGN: This prospective, single-center, observational cohort study was conducted from August 2015 to December 2016 and October 2018 to December 2019. SETTING: Academic medical center, all inpatient wards. PATIENTS/SUBJECTS: Adult inpatients undergoing a clinical EEG recording; excluded if deaf, severely aphasic, developmentally delayed, non-English speaking (if noncomatose), or if goals of care focused primarily on comfort measures. Four-hundred six subjects were assessed; two were excluded due to technical EEG difficulties. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: A machine learning model, with visually coded EEG features as inputs, was developed to produce scores that correlate with behavioral assessments of delirium severity (Confusion Assessment Method-Severity [CAM-S] Long Form [LF] scores) or coma; evaluated using Spearman R correlation; area under the receiver operating characteristic curve (AUC); and calibration curves. Associations of Visual EEG Confusion Assessment Method Severity (VE-CAM-S) were measured for three outcomes: functional status at discharge (via Glasgow Outcome Score [GOS]), inhospital mortality, and 3-month mortality. Four-hundred four subjects were analyzed (mean [sd] age, 59.8 yr [17.6 yr]; 232 [57%] male; 320 [79%] White; 339 [84%] non-Hispanic); 132 (33%) without delirium or coma, 143 (35%) with delirium, and 129 (32%) with coma. VE-CAM-S scores correlated strongly with CAM-S scores (Spearman correlation 0.67 [0.62-0.73]; p < 0.001) and showed excellent discrimination between levels of delirium (CAM-S LF = 0 vs ≥ 4, AUC 0.85 [0.78-0.92], calibration slope of 1.04 [0.87-1.19] for CAM-S LF ≤ 4 vs ≥ 5). VE-CAM-S scores were strongly associated with important clinical outcomes including inhospital mortality (AUC 0.79 [0.72-0.84]), 3-month mortality (AUC 0.78 [0.71-0.83]), and GOS at discharge (0.76 [0.69-0.82]). CONCLUSIONS: VE-CAM-S is a physiologic grading scale for the severity of symptoms in the setting of delirium and coma, based on visually assessed electroencephalography features. VE-CAM-S scores are strongly associated with clinical outcomes.

Sleep apnea and respiratory anomaly detection from a wearable band and oxygen saturation.

OBJECTIVE: Sleep-related respiratory abnormalities are typically detected using polysomnography. There is a need in general medicine and critical care for a more convenient method to detect sleep apnea automatically from a simple, easy-to-wear device. The objective was to detect abnormal respiration and estimate the Apnea-Hypopnea Index (AHI) automatically with a wearable respiratory device with and without SpO2 signals using a large (n = 412) dataset serving as ground truth. DESIGN: Simultaneously recorded polysomnography (PSG) and wearable respiratory effort data were used to train and evaluate models in a cross-validation fashion. Time domain and complexity features were extracted, important features were identified, and a random forest model was employed to detect events and predict AHI. Four models were trained: one each using the respiratory features only, a feature from the SpO2 (%)-signal only, and two additional models that use the respiratory features and the SpO2 (%) feature, one allowing a time lag of 30 s between the two signals. RESULTS: Event-based classification resulted in areas under the receiver operating characteristic curves of 0.94, 0.86, and 0.82, and areas under the precision-recall curves of 0.48, 0.32, and 0.51 for the models using respiration and SpO2, respiration-only, and SpO2-only, respectively. Correlation between expert-labelled and predicted AHI was 0.96, 0.78, and 0.93, respectively. CONCLUSIONS: A wearable respiratory effort signal with or without SpO2 signal predicted AHI accurately, and best performance was achieved with using both signals.

Physiological Assessment of Delirium Severity: The Electroencephalographic Confusion Assessment Method Severity Score (E-CAM-S).

OBJECTIVES: Delirium is a common and frequently underdiagnosed complication in acutely hospitalized patients, and its severity is associated with worse clinical outcomes. We propose a physiologically based method to quantify delirium severity as a tool that can help close this diagnostic gap: the Electroencephalographic Confusion Assessment Method Severity Score (E-CAM-S). DESIGN: Retrospective cohort study. SETTING: Single-center tertiary academic medical center. PATIENTS: Three-hundred seventy-three adult patients undergoing electroencephalography to evaluate altered mental status between August 2015 and December 2019. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We developed the E-CAM-S based on a learning-to-rank machine learning model of forehead electroencephalography signals. Clinical delirium severity was assessed using the Confusion Assessment Method Severity (CAM-S). We compared associations of E-CAM-S and CAM-S with hospital length of stay and inhospital mortality. E-CAM-S correlated with clinical CAM-S (R = 0.67; p < 0.0001). For the overall cohort, E-CAM-S and CAM-S were similar in their strength of association with hospital length of stay (correlation = 0.31 vs 0.41, respectively; p = 0.082) and inhospital mortality (area under the curve = 0.77 vs 0.81; p = 0.310). Even when restricted to noncomatose patients, E-CAM-S remained statistically similar to CAM-S in its association with length of stay (correlation = 0.37 vs 0.42, respectively; p = 0.188) and inhospital mortality (area under the curve = 0.83 vs 0.74; p = 0.112). In addition to previously appreciated spectral features, the machine learning framework identified variability in multiple measures over time as important features in electroencephalography-based prediction of delirium severity. CONCLUSIONS: The E-CAM-S is an automated, physiologic measure of delirium severity that predicts clinical outcomes with a level of performance comparable to conventional interview-based clinical assessment.

CoVA: An Acuity Score for Outpatient Screening that Predicts Coronavirus Disease 2019 Prognosis.

BACKGROUND: We sought to develop an automatable score to predict hospitalization, critical illness, or death for patients at risk for coronavirus disease 2019 (COVID-19) presenting for urgent care. METHODS: We developed the COVID-19 Acuity Score (CoVA) based on a single-center study of adult outpatients seen in respiratory illness clinics or the emergency department. Data were extracted from the Partners Enterprise Data Warehouse, and split into development (n = 9381, 7 March-2 May) and prospective (n = 2205, 3-14 May) cohorts. Outcomes were hospitalization, critical illness (intensive care unit or ventilation), or death within 7 days. Calibration was assessed using the expected-to-observed event ratio (E/O). Discrimination was assessed by area under the receiver operating curve (AUC). RESULTS: In the prospective cohort, 26.1%, 6.3%, and 0.5% of patients experienced hospitalization, critical illness, or death, respectively. CoVA showed excellent performance in prospective validation for hospitalization (expected-to-observed ratio [E/O]: 1.01; AUC: 0.76), for critical illness (E/O: 1.03; AUC: 0.79), and for death (E/O: 1.63; AUC: 0.93). Among 30 predictors, the top 5 were age, diastolic blood pressure, blood oxygen saturation, COVID-19 testing status, and respiratory rate. CONCLUSIONS: CoVA is a prospectively validated automatable score for the outpatient setting to predict adverse events related to COVID-19 infection.

Sleep staging from electrocardiography and respiration with deep learning.

STUDY OBJECTIVES: Sleep is reflected not only in the electroencephalogram but also in heart rhythms and breathing patterns. We hypothesized that it is possible to accurately stage sleep based on the electrocardiogram (ECG) and respiratory signals. METHODS: Using a dataset including 8682 polysomnograms, we develop deep neural networks to stage sleep from ECG and respiratory signals. Five deep neural networks consisting of convolutional networks and long- and short-term memory networks are trained to stage sleep using heart and breathing, including the timing of R peaks from ECG, abdominal and chest respiratory effort, and the combinations of these signals. RESULTS: ECG in combination with the abdominal respiratory effort achieved the best performance for staging all five sleep stages with a Cohen's kappa of 0.585 (95% confidence interval ±0.017); and 0.760 (±0.019) for discriminating awake vs. rapid eye movement vs. nonrapid eye movement sleep. Performance is better for younger ages, whereas it is robust for body mass index, apnea severity, and commonly used outpatient medications. CONCLUSIONS: Our results validate that ECG and respiratory effort provide substantial information about sleep stages in a large heterogeneous population. This opens new possibilities in sleep research and applications where electroencephalography is not readily available or may be infeasible.