Evaluating the accuracy of a state-of-the-art large language model for prediction of admissions from the emergency room.

BACKGROUND: Artificial intelligence (AI) and large language models (LLMs) can play a critical role in emergency room operations by augmenting decision-making about patient admission. However, there are no studies for LLMs using real-world data and scenarios, in comparison to and being informed by traditional supervised machine learning (ML) models. We evaluated the performance of GPT-4 for predicting patient admissions from emergency department (ED) visits. We compared performance to traditional ML models both naively and when informed by few-shot examples and/or numerical probabilities. METHODS: We conducted a retrospective study using electronic health records across 7 NYC hospitals. We trained Bio-Clinical-BERT and XGBoost (XGB) models on unstructured and structured data, respectively, and created an ensemble model reflecting ML performance. We then assessed GPT-4 capabilities in many scenarios: through Zero-shot, Few-shot with and without retrieval-augmented generation (RAG), and with and without ML numerical probabilities. RESULTS: The Ensemble ML model achieved an area under the receiver operating characteristic curve (AUC) of 0.88, an area under the precision-recall curve (AUPRC) of 0.72 and an accuracy of 82.9%. The naïve GPT-4's performance (0.79 AUC, 0.48 AUPRC, and 77.5% accuracy) showed substantial improvement when given limited, relevant data to learn from (ie, RAG) and underlying ML probabilities (0.87 AUC, 0.71 AUPRC, and 83.1% accuracy). Interestingly, RAG alone boosted performance to near peak levels (0.82 AUC, 0.56 AUPRC, and 81.3% accuracy). CONCLUSIONS: The naïve LLM had limited performance but showed significant improvement in predicting ED admissions when supplemented with real-world examples to learn from, particularly through RAG, and/or numerical probabilities from traditional ML models. Its peak performance, although slightly lower than the pure ML model, is noteworthy given its potential for providing reasoning behind predictions. Further refinement of LLMs with real-world data is necessary for successful integration as decision-support tools in care settings.

Characterizing cell type specific transcriptional differences between the living and postmortem human brain.

Single-nucleus RNA sequencing (snRNA-seq) is often used to define gene expression patterns characteristic of brain cell types as well as to identify cell type specific gene expression signatures of neurological and mental illnesses in postmortem human brains. As methods to obtain brain tissue from living individuals emerge, it is essential to characterize gene expression differences associated with tissue originating from either living or postmortem subjects using snRNA-seq, and to assess whether and how such differences may impact snRNA-seq studies of brain tissue. To address this, human prefrontal cortex single nuclei gene expression was generated and compared between 31 samples from living individuals and 21 postmortem samples. The same cell types were consistently identified in living and postmortem nuclei, though for each cell type, a large proportion of genes were differentially expressed between samples from postmortem and living individuals. Notably, estimation of cell type proportions by cell type deconvolution of pseudo-bulk data was found to be more accurate in samples from living individuals. To allow for future integration of living and postmortem brain gene expression, a model was developed that quantifies from gene expression data the probability a human brain tissue sample was obtained postmortem. These probabilities are established as a means to statistically account for the gene expression differences between samples from living and postmortem individuals. Together, the results presented here provide a deep characterization of both differences between snRNA-seq derived from samples from living and postmortem individuals, as well as qualify and account for their effect on common analyses performed on this type of data.

Divergent landscapes of A-to-I editing in postmortem and living human brain.

Adenosine-to-inosine (A-to-I) editing is a prevalent post-transcriptional RNA modification within the brain. Yet, most research has relied on postmortem samples, assuming it is an accurate representation of RNA biology in the living brain. We challenge this assumption by comparing A-to-I editing between postmortem and living prefrontal cortical tissues. Major differences were found, with over 70,000 A-to-I sites showing higher editing levels in postmortem tissues. Increased A-to-I editing in postmortem tissues is linked to higher ADAR1 and ADARB1 expression, is more pronounced in non-neuronal cells, and indicative of postmortem activation of inflammation and hypoxia. Higher A-to-I editing in living tissues marks sites that are evolutionarily preserved, synaptic, developmentally timed, and disrupted in neurological conditions. Common genetic variants were also found to differentially affect A-to-I editing levels in living versus postmortem tissues. Collectively, these discoveries illuminate the nuanced functions and intricate regulatory mechanisms of RNA editing within the human brain.

Integrated multiomics implicates dysregulation of ECM and cell adhesion pathways as drivers of severe COVID-associated kidney injury.

COVID-19 has been a significant public health concern for the last four years; however, little is known about the mechanisms that lead to severe COVID-associated kidney injury. In this multicenter study, we combined quantitative deep urinary proteomics and machine learning to predict severe acute outcomes in hospitalized COVID-19 patients. Using a 10-fold cross-validated random forest algorithm, we identified a set of urinary proteins that demonstrated predictive power for both discovery and validation set with 87% and 79% accuracy, respectively. These predictive urinary biomarkers were recapitulated in non-COVID acute kidney injury revealing overlapping injury mechanisms. We further combined orthogonal multiomics datasets to understand the mechanisms that drive severe COVID-associated kidney injury. Functional overlap and network analysis of urinary proteomics, plasma proteomics and urine sediment single-cell RNA sequencing showed that extracellular matrix and autophagy-associated pathways were uniquely impacted in severe COVID-19. Differentially abundant proteins associated with these pathways exhibited high expression in cells in the juxtamedullary nephron, endothelial cells, and podocytes, indicating that these kidney cell types could be potential targets. Further, single-cell transcriptomic analysis of kidney organoids infected with SARS-CoV-2 revealed dysregulation of extracellular matrix organization in multiple nephron segments, recapitulating the clinically observed fibrotic response across multiomics datasets. Ligand-receptor interaction analysis of the podocyte and tubule organoid clusters showed significant reduction and loss of interaction between integrins and basement membrane receptors in the infected kidney organoids. Collectively, these data suggest that extracellular matrix degradation and adhesion-associated mechanisms could be a main driver of COVID-associated kidney injury and severe outcomes.

Neuropsychiatric complications of coronavirus disease 2019: Mount Sinai Health System cohort study.

OBJECTIVE: To describe the frequency of neuropsychiatric complications among hospitalized patients with coronavirus disease 2019 (COVID-19) and their association with pre-existing comorbidities and clinical outcomes. METHODS: We retrospectively identified all patients hospitalized with COVID-19 within a large multicenter New York City health system between March 15, 2020 and May 17, 2021 and randomly selected a representative cohort for detailed chart review. Clinical data, including the occurrence of neuropsychiatric complications (categorized as either altered mental status [AMS] or other neuropsychiatric complications) and in-hospital mortality, were extracted using an electronic medical record database and individual chart review. Associations between neuropsychiatric complications, comorbidities, laboratory findings, and in-hospital mortality were assessed using multivariate logistic regression. RESULTS: Our study cohort consisted of 974 patients, the majority were admitted during the first wave of the pandemic. Patients were treated with anticoagulation (88.4%), glucocorticoids (24.8%), and remdesivir (10.5%); 18.6% experienced severe COVID-19 pneumonia (evidenced by ventilator requirement). Neuropsychiatric complications occurred in 58.8% of patients; 39.8% experienced AMS; and 19.0% experienced at least one other complication (seizures in 1.4%, ischemic stroke in 1.6%, hemorrhagic stroke in 1.0%) or symptom (headache in 11.4%, anxiety in 6.8%, ataxia in 6.3%). Higher odds of mortality, which occurred in 22.0%, were associated with AMS, ventilator support, increasing age, and higher serum inflammatory marker levels. Anticoagulant therapy was associated with lower odds of mortality and AMS. CONCLUSION: Neuropsychiatric complications of COVID-19, especially AMS, were common, varied, and associated with in-hospital mortality in a diverse multicenter cohort at an epicenter of the COVID-19 pandemic.

Dopamine and serotonin in human substantia nigra track social context and value signals during economic exchange.

Dopamine and serotonin are hypothesized to guide social behaviours. In humans, however, we have not yet been able to study neuromodulator dynamics as social interaction unfolds. Here, we obtained subsecond estimates of dopamine and serotonin from human substantia nigra pars reticulata during the ultimatum game. Participants, who were patients with Parkinson's disease undergoing awake brain surgery, had to accept or reject monetary offers of varying fairness from human and computer players. They rejected more offers in the human than the computer condition, an effect of social context associated with higher overall levels of dopamine but not serotonin. Regardless of the social context, relative changes in dopamine tracked trial-by-trial changes in offer value-akin to reward prediction errors-whereas serotonin tracked the current offer value. These results show that dopamine and serotonin fluctuations in one of the basal ganglia's main output structures reflect distinct social context and value signals.

Comparison of predicting cardiovascular disease hospitalization using individual, ZIP code-derived, and machine learning model-predicted educational attainment in New York City.

BACKGROUND: Area-level social determinants of health (SDOH) based on patients' ZIP codes or census tracts have been commonly used in research instead of individual SDOHs. To our knowledge, whether machine learning (ML) could be used to derive individual SDOH measures, specifically individual educational attainment, is unknown. METHODS: This is a retrospective study using data from the Mount Sinai BioMe Biobank. We included participants that completed a validated questionnaire on educational attainment and had home addresses in New York City. ZIP code-level education was derived from the American Community Survey matched for the participant's gender and race/ethnicity. We tested several algorithms to predict individual educational attainment from routinely collected clinical and demographic data. To evaluate how using different measures of educational attainment will impact model performance, we developed three distinct models for predicting cardiovascular (CVD) hospitalization. Educational attainment was imputed into models as either survey-derived, ZIP code-derived, or ML-predicted educational attainment. RESULTS: A total of 20,805 participants met inclusion criteria. Concordance between survey and ZIP code-derived education was 47%, while the concordance between survey and ML model-predicted education was 67%. A total of 13,715 patients from the cohort were included into our CVD hospitalization prediction models, of which 1,538 (11.2%) had a history of CVD hospitalization. The AUROC of the model predicting CVD hospitalization using survey-derived education was significantly higher than the model using ZIP code-level education (0.77 versus 0.72; p < 0.001) and the model using ML model-predicted education (0.77 versus 0.75; p < 0.001). The AUROC for the model using ML model-predicted education was also significantly higher than that using ZIP code-level education (p = 0.003). CONCLUSION: The concordance of survey and ZIP code-level educational attainment in NYC was low. As expected, the model utilizing survey-derived education achieved the highest performance. The model incorporating our ML model-predicted education outperformed the model relying on ZIP code-derived education. Implementing ML techniques can improve the accuracy of SDOH data and consequently increase the predictive performance of outcome models.

Derivation, External Validation and Clinical Implications of a deep learning approach for intracranial pressure estimation using non-cranial waveform measurements.

Importance: Increased intracranial pressure (ICP) is associated with adverse neurological outcomes, but needs invasive monitoring. Objective: Development and validation of an AI approach for detecting increased ICP (aICP) using only non-invasive extracranial physiological waveform data. Design: Retrospective diagnostic study of AI-assisted detection of increased ICP. We developed an AI model using exclusively extracranial waveforms, externally validated it and assessed associations with clinical outcomes. Setting: MIMIC-III Waveform Database (2000-2013), a database derived from patients admitted to an ICU in an academic Boston hospital, was used for development of the aICP model, and to report association with neurologic outcomes. Data from Mount Sinai Hospital (2020-2022) in New York City was used for external validation. Participants: Patients were included if they were older than 18 years, and were monitored with electrocardiograms, arterial blood pressure, respiratory impedance plethysmography and pulse oximetry. Patients who additionally had intracranial pressure monitoring were used for development (N=157) and external validation (N=56). Patients without intracranial monitors were used for association with outcomes (N=1694). Exposures: Extracranial waveforms including electrocardiogram, arterial blood pressure, plethysmography and SpO2. Main Outcomes and Measures: Intracranial pressure > 15 mmHg. Measures were Area under receiver operating characteristic curves (AUROCs), sensitivity, specificity, and accuracy at threshold of 0.5. We calculated odds ratios and p-values for phenotype association. Results: The AUROC was 0.91 (95% CI, 0.90-0.91) on testing and 0.80 (95% CI, 0.80-0.80) on external validation. aICP had accuracy, sensitivity, and specificity of 73.8% (95% CI, 72.0%-75.6%), 99.5% (95% CI 99.3%-99.6%), and 76.9% (95% CI, 74.0-79.8%) on external validation. A ten-percentile increment was associated with stroke (OR=2.12; 95% CI, 1.27-3.13), brain malignancy (OR=1.68; 95% CI, 1.09-2.60), subdural hemorrhage (OR=1.66; 95% CI, 1.07-2.57), intracerebral hemorrhage (OR=1.18; 95% CI, 1.07-1.32), and procedures like percutaneous brain biopsy (OR=1.58; 95% CI, 1.15-2.18) and craniotomy (OR = 1.43; 95% CI, 1.12-1.84; P < 0.05 for all). Conclusions and Relevance: aICP provides accurate, non-invasive estimation of increased ICP, and is associated with neurological outcomes and neurosurgical procedures in patients without intracranial monitoring.

A novel method leveraging time series data to improve subphenotyping and application in critically ill patients with COVID-19.

Computational subphenotyping, a data-driven approach to understanding disease subtypes, is a prominent topic in medical research. Numerous ongoing studies are dedicated to developing advanced computational subphenotyping methods for cross-sectional data. However, the potential of time-series data has been underexplored until now. Here, we propose a Multivariate Levenshtein Distance (MLD) that can account for address correlation in multiple discrete features over time-series data. Our algorithm has two distinct components: it integrates an optimal threshold score to enhance the sensitivity in discriminating between pairs of instances, and the MLD itself. We have applied the proposed distance metrics on the k-means clustering algorithm to derive temporal subphenotypes from time-series data of biomarkers and treatment administrations from 1039 critically ill patients with COVID-19 and compare its effectiveness to standard methods. In conclusion, the Multivariate Levenshtein Distance metric is a novel method to quantify the distance from multiple discrete features over time-series data and demonstrates superior clustering performance among competing time-series distance metrics.

Persistent complement dysregulation with signs of thromboinflammation in active Long Covid.

Long Covid is a debilitating condition of unknown etiology. We performed multimodal proteomics analyses of blood serum from COVID-19 patients followed up to 12 months after confirmed severe acute respiratory syndrome coronavirus 2 infection. Analysis of >6500 proteins in 268 longitudinal samples revealed dysregulated activation of the complement system, an innate immune protection and homeostasis mechanism, in individuals experiencing Long Covid. Thus, active Long Covid was characterized by terminal complement system dysregulation and ongoing activation of the alternative and classical complement pathways, the latter associated with increased antibody titers against several herpesviruses possibly stimulating this pathway. Moreover, markers of hemolysis, tissue injury, platelet activation, and monocyte-platelet aggregates were increased in Long Covid. Machine learning confirmed complement and thromboinflammatory proteins as top biomarkers, warranting diagnostic and therapeutic interrogation of these systems.

Older adults with epilepsy and COVID-19: Outcomes in a multi-hospital health system.

BACKGROUND: Coronavirus disease 2019 (COVID-19) is associated with high rates of mortality and morbidity in older adults, especially those with pre-existing conditions. There is little work investigating how neurological conditions affect older adults with COVID-19. We aimed to compare in-hospital outcomes, including mortality, in older adults with and without epilepsy. METHODS: This retrospective study in a large multicenter New York health system included consecutive older patients (age ≥65 years) either with or without epilepsy who were admitted with COVID-19 between 3/2020-5/2021. Epilepsy was identified using a validated International Classification of Disease (ICD) and antiseizure medicationbased case definition. Univariate comparisons were calculated using Chi-square, Fisher's exact, Mann-Whitney U, or Student's t-tests. Multivariable logistic regression models were generated to examine factors associated with mortality, discharge disposition and length of stay (LOS). RESULTS: We identified 5384 older adults admitted with COVID-19 of whom 173 (3.21 %) had epilepsy. Mean age was significantly lower in those with (75.44, standard deviation (SD): 7.23) compared to those without epilepsy (77.98, SD: 8.68, p = 0.007). Older adults with epilepsy were more likely to be ventilated (35.84 % vs. 16.18 %, p < 0.001), less likely to be discharged home (21.39 % vs. 43.12 %, p < 0.001), had longer median LOS (13 days vs. 8 days, p < 0.001), and had higher in-hospital death (35.84 % vs. 28.29 %, p = 0.030) compared to those without epilepsy. Epilepsy in older adults was associated with increased odds of in-hospital death (adjusted odds ratio (aOR), 1.55; 95 % CI 1.12-2.14, p = 0.032), non-routine discharge disposition (aOR, 3.34; 95 % CI 2.21-5.03, p < 0.001), and longer LOS (46.46 % 95 % CI 34 %-59 %, p < 0.001). CONCLUSIONS: In models that adjusted for multiple confounders including comorbidity and age, our study found that epilepsy was still associated with higher in-hospital mortality, longer LOS and worse discharge dispositions in older adults with COVID-19 higher in-hospital mortality, longer LOS and worse discharge dispositions in older adults with COVID-19. This work reinforces that epilepsy is a risk factor for worse outcomes in older adults admitted with COVID-19. Timely identification and treatment of COVID-19 in epilepsy may improve outcomes in older people with epilepsy.

Quantitative Prediction of Right Ventricular Size and Function From the ECG.

BACKGROUND: Right ventricular ejection fraction (RVEF) and end-diastolic volume (RVEDV) are not readily assessed through traditional modalities. Deep learning-enabled ECG analysis for estimation of right ventricular (RV) size or function is unexplored. METHODS AND RESULTS: We trained a deep learning-ECG model to predict RV dilation (RVEDV >120 mL/m2), RV dysfunction (RVEF ≤40%), and numerical RVEDV and RVEF from a 12-lead ECG paired with reference-standard cardiac magnetic resonance imaging volumetric measurements in UK Biobank (UKBB; n=42 938). We fine-tuned in a multicenter health system (MSHoriginal [Mount Sinai Hospital]; n=3019) with prospective validation over 4 months (MSHvalidation; n=115). We evaluated performance with area under the receiver operating characteristic curve for categorical and mean absolute error for continuous measures overall and in key subgroups. We assessed the association of RVEF prediction with transplant-free survival with Cox proportional hazards models. The prevalence of RV dysfunction for UKBB/MSHoriginal/MSHvalidation cohorts was 1.0%/18.0%/15.7%, respectively. RV dysfunction model area under the receiver operating characteristic curve for UKBB/MSHoriginal/MSHvalidation cohorts was 0.86/0.81/0.77, respectively. The prevalence of RV dilation for UKBB/MSHoriginal/MSHvalidation cohorts was 1.6%/10.6%/4.3%. RV dilation model area under the receiver operating characteristic curve for UKBB/MSHoriginal/MSHvalidation cohorts was 0.91/0.81/0.92, respectively. MSHoriginal mean absolute error was RVEF=7.8% and RVEDV=17.6 mL/m2. The performance of the RVEF model was similar in key subgroups including with and without left ventricular dysfunction. Over a median follow-up of 2.3 years, predicted RVEF was associated with adjusted transplant-free survival (hazard ratio, 1.40 for each 10% decrease; P=0.031). CONCLUSIONS: Deep learning-ECG analysis can identify significant cardiac magnetic resonance imaging RV dysfunction and dilation with good performance. Predicted RVEF is associated with clinical outcome.

The genetic contribution to the comorbidity of depression and anxiety: a multi-site electronic health records study of almost 178 000 people.

BACKGROUND: Depression and anxiety are common and highly comorbid, and their comorbidity is associated with poorer outcomes posing clinical and public health concerns. We evaluated the polygenic contribution to comorbid depression and anxiety, and to each in isolation. METHODS: Diagnostic codes were extracted from electronic health records for four biobanks [N = 177 865 including 138 632 European (77.9%), 25 612 African (14.4%), and 13 621 Hispanic (7.7%) ancestry participants]. The outcome was a four-level variable representing the depression/anxiety diagnosis group: neither, depression-only, anxiety-only, and comorbid. Multinomial regression was used to test for association of depression and anxiety polygenic risk scores (PRSs) with the outcome while adjusting for principal components of ancestry. RESULTS: In total, 132 960 patients had neither diagnosis (74.8%), 16 092 depression-only (9.0%), 13 098 anxiety-only (7.4%), and 16 584 comorbid (9.3%). In the European meta-analysis across biobanks, both PRSs were higher in each diagnosis group compared to controls. Notably, depression-PRS (OR 1.20 per s.d. increase in PRS; 95% CI 1.18-1.23) and anxiety-PRS (OR 1.07; 95% CI 1.05-1.09) had the largest effect when the comorbid group was compared with controls. Furthermore, the depression-PRS was significantly higher in the comorbid group than the depression-only group (OR 1.09; 95% CI 1.06-1.12) and the anxiety-only group (OR 1.15; 95% CI 1.11-1.19) and was significantly higher in the depression-only group than the anxiety-only group (OR 1.06; 95% CI 1.02-1.09), showing a genetic risk gradient across the conditions and the comorbidity. CONCLUSIONS: This study suggests that depression and anxiety have partially independent genetic liabilities and the genetic vulnerabilities to depression and anxiety make distinct contributions to comorbid depression and anxiety.

Peripheral Transcriptomics in Acute and Long-Term Kidney Dysfunction in SARS-CoV2 Infection.

Background: Acute kidney injury (AKI) is common in hospitalized patients with SARS-CoV2 infection despite vaccination and leads to long-term kidney dysfunction. However, peripheral blood molecular signatures in AKI from COVID-19 and their association with long-term kidney dysfunction are yet unexplored. Methods: In patients hospitalized with SARS-CoV2, we performed bulk RNA sequencing using peripheral blood mononuclear cells(PBMCs). We applied linear models accounting for technical and biological variability on RNA-Seq data accounting for false discovery rate (FDR) and compared functional enrichment and pathway results to a historical sepsis-AKI cohort. Finally, we evaluated the association of these signatures with long-term trends in kidney function. Results: Of 283 patients, 106 had AKI. After adjustment for sex, age, mechanical ventilation, and chronic kidney disease (CKD), we identified 2635 significant differential gene expressions at FDR<0.05. Top canonical pathways were EIF2 signaling, oxidative phosphorylation, mTOR signaling, and Th17 signaling, indicating mitochondrial dysfunction and endoplasmic reticulum (ER) stress. Comparison with sepsis associated AKI showed considerable overlap of key pathways (48.14%). Using follow-up estimated glomerular filtration rate (eGFR) measurements from 115 patients, we identified 164/2635 (6.2%) of the significantly differentiated genes associated with overall decrease in long-term kidney function. The strongest associations were 'autophagy', 'renal impairment via fibrosis', and 'cardiac structure and function'. Conclusions: We show that AKI in SARS-CoV2 is a multifactorial process with mitochondrial dysfunction driven by ER stress whereas long-term kidney function decline is associated with cardiac structure and function and immune dysregulation. Functional overlap with sepsis-AKI also highlights common signatures, indicating generalizability in therapeutic approaches. SIGNIFICANCE STATEMENT: Peripheral transcriptomic findings in acute and long-term kidney dysfunction after hospitalization for SARS-CoV2 infection are unclear. We evaluated peripheral blood molecular signatures in AKI from COVID-19 (COVID-AKI) and their association with long-term kidney dysfunction using the largest hospitalized cohort with transcriptomic data. Analysis of 283 hospitalized patients of whom 37% had AKI, highlighted the contribution of mitochondrial dysfunction driven by endoplasmic reticulum stress in the acute stages. Subsequently, long-term kidney function decline exhibits significant associations with markers of cardiac structure and function and immune mediated dysregulation. There were similar biomolecular signatures in other inflammatory states, such as sepsis. This enhances the potential for repurposing and generalizability in therapeutic approaches.

Comparing ChatGPT and GPT-4 performance in USMLE soft skill assessments.

The United States Medical Licensing Examination (USMLE) has been a subject of performance study for artificial intelligence (AI) models. However, their performance on questions involving USMLE soft skills remains unexplored. This study aimed to evaluate ChatGPT and GPT-4 on USMLE questions involving communication skills, ethics, empathy, and professionalism. We used 80 USMLE-style questions involving soft skills, taken from the USMLE website and the AMBOSS question bank. A follow-up query was used to assess the models' consistency. The performance of the AI models was compared to that of previous AMBOSS users. GPT-4 outperformed ChatGPT, correctly answering 90% compared to ChatGPT's 62.5%. GPT-4 showed more confidence, not revising any responses, while ChatGPT modified its original answers 82.5% of the time. The performance of GPT-4 was higher than that of AMBOSS's past users. Both AI models, notably GPT-4, showed capacity for empathy, indicating AI's potential to meet the complex interpersonal, ethical, and professional demands intrinsic to the practice of medicine.

Implications of the Use of Artificial Intelligence Predictive Models in Health Care Settings : A Simulation Study.

BACKGROUND: Substantial effort has been directed toward demonstrating uses of predictive models in health care. However, implementation of these models into clinical practice may influence patient outcomes, which in turn are captured in electronic health record data. As a result, deployed models may affect the predictive ability of current and future models. OBJECTIVE: To estimate changes in predictive model performance with use through 3 common scenarios: model retraining, sequentially implementing 1 model after another, and intervening in response to a model when 2 are simultaneously implemented. DESIGN: Simulation of model implementation and use in critical care settings at various levels of intervention effectiveness and clinician adherence. Models were either trained or retrained after simulated implementation. SETTING: Admissions to the intensive care unit (ICU) at Mount Sinai Health System (New York, New York) and Beth Israel Deaconess Medical Center (Boston, Massachusetts). PATIENTS: 130 000 critical care admissions across both health systems. INTERVENTION: Across 3 scenarios, interventions were simulated at varying levels of clinician adherence and effectiveness. MEASUREMENTS: Statistical measures of performance, including threshold-independent (area under the curve) and threshold-dependent measures. RESULTS: At fixed 90% sensitivity, in scenario 1 a mortality prediction model lost 9% to 39% specificity after retraining once and in scenario 2 a mortality prediction model lost 8% to 15% specificity when created after the implementation of an acute kidney injury (AKI) prediction model; in scenario 3, models for AKI and mortality prediction implemented simultaneously, each led to reduced effective accuracy of the other by 1% to 28%. LIMITATIONS: In real-world practice, the effectiveness of and adherence to model-based recommendations are rarely known in advance. Only binary classifiers for tabular ICU admissions data were simulated. CONCLUSION: In simulated ICU settings, a universally effective model-updating approach for maintaining model performance does not seem to exist. Model use may have to be recorded to maintain viability of predictive modeling. PRIMARY FUNDING SOURCE: National Center for Advancing Translational Sciences.

Deep learning on electronic medical records identifies distinct subphenotypes of diabetic kidney disease driven by genetic variations in the Rho pathway.

Kidney disease affects 50% of all diabetic patients; however, prediction of disease progression has been challenging due to inherent disease heterogeneity. We use deep learning to identify novel genetic signatures prognostically associated with outcomes. Using autoencoders and unsupervised clustering of electronic health record data on 1,372 diabetic kidney disease patients, we establish two clusters with differential prevalence of end-stage kidney disease. Exome-wide associations identify a novel variant in ARHGEF18, a Rho guanine exchange factor specifically expressed in glomeruli. Overexpression of ARHGEF18 in human podocytes leads to impairments in focal adhesion architecture, cytoskeletal dynamics, cellular motility, and RhoA/Rac1 activation. Mutant GEF18 is resistant to ubiquitin mediated degradation leading to pathologically increased protein levels. Our findings uncover the first known disease-causing genetic variant that affects protein stability of a cytoskeletal regulator through impaired degradation, a potentially novel class of expression quantitative trait loci that can be therapeutically targeted.

Development of a decentralized cohort for studying post-acute sequelae of COVID-19 in India in the Data4life Study.

BACKGROUND: Decentralized, digital health studies can provide real-world evidence of the lasting effects of COVID-19 on physical, socioeconomic, psychological, and social determinant factors of health in India. Existing research cohorts, however, are small and were not designed for longitudinal collection of comprehensive data from India's diverse population. Data4Life is a nationwide, digitally enabled, health research initiative to examine the post-acute sequelae of COVID-19 across individuals, communities, and regions. Data4Life seeks to build an ethnically and geographically diverse population of at least 100,000 participants in India. METHODS: Here we discuss the feasibility of developing a completely decentralized COVID-19 cohort in India through qualitative analysis of data collection procedures, participant characteristics, participant perspectives on recruitment and reported study motivation. RESULTS: As of June 13th, 2022, more than 6,000 participants from 17 Indian states completed baseline surveys. Friend and family referral were identified as the most common recruitment method (64.8%) across all demographic groups. Helping family and friends was the primary reason reported for joining the study (61.5%). CONCLUSIONS: Preliminary findings support the use of digital technology for rapid enrollment and data collection to develop large health research cohorts in India. This demonstrates the potential for expansion of digitally enabled health research in India. These findings also outline the value of person-to-person recruitment strategies when conducting digital health research in modern-day India. Qualitative analysis reveals opportunities to increase diversity and retention in real time. It also informs strategies for improving participant experiences in the current Data4Life initiative and future studies.

Due to the vast geographical size and ethnic diversity of the population, India represents a huge challenge for conducting research studies. The Data4Life study was set up to understand if digital tools can be an effective way to study long-term effects of COVID-19 across India. We studied different ways of collecting the relevant information from participants, the background of each participant, reasons, and motivation of each participant for joining the study. The results showed that friend and family referrals were the most common recruitment reason. Helping family and friends was reported as the main motivation for joining the study. Overall, the findings support the use of digital tools as an effective recruitment method for research studies in India.

In-hospital outcomes in patients with and without epilepsy diagnosed with COVID-19-A cohort study.

OBJECTIVES: Coronavirus disease 2019 (COVID-19) is associated with mortality in persons with comorbidities. The aim of this study was to evaluate in-hospital outcomes in patients with COVID-19 with and without epilepsy. METHODS: We conducted a retrospective study of patients with COVID-19 admitted to a multicenter health system between March 15, 2020, and May 17, 2021. Patients with epilepsy were identified using a validated International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM)/ICD-10-CM case definition. Logistic regression models and Kaplan-Meier analyses were conducted for mortality and non-routine discharges (i.e., not discharged home). An ordinary least-squares regression model was fitted for length of stay (LOS). RESULTS: We identified 9833 people with COVID-19 including 334 with epilepsy. On univariate analysis, people with epilepsy had significantly higher ventilator use (37.70% vs 14.30%, p < .001), intensive care unit (ICU) admissions (39.20% vs 17.70%, p < .001) mortality rate (29.60% vs 19.90%, p < .001), and longer LOS (12 days vs 7 days, p < .001). and fewer were discharged home (29.64% vs 57.37%, p < .001). On multivariate analysis, only non-routine discharge (adjusted odds ratio [aOR] 2.70, 95% confidence interval [CI] 2.00-3.70; p < .001) and LOS (32.50% longer, 95% CI 22.20%-43.60%; p < .001) were significantly different. Factors associated with higher odds of mortality in epilepsy were older age (aOR 1.05, 95% CI 1.03-1.08; p < .001), ventilator support (aOR 7.18, 95% CI 3.12-16.48; p < .001), and higher Charlson comorbidity index (CCI) (aOR 1.18, 95% CI 1.04-1.34; p = .010). In epilepsy, admissions between August and December 2020 or January and May 2021 were associated with a lower odds of non-routine discharge and decreased LOS compared to admissions between March and July 2020, but this difference was not statistically significant. SIGNIFICANCE: People with COVID-19 who had epilepsy had a higher odds of non-routine discharge and longer LOS but not higher mortality. Older age (≥65), ventilator use, and higher CCI were associated with COVID-19 mortality in epilepsy. This suggests that older adults with epilepsy and multimorbidity are more vulnerable than those without and should be monitored closely in the setting of COVID-19.