Study of a screening system for mild cognitive impairment based on machine learning model / 上海交通大学学报（医学版）

ABSTRACT

Objective:To evaluate the reliability and validity of a computerized cognitive assessment system designed for screening mild cognitive impairment (MCI), and compare the screening accuracy among constructed different machine learning classification models. Methods:A group of random stratified samples of over 55 years old residents in the communities, nursing homes and memory-clinics from Shanghai and Henan were selected to assess their cognitive status using Montreal Cognitive Assessment (MoCA) by well-trained investigators. The reliability and validity were assessed by intrinsic consistency analysis and factor analysis, respectively. Taking the results of MoCA as standards, four machine learning classification algorithms, i.e., naïve Bayesian classification model, random forest classifier, Logistic regression classifier, and K-nearest neighbor classifier, were compared in accuracy and area under curve (AUC). Results:A total of 359 participants were included, the median age of whom was 63 years old. And 82.80% of them were secondary school graduates or below. According to the results of MoCA, 147 of them might be MCI. The Cronbach's α and KMO of this system were 0.84 and 0.78, respectively; Bartlett's sphericity test was significant (P<0.05); thirteen common factors could explain 75.10% of the system. The best classification model was naïve Bayesian classification model, and its accuracy and AUC were 88.05% and 0.941, respectively. Conclusion:The new designed computerized cognitive assessment system has been proved to be reliable and valid. The naïve Bayesian classification model has good classification accuracy.