Detection of virtual reality motion sickness based on EEG using asymmetry of entropy and cross-frequency coupling.

The existence of Virtual Reality Motion Sickness (VRMS) is a key factor restricting the further development of the VR industry, and the premise to solve this problem is to be able to accurately and effectively detect its occurrence. In view of the current lack of high-accuracy and effective detection methods, this paper proposes a VRMS detection method based on entropy asymmetry and cross-frequency coupling value asymmetry of EEG. First of all, the EEG of the four selected pairs of electrodes on the bilateral brain are subjected to Multivariate Variational Mode Decomposition (MVMD) respectively, and three types of entropy values on the low-frequency and high-frequency components are calculated, namely approximate entropy, fuzzy entropy and permutation entropy, as well as three types of phase-amplitude coupling features between the low-frequency and high-frequency components, namely the mean value, standard deviation and correlation coefficient; Secondly, the difference of the entropies and the cross-frequency coupling features between the left electrodes and the right electrodes are calculated; Finally, the final feature set are selected via t-test and fed into the SVM for classification, thus realizing the automatic detection of VRMS. The results show that the three classification indexes under this method, i.e., accuracy, sensitivity and specificity, reach 99.5 %, 99.3 % and 99.7 %, respectively, and the value of the area under the ROC curve reached 1, which proves that this method can be an effective indicator for detecting the occurrence of VRMS.

EEG classification model for virtual reality motion sickness based on multi-scale CNN feature correlation.

BACKGROUND: Virtual reality motion sickness (VRMS) is a key issue hindering the development of virtual reality technology, and accurate detection of its occurrence is the first prerequisite for solving the issue. OBJECTIVE: In this paper, a convolutional neural network (CNN) EEG detection model based on multi-scale feature correlation is proposed for detecting VRMS. METHODS: The model uses multi-scale 1D convolutional layers to extract multi-scale temporal features from the multi-lead EEG data, and then calculates the feature correlations of the extracted multi-scale features among all the leads to form the feature adjacent matrixes, which converts the time-domain features to correlation-based brain network features, thus strengthen the feature representation. Finally, the correlation features of each layer are fused. The fused features are then fed into the channel attention module to filter the channels and classify them using a fully connected network. Finally, we recruit subjects to experience 6 different modes of virtual roller coaster scenes, and collect resting EEG data before and after the task to verify the model. RESULTS: The results show that the accuracy, precision, recall and F1-score of this model for the recognition of VRMS are 98.66 %, 98.65 %, 98.68 %, and 98.66 %, respectively. The proposed model outperforms the current classic and advanced EEG recognition models. SIGNIFICANCE: It shows that this model can be used for the recognition of VRMS based on the resting state EEG.