Emotion recognition based on group phase locking value using convolutional neural network.

Electroencephalography (EEG)-based emotion recognition is an important technology for human-computer interactions. In the field of neuromarketing, emotion recognition based on group EEG can be used to analyze the emotional states of multiple users. Previous emotion recognition experiments have been based on individual EEGs; therefore, it is difficult to use them for estimating the emotional states of multiple users. The purpose of this study is to find a data processing method that can improve the efficiency of emotion recognition. In this study, the DEAP dataset was used, which comprises EEG signals of 32 participants that were recorded as they watched 40 videos with different emotional themes. This study compared emotion recognition accuracy based on individual and group EEGs using the proposed convolutional neural network model. Based on this study, we can see that the differences of phase locking value (PLV) exist in different EEG frequency bands when subjects are in different emotional states. The results showed that an emotion recognition accuracy of up to 85% can be obtained for group EEG data by using the proposed model. It means that using group EEG data can effectively improve the efficiency of emotion recognition. Moreover, the significant emotion recognition accuracy for multiple users achieved in this study can contribute to research on handling group human emotional states.

Attention allocation on mobile app interfaces when human interacts with them.

With the popularity of smartphones and the pervasion of mobile apps, people spend more and more time to interact with a diversity of apps on their smartphones, especially for young population. This raises a question: how people allocate attention to interfaces of apps during using them. To address this question, we, in this study, designed an experiment with two sessions (i.e., Session1: browsing original interfaces; Session 2: browsing interfaces after removal of colors and background) integrating with an eyetracking system. Attention fixation durations were recorded by an eye-tracker while participants browsed app interfaces. The whole screen of smartphone was divided into four even regions to explore fixation durations. The results revealed that participants gave significantly longer total fixation duration on the bottom left region compared to other regions in the session (1) Longer total fixation duration on the bottom was preserved, but there is no significant difference between left side and right side in the session2. Similar to the finding of total fixation duration, first fixation duration is also predominantly paid on the bottom area of the interface. Moreover, the skill in the use of mobile phone was quantified by assessing familiarity and accuracy of phone operation and was investigated in the association with the fixation durations. We found that first fixation duration of the bottom left region is significantly negatively correlated with the smartphone operation level in the session 1, but there is no significant correlation between them in the session (2) According to the results of ratio exploration, the ratio of the first fixation duration to the total fixation duration is not significantly different between areas of interest for both sessions. The findings of this study provide insights into the attention allocation during browsing app interfaces and are of implications on the design of app interfaces and advertisements as layout can be optimized according to the attention allocation to maximally deliver information.

A Hybrid System for Distinguishing between Brain Death and Coma Using Diverse EEG Features.

Electroencephalography (EEG) signals may provide abundant information reflecting the developmental changes in brain status. It usually takes a long time to finally judge whether a brain is dead, so an effective pre-test of brain states method is needed. In this paper, we present a hybrid processing pipeline to differentiate brain death and coma patients based on canonical correlation analysis (CCA) of power spectral density, complexity features, and feature fusion for group analysis. In addition, time-varying power spectrum and complexity were observed based on the analysis of individual patients, which can be used to monitor the change of brain status over time. Results showed three major differences between brain death and coma groups of EEG signal: slowing, increased complexity, and the improvement on classification accuracy with feature fusion. To the best of our knowledge, this is the first scheme for joint general analysis and time-varying state monitoring. Delta-band relative power spectrum density and permutation entropy could effectively be regarded as potential features of discrimination analysis on brain death and coma patients.