Corrigendum: Machine learning for the detection of social anxiety disorder using effective connectivity and graph theory measures.

[This corrects the article DOI: 10.3389/fpsyt.2023.1155812.].

Machine learning for the detection of social anxiety disorder using effective connectivity and graph theory measures.

Introduction: The early diagnosis and classification of social anxiety disorder (SAD) are crucial clinical support tasks for medical practitioners in designing patient treatment programs to better supervise the progression and development of SAD. This paper proposes an effective method to classify the severity of SAD into different grading (severe, moderate, mild, and control) by using the patterns of brain information flow with their corresponding graphical networks. Methods: We quantified the directed information flow using partial directed coherence (PDC) and the topological networks by graph theory measures at four frequency bands (delta, theta, alpha, and beta). The PDC assesses the causal interactions between neuronal units of the brain network. Besides, the graph theory of the complex network identifies the topological structure of the network. Resting-state electroencephalogram (EEG) data were recorded for 66 patients with different severities of SAD (22 severe, 22 moderate, and 22 mild) and 22 demographically matched healthy controls (HC). Results: PDC results have found significant differences between SAD groups and HCs in theta and alpha frequency bands (p < 0.05). Severe and moderate SAD groups have shown greater enhanced information flow than mild and HC groups in all frequency bands. Furthermore, the PDC and graph theory features have been used to discriminate three classes of SAD from HCs using several machine learning classifiers. In comparison to the features obtained by PDC, graph theory network features combined with PDC have achieved maximum classification performance with accuracy (92.78%), sensitivity (95.25%), and specificity (94.12%) using Support Vector Machine (SVM). Discussion: Based on the results, it can be concluded that the combination of graph theory features and PDC values may be considered an effective tool for SAD identification. Our outcomes may provide new insights into developing biomarkers for SAD diagnosis based on topological brain networks and machine learning algorithms.

A novel method for efficient estimation of brain effective connectivity in EEG.

BACKGROUND AND OBJECTIVE: Brain connectivity plays a pivotal role in understanding the brain's information processing functions by providing various details including magnitude, direction, and temporal dynamics of inter-neuron connections. While the connectivity may be classified as structural, functional and causal, a complete in-vivo directional analysis is guaranteed by the latter and is referred to as Effective Connectivity (EC). Two most widely used EC techniques are Directed Transfer Function (DTF) and Partial Directed Coherence (PDC) which are based on multivariate autoregressive models. The drawbacks of these techniques include poor frequency resolution and the requirement for experimental approach to determine signal normalization and thresholding techniques in identifying significant connectivities between multivariate sources. METHODS: In this study, the drawbacks of DTF and PDC are addressed by proposing a novel technique, termed as Efficient Effective Connectivity (EEC), for the estimation of EC between multivariate sources using AR spectral estimation and Granger causality principle. In EEC, a linear predictive filter with AR coefficients obtained via multivariate EEG is used for signal prediction. This leads to the estimation of full-length signals which are then transformed into frequency domain by using Burg spectral estimation method. Furthermore, the newly proposed normalization method addressed the effect on each source in EEC using the sum of maximum connectivity values over the entire frequency range. Lastly, the proposed dynamic thresholding works by subtracting the first moment of causal effects of all the sources on one source from individual connections present for that source. RESULTS: The proposed method is evaluated using synthetic and real resting-state EEG of 46 healthy controls. A 3D-Convolutional Neural Network is trained and tested using the PDC and EEC samples. The result indicates that compared to PDC, EEC improves the EEG eye-state classification accuracy, sensitivity and specificity by 5.57%, 3.15% and 8.74%, respectively. CONCLUSION: Correct identification of all connections in synthetic data and improved resting-state classification performance using EEC proved that EEC gives better estimation of directed causality and indicates that it can be used for reliable understanding of brain mechanisms. Conclusively, the proposed technique may open up new research dimensions for clinical diagnosis of mental disorders.

Effective Connectivity for Decoding Electroencephalographic Motor Imagery Using a Probabilistic Neural Network.

Motor imagery (MI)-based brain-computer interfaces have gained much attention in the last few years. They provide the ability to control external devices, such as prosthetic arms and wheelchairs, by using brain activities. Several researchers have reported the inter-communication of multiple brain regions during motor tasks, thus making it difficult to isolate one or two brain regions in which motor activities take place. Therefore, a deeper understanding of the brain's neural patterns is important for BCI in order to provide more useful and insightful features. Thus, brain connectivity provides a promising approach to solving the stated shortcomings by considering inter-channel/region relationships during motor imagination. This study used effective connectivity in the brain in terms of the partial directed coherence (PDC) and directed transfer function (DTF) as intensively unconventional feature sets for motor imagery (MI) classification. MANOVA-based analysis was performed to identify statistically significant connectivity pairs. Furthermore, the study sought to predict MI patterns by using four classification algorithms-an SVM, KNN, decision tree, and probabilistic neural network. The study provides a comparative analysis of all of the classification methods using two-class MI data extracted from the PhysioNet EEG database. The proposed techniques based on a probabilistic neural network (PNN) as a classifier and PDC as a feature set outperformed the other classification and feature extraction techniques with a superior classification accuracy and a lower error rate. The research findings indicate that when the PDC was used as a feature set, the PNN attained the greatest overall average accuracy of 98.65%, whereas the same classifier was used to attain the greatest accuracy of 82.81% with the DTF. This study validates the activation of multiple brain regions during a motor task by achieving better classification outcomes through brain connectivity as compared to conventional features. Since the PDC outperformed the DTF as a feature set with its superior classification accuracy and low error rate, it has great potential for application in MI-based brain-computer interfaces.

Analysis of Default Mode Network in Social Anxiety Disorder: EEG Resting-State Effective Connectivity Study.

Recent brain imaging findings by using different methods (e.g., fMRI and PET) have suggested that social anxiety disorder (SAD) is correlated with alterations in regional or network-level brain function. However, due to many limitations associated with these methods, such as poor temporal resolution and limited number of samples per second, neuroscientists could not quantify the fast dynamic connectivity of causal information networks in SAD. In this study, SAD-related changes in brain connections within the default mode network (DMN) were investigated using eight electroencephalographic (EEG) regions of interest. Partial directed coherence (PDC) was used to assess the causal influences of DMN regions on each other and indicate the changes in the DMN effective network related to SAD severity. The DMN is a large-scale brain network basically composed of the mesial prefrontal cortex (mPFC), posterior cingulate cortex (PCC)/precuneus, and lateral parietal cortex (LPC). The EEG data were collected from 88 subjects (22 control, 22 mild, 22 moderate, 22 severe) and used to estimate the effective connectivity between DMN regions at different frequency bands: delta (1-3 Hz), theta (4-8 Hz), alpha (8-12 Hz), low beta (13-21 Hz), and high beta (22-30 Hz). Among the healthy control (HC) and the three considered levels of severity of SAD, the results indicated a higher level of causal interactions for the mild and moderate SAD groups than for the severe and HC groups. Between the control and the severe SAD groups, the results indicated a higher level of causal connections for the control throughout all the DMN regions. We found significant increases in the mean PDC in the delta (p = 0.009) and alpha (p = 0.001) bands between the SAD groups. Among the DMN regions, the precuneus exhibited a higher level of causal influence than other regions. Therefore, it was suggested to be a major source hub that contributes to the mental exploration and emotional content of SAD. In contrast to the severe group, HC exhibited higher resting-state connectivity at the mPFC, providing evidence for mPFC dysfunction in the severe SAD group. Furthermore, the total Social Interaction Anxiety Scale (SIAS) was positively correlated with the mean values of the PDC of the severe SAD group, r (22) = 0.576, p = 0.006 and negatively correlated with those of the HC group, r (22) = -0.689, p = 0.001. The reported results may facilitate greater comprehension of the underlying potential SAD neural biomarkers and can be used to characterize possible targets for further medication.

Workplace design-related stress effects on prefrontal cortex connectivity and neurovascular coupling.

This study aims to evaluate the effect of workstation type on the neural and vascular networks of the prefrontal cortex (PFC) underlying the cognitive activity involved during mental stress. Workstation design has been reported to affect the physical and mental health of employees. However, while the functional effects of ergonomic workstations have been documented, there is little research on the influence of workstation design on the executive function of the brain. In this study, 23 healthy volunteers in ergonomic and non-ergonomic workstations completed the Montreal imaging stress task, while their brain activity was recorded using the synchronized measurement of electroencephalography and functional near-infrared spectroscopy. The results revealed desynchronization in alpha rhythms and oxygenated hemoglobin, as well as decreased functional connectivity in the PFC networks at the non-ergonomic workstations. Additionally, a significant increase in salivary alpha-amylase activity was observed in all participants at the non-ergonomic workstations, confirming the presence of induced stress. These findings suggest that workstation design can significantly impact cognitive functioning and human capabilities at work. Therefore, the use of functional neuroimaging in workplace design can provide critical information on the causes of workplace-related stress.

Frontal Electroencephalogram Alpha Asymmetry during Mental Stress Related to Workplace Noise.

This study aims to investigate the effects of workplace noise on neural activity and alpha asymmetries of the prefrontal cortex (PFC) during mental stress conditions. Workplace noise exposure is a pervasive environmental pollutant and is negatively linked to cognitive effects and selective attention. Generally, the stress theory is assumed to underlie the impact of noise on health. Evidence for the impacts of workplace noise on mental stress is lacking. Fifteen healthy volunteer subjects performed the Montreal imaging stress task in quiet and noisy workplaces while their brain activity was recorded using electroencephalography. The salivary alpha-amylase (sAA) was measured before and immediately after each tested workplace to evaluate the stress level. The results showed a decrease in alpha rhythms, or an increase in cortical activity, of the PFC for all participants at the noisy workplace. Further analysis of alpha asymmetry revealed a greater significant relative right frontal activation of the noisy workplace group at electrode pairs F4-F3 but not F8-F7. Furthermore, a significant increase in sAA activity was observed in all participants at the noisy workplace, demonstrating the presence of stress. The findings provide critical information on the effects of workplace noise-related stress that might be neglected during mental stress evaluations.

Effective Connectivity in Default Mode Network for Alcoholism Diagnosis.

Alcohol Use Disorder (AUD) is a chronic relapsing brain disease characterized by excessive alcohol use, loss of control over alcohol intake, and negative emotional states under no alcohol consumption. The key factor in successful treatment of AUD is the accurate diagnosis for better medical and therapy management. Conventionally, for individuals to be diagnosed with AUD, certain criteria as outlined in the Diagnostic and Statistical Manual of Mental Disorders (DSM) should be met. However, this process is subjective in nature and could be misleading due to memory problems and dishonesty of some AUD patients. In this paper, an assessment scheme for objective diagnosis of AUD is proposed. For this purpose, EEG recording of 31 healthy controls and 31 AUD patients are used for the calculation of effective connectivity (EC) between the various regions of the brain Default Mode Network (DMN). The EC is estimated using partial directed coherence (PDC) which are then used as input to a 3D Convolutional Neural Network (CNN) for binary classification of AUD cases. Using 5-fold cross validation, the classification of AUD vs. HC effective connectivity matrices using the proposed 3D-CNN gives an accuracy of 87.85 ± 4.64 %. For further validation, 32 and 30 subjects are randomly selected for training and testing, respectively, giving 100% correct classification of all the testing subjects.

Effects of Workstation Type on Mental Stress: FNIRS Study.

OBJECTIVE: The purpose of this study is to examine the effect of the workstation type on the severity of mental stress by means of measuring prefrontal cortex (PFC) activation using functional near-infrared spectroscopy. BACKGROUND: Workstation type is known to influence worker's health and performance. Despite the practical implications of ergonomic workstations, limited information is available regarding their impact on brain activity and executive functions. METHOD: Ten healthy participants performed a Montreal imaging stress task (MIST) in ergonomic and nonergonomic workstations to investigate their effects on the severity of the induced mental stress. RESULTS: Cortical hemodynamic changes in the PFC were observed during the MIST in both the ergonomic and nonergonomic workstations. However, the ergonomic workstation exhibited improved MIST performance, which was positively correlated with the cortical activation on the right ventrolateral and the left dorsolateral PFC, as well as a marked decrease in salivary alpha-amylase activity compared with that of the nonergonomic workstation. Further analysis using the NASA Task Load Index revealed a higher weighted workload score in the nonergonomic workstation than that in the ergonomic workstation. CONCLUSION: The findings suggest that ergonomic workstations could significantly improve cognitive functioning and human capabilities at work compared to a nonergonomic workstation. APPLICATION: Such a study could provide critical information on workstation design and development of mental stress that can be overlooked during traditional workstation design and mental stress assessments.

Effective Connectivity for Default Mode Network Analysis of Alcoholism.

Introduction: With the recent technical advances in brain imaging modalities such as magnetic resonance imaging, positron emission tomography, and functional magnetic resonance imaging (fMRI), researchers' interests have inclined over the years to study brain functions through the analysis of the variations in the statistical dependence among various brain regions. Through its wide use in studying brain connectivity, the low temporal resolution of the fMRI represented by the limited number of samples per second, in addition to its dependence on brain slow hemodynamic changes, makes it of limited capability in studying the fast underlying neural processes during information exchange between brain regions. Materials and Methods: In this article, the high temporal resolution of the electroencephalography (EEG) is utilized to estimate the effective connectivity within the default mode network (DMN). The EEG data are collected from 20 subjects with alcoholism and 25 healthy subjects (controls), and used to obtain the effective connectivity diagram of the DMN using the Partial Directed Coherence algorithm. Results: The resulting effective connectivity diagram within the DMN shows the unidirectional causal effect of each region on the other. The variations in the causal effects within the DMN between controls and alcoholics show clear correlation with the symptoms that are usually associated with alcoholism, such as cognitive and memory impairments, executive control, and attention deficiency. The correlation between the exchanged causal effects within the DMN and symptoms related to alcoholism is discussed and properly analyzed. Conclusion: The establishment of the causal differences between control and alcoholic subjects within the DMN regions provides valuable insight into the mechanism by which alcohol modulates our cognitive and executive functions and creates better possibility for effective treatment of alcohol use disorder.

Review of EEG, ERP, and Brain Connectivity Estimators as Predictive Biomarkers of Social Anxiety Disorder.

Social anxiety disorder (SAD) is characterized by a fear of negative evaluation, negative self-belief and extreme avoidance of social situations. These recurrent symptoms are thought to maintain the severity and substantial impairment in social and cognitive thoughts. SAD is associated with a disruption in neuronal networks implicated in emotional regulation, perceptual stimulus functions, and emotion processing, suggesting a network system to delineate the electrocortical endophenotypes of SAD. This paper seeks to provide a comprehensive review of the most frequently studied electroencephalographic (EEG) spectral coupling, event-related potential (ERP), visual-event potential (VEP), and other connectivity estimators in social anxiety during rest, anticipation, stimulus processing, and recovery states. A search on Web of Science provided 97 studies that document electrocortical biomarkers and relevant constructs pertaining to individuals with SAD. This study aims to identify SAD neuronal biomarkers and provide insight into the differences in these biomarkers based on EEG, ERPs, VEP, and brain connectivity networks in SAD patients and healthy controls (HC). Furthermore, we proposed recommendations to improve methods of delineating the electrocortical endophenotypes of SAD, e.g., a fusion of EEG with other modalities such as functional magnetic resonance imaging (fMRI) and magnetoencephalograms (MEG), to realize better effectiveness than EEG alone, in order to ultimately evolve the treatment selection process, and to review the possibility of using electrocortical measures in the early diagnosis and endophenotype examination of SAD.

Self-Motion-Assisted Tensor Completion Method for Background Initialization in Complex Video Sequences.

The background Initialization (BI) problem has attracted the attention of researchers in different image/video processing fields. Recently, a tensor-based technique called spatiotemporal slice-based singular value decomposition (SS-SVD) has been proposed for background initialization. SS-SVD applies the SVD on the tensor slices and estimates the background from low-rank information. Despite its efficiency in background initialization, the performance of SS-SVD requires further improvement in the case of complex sequences with challenges such as stationary foreground objects (SFOs), illumination changes, low frame-rate, and clutter. In this paper, a self-motion-assisted tensor completion method is proposed to overcome the limitations of SS-SVD in complex video sequences and enhance the visual appearance of the initialized background. With the proposed method, the motion information, extracted from the sparse portion of the tensor slices, is incorporated with the low-rank information of SS-SVD to eliminate existing artifacts in the initiated background. Efficient blending schemes between the low-rank (background) and sparse (foreground) information of the tensor slices is developed for scenarios such as SFO removal, lighting variation processing, low frame-rate processing, crowdedness estimation, and best frame selection. The performance of the proposed method on video sequences with complex scenarios is compared with the top-ranked state-of-the-art techniques in the field of background initialization. The results not only validate the improved performance over the majority of the tested challenges but also demonstrate the capability of the proposed method to initialize the background in less computational time.

Intersection-Based Link-Adaptive Beaconless Forwarding in Urban Vehicular Ad-Hoc Networks.

Remote monitoring applications in urban vehicular ad-hoc networks (VANETs) enable authorities to monitor data related to various activities of a moving vehicle from a static infrastructure. However, urban environment constraints along with various characteristics of remote monitoring applications give rise to significant hurdles while developing routing solutions in urban VANETs. Since the urban environment comprises several road intersections, using their geographic information can greatly assist in achieving efficient and reliable routing. With an aim to leverage this information, this article presents a receiver-based data forwarding protocol, termed Intersection-based Link-adaptive Beaconless Forwarding for City scenarios (ILBFC). ILBFC uses the position information of road intersections to effectively limit the duration for which a relay vehicle can stay as a default forwarder. In addition, a winner relay management scheme is employed to consider the drastic speed decay in vehicles. Furthermore, ILBFC is simulated in realistic urban traffic conditions, and its performance is compared with other existing state-of-the-art routing protocols in terms of packet delivery ratio, average end-to-end delay and packet redundancy coefficient. In particular, the results highlight the superior performance of ILBFC, thereby offering an efficient and reliable routing solution for remote monitoring applications.

Bayesian Algorithm Based Localization of EEG Recorded Electromagnetic Brain Activity.

BACKGROUND: Electrical signals are generated inside human brain due to any mental or physical task. This causes activation of several sources inside brain which are localized using various optimization algorithms. METHODS: Such activity is recorded through various neuroimaging techniques like fMRI, EEG, MEG etc. EEG signals based localization is termed as EEG source localization. The source localization problem is defined by two complementary problems; the forward problem and the inverse problem. The forward problem involves the modeling how the electromagnetic sources cause measurement in sensor space, while the inverse problem refers to the estimation of the sources (causes) from observed data (consequences). Usually, this inverse problem is ill-posed. In other words, there are many solutions to the inverse problem that explains the same data. This ill-posed problem can be finessed by using prior information within a Bayesian framework. This research work discusses source reconstruction for EEG data using a Bayesian framework. In particular, MSP, LORETA and MNE are compared. RESULTS: The results are compared in terms of variational free energy approximation to model evidence and in terms of variance accounted for in the sensor space. The results are taken for real time EEG data and synthetically generated EEG data at an SNR level of 10dB. CONCLUSION: In brief, it was seen that MSP has the highest evidence and lowest localization error when compared to classical models. Furthermore, the plausibility and consistency of the source reconstruction speaks to the ability of MSP technique to localize active brain sources.

SVD-based Tensor-Completion Technique for Background Initialization.

Extracting the background from a video in the presence of various moving patterns is the focus of several background-initialization approaches. To model the scene background using rank-one matrices, this paper proposes a background-initialization technique that relies on the singular-value decomposition (SVD) of spatiotemporally extracted slices from the video tensor. The proposed method is referred to as spatiotemporal slice-based SVD (SS-SVD). To determine the SVD components that best model the background, a depth analysis of the computation of the left/right singular vectors and singular values is performed, and the relationship with tensor-tube fibers is determined. The analysis proves that a rank-1 matrix extracted from the first left and right singular vectors and singular value represents an efficient model of the scene background. The performance of the proposed SS-SVD method is evaluated using 93 complex video sequences of different challenges, and the method is compared with state-of-the-art tensor/matrix completion-based methods, statistical-based methods, search-based methods, and labeling-based methods. The results not only show better performance over most of the tested challenges, but also demonstrate the capability of the proposed technique to solve the background-initialization problem in a less computational time and with fewer frames.

A study of decoding human brain activities from simultaneous data of EEG and fMRI using MVPA.

Neuroscientists have investigated the functionality of the brain in detail and achieved remarkable results but this area still need further research. Functional magnetic resonance imaging (fMRI) is considered as the most reliable and accurate technique to decode the human brain activity, on the other hand electroencephalography (EEG) is a portable and low cost solution in brain research. The purpose of this study is to find whether EEG can be used to decode the brain activity patterns like fMRI. In fMRI, data from a very specific brain region is enough to decode the brain activity patterns due to the quality of data. On the other hand, EEG can measure the rapid changes in neuronal activity patterns due to its higher temporal resolution i.e., in msec. These rapid changes mostly occur in different brain regions. In this study, multivariate pattern analysis (MVPA) is used both for EEG and fMRI data analysis and the information is extracted from distributed activation patterns of the brain. The significant information among different classes is extracted using two sample t test in both data sets. Finally, the classification analysis is done using the support vector machine. A fair comparison of both data sets is done using the same analysis techniques, moreover simultaneously collected data of EEG and fMRI is used for this comparison. The final analysis is done with the data of eight participants; the average result of all conditions are found which is 65.7% for EEG data set and 64.1% for fMRI data set. It concludes that EEG is capable of doing brain decoding with the data from multiple brain regions. In other words, decoding accuracy with EEG MVPA is as good as fMRI MVPA and is above chance level.

Mitigation of stress: new treatment alternatives.

Complaints of stress are common in modern life. Psychological stress is a major cause of lifestyle-related issues, contributing to poor quality of life. Chronic stress impedes brain function, causing impairment of many executive functions, including working memory, decision making and attentional control. The current study sought to describe newly developed stress mitigation techniques, and their influence on autonomic and endocrine functions. The literature search revealed that the most frequently studied technique for stress mitigation was biofeedback (BFB). However, evidence suggests that neurofeedback (NFB) and noninvasive brain stimulation (NIBS) could potentially provide appropriate approaches. We found that recent studies of BFB methods have typically used measures of heart rate variability, respiration and skin conductance. In contrast, studies of NFB methods have typically utilized neurocomputation techniques employing electroencephalography, functional magnetic resonance imaging and near infrared spectroscopy. NIBS studies have typically utilized transcranial direct current stimulation methods. Mitigation of stress is a challenging but important research target for improving quality of life.

An EEG-based functional connectivity measure for automatic detection of alcohol use disorder.

BACKGROUND: The abnormal alcohol consumption could cause toxicity and could alter the human brain's structure and function, termed as alcohol used disorder (AUD). Unfortunately, the conventional screening methods for AUD patients are subjective and manual. Hence, to perform automatic screening of AUD patients, objective methods are needed. The electroencephalographic (EEG) data have been utilized to study the differences of brain signals between alcoholics and healthy controls that could further developed as an automatic screening tool for alcoholics. METHOD: In this work, resting-state EEG-derived features were utilized as input data to the proposed feature selection and classification method. The aim was to perform automatic classification of AUD patients and healthy controls. The validation of the proposed method involved real-EEG data acquired from 30 AUD patients and 30 age-matched healthy controls. The resting-state EEG-derived features such as synchronization likelihood (SL) were computed involving 19 scalp locations resulted into 513 features. Furthermore, the features were rank-ordered to select the most discriminant features involving a rank-based feature selection method according to a criterion, i.e., receiver operating characteristics (ROC). Consequently, a reduced set of most discriminant features was identified and utilized further during classification of AUD patients and healthy controls. In this study, three different classification models such as Support Vector Machine (SVM), Naïve Bayesian (NB), and Logistic Regression (LR) were used. RESULTS: The study resulted into SVM classification accuracy=98%, sensitivity=99.9%, specificity=95%, and f-measure=0.97; LR classification accuracy=91.7%, sensitivity=86.66%, specificity=96.6%, and f-measure=0.90; NB classification accuracy=93.6%, sensitivity=100%, specificity=87.9%, and f-measure=0.95. CONCLUSION: The SL features could be utilized as objective markers to screen the AUD patients and healthy controls.

Decoding of visual activity patterns from fMRI responses using multivariate pattern analyses and convolutional neural network.

Decoding of human brain activity has always been a primary goal in neuroscience especially with functional magnetic resonance imaging (fMRI) data. In recent years, Convolutional neural network (CNN) has become a popular method for the extraction of features due to its higher accuracy, however it needs a lot of computation and training data. In this study, an algorithm is developed using Multivariate pattern analysis (MVPA) and modified CNN to decode the behavior of brain for different images with limited data set. Selection of significant features is an important part of fMRI data analysis, since it reduces the computational burden and improves the prediction performance; significant features are selected using t-test. MVPA uses machine learning algorithms to classify different brain states and helps in prediction during the task. General linear model (GLM) is used to find the unknown parameters of every individual voxel and the classification is done using multi-class support vector machine (SVM). MVPA-CNN based proposed algorithm is compared with region of interest (ROI) based method and MVPA based estimated values. The proposed method showed better overall accuracy (68.6%) compared to ROI (61.88%) and estimation values (64.17%).

Visual brain activity patterns classification with simultaneous EEG-fMRI: A multimodal approach.

BACKGROUND: Classification of the visual information from the brain activity data is a challenging task. Many studies reported in the literature are based on the brain activity patterns using either fMRI or EEG/MEG only. EEG and fMRI considered as two complementary neuroimaging modalities in terms of their temporal and spatial resolution to map the brain activity. For getting a high spatial and temporal resolution of the brain at the same time, simultaneous EEG-fMRI seems to be fruitful. METHODS: In this article, we propose a new method based on simultaneous EEG-fMRI data and machine learning approach to classify the visual brain activity patterns. We acquired EEG-fMRI data simultaneously on the ten healthy human participants by showing them visual stimuli. Data fusion approach is used to merge EEG and fMRI data. Machine learning classifier is used for the classification purposes. RESULTS: Results showed that superior classification performance has been achieved with simultaneous EEG-fMRI data as compared to the EEG and fMRI data standalone. This shows that multimodal approach improved the classification accuracy results as compared with other approaches reported in the literature. CONCLUSIONS: The proposed simultaneous EEG-fMRI approach for classifying the brain activity patterns can be helpful to predict or fully decode the brain activity patterns.