Number of necessary training examples for Neural Networks with different number of trainable parameters.

In this work, the network complexity should be reduced with a concomitant reduction in the number of necessary training examples. The focus thus was on the dependence of proper evaluation metrics on the number of adjustable parameters of the considered deep neural network. The used data set encompassed Hematoxylin and Eosin (H&E) colored cell images provided by various clinics. We used a deep convolutional neural network to get the relation between a model's complexity, its concomitant set of parameters, and the size of the training sample necessary to achieve a certain classification accuracy. The complexity of the deep neural networks was reduced by pruning a certain amount of filters in the network. As expected, the unpruned neural network showed best performance. The network with the highest number of trainable parameter achieved, within the estimated standard error of the optimized cross-entropy loss, best results up to 30% pruning. Strongly pruned networks are highly viable and the classification accuracy declines quickly with decreasing number of training patterns. However, up to a pruning ratio of 40%, we found a comparable performance of pruned and unpruned deep convolutional neural networks (DCNN) and densely connected convolutional networks (DCCN).

Forecasting brain activity based on models of spatiotemporal brain dynamics: A comparison of graph neural network architectures.

Comprehending the interplay between spatial and temporal characteristics of neural dynamics can contribute to our understanding of information processing in the human brain. Graph neural networks (GNNs) provide a new possibility to interpret graph-structured signals like those observed in complex brain networks. In our study we compare different spatiotemporal GNN architectures and study their ability to model neural activity distributions obtained in functional MRI (fMRI) studies. We evaluate the performance of the GNN models on a variety of scenarios in MRI studies and also compare it to a VAR model, which is currently often used for directed functional connectivity analysis. We show that by learning localized functional interactions on the anatomical substrate, GNN-based approaches are able to robustly scale to large network studies, even when available data are scarce. By including anatomical connectivity as the physical substrate for information propagation, such GNNs also provide a multimodal perspective on directed connectivity analysis, offering a novel possibility to investigate the spatiotemporal dynamics in brain networks.

Analysis of eyewitness testimony using electroencephalogram signals.

Face recognition and related psychological phenomenon have been the subject of neurocognitive studies during last decades. More recently the problem of face identification is also addressed to test the possibility of finding markers on the electroencephalogram signals. To this end, this work presents an experimental study where Brain Computer Interface strategies were implemented to find features on the signals that could discriminate between culprit and innocent. The feature extraction block comprises time domain and frequency domain characteristics of single-trial signals. The classification block is based on a support vector machine and its performance for the best ranked features. The data analysis comprises the signals of a cohort of 28 participants.

A graph neural network framework for causal inference in brain networks.

A central question in neuroscience is how self-organizing dynamic interactions in the brain emerge on their relatively static structural backbone. Due to the complexity of spatial and temporal dependencies between different brain areas, fully comprehending the interplay between structure and function is still challenging and an area of intense research. In this paper we present a graph neural network (GNN) framework, to describe functional interactions based on the structural anatomical layout. A GNN allows us to process graph-structured spatio-temporal signals, providing a possibility to combine structural information derived from diffusion tensor imaging (DTI) with temporal neural activity profiles, like that observed in functional magnetic resonance imaging (fMRI). Moreover, dynamic interactions between different brain regions discovered by this data-driven approach can provide a multi-modal measure of causal connectivity strength. We assess the proposed model's accuracy by evaluating its capabilities to replicate empirically observed neural activation profiles, and compare the performance to those of a vector auto regression (VAR), like that typically used in Granger causality. We show that GNNs are able to capture long-term dependencies in data and also computationally scale up to the analysis of large-scale networks. Finally we confirm that features learned by a GNN can generalize across MRI scanner types and acquisition protocols, by demonstrating that the performance on small datasets can be improved by pre-training the GNN on data from an earlier study. We conclude that the proposed multi-modal GNN framework can provide a novel perspective on the structure-function relationship in the brain. Accordingly this approach appears to be promising for the characterization of the information flow in brain networks.

Technical Note: A comparison of point set registration methods for electromagnetic tracking.

PURPOSE: High dose rate brachytherapy applies intense and destructive radiation. A treatment plan defines radiation source dwell positions to avoid irradiating healthy tissue. The study discusses methods to quantify any positional changes of source locations along the various treatment sessions. METHODS: Electromagnetic tracking (EMT) localizes the radiation source during the treatment sessions. But in each session the relative position of the patient relative to the filed generator is changed. Hence, the measured dwell point sets need to be registered onto each other to render them comparable. Two point set registration techniques are compared: a probabilistic method called coherent point drift (CPD) and a multidimensional scaling (MDS) technique. RESULTS: Both enable using EMT without external registration and achieve very similar results with respect to dwell position determination of the radiation source. Still MDS achieves smaller grand average deviations (CPD-rPSR: MD = 2.55 mm, MDS-PSR: MD = 2.15 mm) between subsequent dwell position determinations, which also show less variance (CPD-rPSR: IQR = 4 mm, MDS-PSR: IQR = 3 mm). Furthermore, MDS is not based on approximations and does not need an iterative procedure to track sensor positions inside the implanted catheters. CONCLUSION: Although both methods achieve similar results, MDS is to be preferred over rigid CPD while nonrigid CPD is unsuitable as it does not preserve topology.

Hybridizing EMD with cICA for fMRI Analysis of Patient Groups.

Independent component analysis (ICA), as a data driven method, has shown to be a powerful tool for functional magnetic resonance imaging (fMRI) data analysis. One drawback of this multivariate approach is, that it is naturally not convenient for analysis of group studies. Therefore various techniques have been proposed in order to overcome this limitation of ICA. In this paper a novel ICA based work-flow for extracting resting state networks from fMRI group studies is proposed. An empirical mode decomposition (EMD) is used to generate reference signals in a data driven manner, which can be incorporated into a constrained version of ICA (cICA), what helps to overcome the inherent ambiguities. The results of the proposed workflow are then compared to those obtained by a widely used group ICA approach. It is demonstrated that intrinsic modes, extracted by EMD, are suitable to serve as references for cICA to obtain typical resting state patterns, which are consistent over subjects. This novel processing pipeline makes it transparent for the user, how comparable activity patterns across subjects emerge, and also the trade-off between similarity across subjects and preserving individual features can be well adjusted and adapted for different requirements in the new work-flow.

Mining EEG scalp maps of independent components related to HCT tasks.

This work presents an unsupervised mining strategy, applied to an independent component analysis (ICA) of segments of data collected while participants are answering to the items of the Halstead Category Test (HCT). This new methodology was developed to achieve signal components at trial level and therefore to study signal dynamics which are not available within participants' ensemble average signals. The study will be focused on the signal component that can be elicited by the binary visual feedback which is part of the HCT protocol. The experimental study is conducted using a cohort of 58 participants.

A tool to automatically analyze electromagnetic tracking data from high dose rate brachytherapy of breast cancer patients.

During High Dose Rate Brachytherapy (HDR-BT) the spatial position of the radiation source inside catheters implanted into a female breast is determined via electromagnetic tracking (EMT). Dwell positions and dwell times of the radiation source are established, relative to the patient's anatomy, from an initial X-ray-CT-image. During the irradiation treatment, catheter displacements can occur due to patient movements. The current study develops an automatic analysis tool of EMT data sets recorded with a solenoid sensor to assure concordance of the source movement with the treatment plan. The tool combines machine learning techniques such as multi-dimensional scaling (MDS), ensemble empirical mode decomposition (EEMD), singular spectrum analysis (SSA) and particle filter (PF) to precisely detect and quantify any mismatch between the treatment plan and actual EMT measurements. We demonstrate that movement artifacts as well as technical signal distortions can be removed automatically and reliably, resulting in artifact-free reconstructed signals. This is a prerequisite for a highly accurate determination of any deviations of dwell positions from the treatment plan.

A multi-variate blind source separation algorithm.

BACKGROUND AND OBJECTIVE: The study follows the proposal of decomposing a given data matrix into a product of independent spatial and temporal component matrices. A multi-variate decomposition approach is presented, based on an approximate diagonalization of a set of matrices computed using a latent space representation. METHODS: The proposed methodology follows an algebraic approach, which is common to space, temporal or spatiotemporal blind source separation algorithms. More specifically, the algebraic approach relies on singular value decomposition techniques, which avoids computationally costly and numerically instable matrix inversion. The method is equally applicable to correlation matrices determined from second order correlations or by considering fourth order correlations. RESULTS: The resulting algorithms are applied to fMRI data sets either to extract the underlying fMRI components or to extract connectivity maps from resting state fMRI data collected for a dynamic functional connectivity analysis. Intriguingly, our algorithm shows increased spatial specificity compared to common approaches, while temporal precision stays similar. CONCLUSION: The study presents a novel spatiotemporal blind source separation algorithm, which is both robust and avoids parameters that are difficult to fine tune. Applied on experimental data sets, the new method yields highly confined and focused areas with least spatial extent in the retinotopy case, and similar results in the dynamic functional connectivity analyses compared to other blind source separation algorithms. Therefore, we conclude that our novel algorithm is highly competitive and yields results, which are superior or at least similar to existing approaches.

On the use of particle filters for electromagnetic tracking in high dose rate brachytherapy.

Modern radiotherapy of female breast cancers often employs high dose rate brachytherapy, where a radioactive source is moved inside catheters, implanted in the female breast, according to a prescribed treatment plan. Source localization relative to the patient's anatomy is determined with solenoid sensors whose spatial positions are measured with an electromagnetic tracking system. Precise sensor dwell position determination is of utmost importance to assure irradiation of the cancerous tissue according to the treatment plan. We present a hybrid data analysis system which combines multi-dimensional scaling with particle filters to precisely determine sensor dwell positions in the catheters during subsequent radiation treatment sessions. Both techniques are complemented with empirical mode decomposition for the removal of superimposed breathing artifacts. We show that the hybrid model robustly and reliably determines the spatial positions of all catheters used during the treatment and precisely determines any deviations of actual sensor dwell positions from the treatment plan. The hybrid system only relies on sensor positions measured with an EMT system and relates them to the spatial positions of the implanted catheters as initially determined with a computed x-ray tomography.

On the use of multi-dimensional scaling and electromagnetic tracking in high dose rate brachytherapy.

High dose rate brachytherapy affords a frequent reassurance of the precise dwell positions of the radiation source. The current investigation proposes a multi-dimensional scaling transformation of both data sets to estimate dwell positions without any external reference. Furthermore, the related distributions of dwell positions are characterized by uni-or bi-modal heavy-tailed distributions. The latter are well represented by α-stable distributions. The newly proposed data analysis provides dwell position deviations with high accuracy, and, furthermore, offers a convenient visualization of the actual shapes of the catheters which guide the radiation source during the treatment.

A combined cICA-EEMD analysis of EEG recordings from depressed or schizophrenic patients during olfactory stimulation.

OBJECTIVE: We propose a combination of a constrained independent component analysis (cICA) with an ensemble empirical mode decomposition (EEMD) to analyze electroencephalographic recordings from depressed or schizophrenic subjects during olfactory stimulation. APPROACH: EEMD serves to extract intrinsic modes (IMFs) underlying the recorded EEG time. The latter then serve as reference signals to extract the most similar underlying independent component within a constrained ICA. The extracted modes are further analyzed considering their power spectra. MAIN RESULTS: The analysis of the extracted modes reveals clear differences in the related power spectra between the disease characteristics of depressed and schizophrenic patients. Such differences appear in the high frequency γ-band in the intrinsic modes, but also in much more detail in the low frequency range in the α-, θ- and δ-bands. SIGNIFICANCE: The proposed method provides various means to discriminate both disease pictures in a clinical environment.

ERP correlates of error processing during performance on the Halstead Category Test.

The Halstead Category Test (HCT) is a neuropsychological test that measures a person's ability to formulate and apply abstract principles. Performance must be adjusted based on feedback after each trial and errors are common until the underlying rules are discovered. Event-related potential (ERP) studies associated with the HCT are lacking. This paper demonstrates the use of a methodology inspired on Singular Spectrum Analysis (SSA) applied to EEG signals, to remove high amplitude ocular and movement artifacts during performance on the test. This filtering technique introduces no phase or latency distortions, with minimum loss of relevant EEG information. Importantly, the test was applied in its original clinical format, without introducing adaptations to ERP recordings. After signal treatment, the feedback-related negativity (FRN) wave, which is related to error-processing, was identified. This component peaked around 250ms, after feedback, in fronto-central electrodes. As expected, errors elicited more negative amplitudes than correct responses. Results are discussed in terms of the increased clinical potential that coupling ERP information with behavioral performance data can bring to the specificity of the HCT in diagnosing different types of impairment in frontal brain function.

Alzheimer's Disease Brain Areas: The Machine Learning Support for Blind Localization.

The analysis of positron emission tomography (PET) scan image is challenging due to a high level of noise and a low resolution and also because differences between healthy and demented are very subtle. High dimensional classification methods based on PET have been proposed to automatically discriminate between normal control group (NC) patients and patients with Alzheimer's disease (AD), with mild cognitive impairment (MCI), and mild cognitive impairment converting to Alzheimer's disease (MCIAD ) (a group of patients that clearly degrades to AD). We developed a voxelbased method for volumetric image analysis. We performed 3 classification experiments AD vs CG, AD vs MCI, MCIAD vs MCI. We will also give a small demonstration of the presented method on a set of face images. This method is capable to extract information about the location of metabolic changes induced by Alzheimer's disease that directly relies statistical features and brain regions of interest (ROIs). We produce "maps" to visualize the most informative regions of the brain and compare them with voxel-wise statistics. Using the mean intensity of about 2000 6 × 6 × 6mm patches, selected by the extracted map, as input for a classifier we obtain a classification rate of 95.5%.

Functional Biomedical Images of Alzheimer's Disease. A Green's Function-based Empirical Mode Decomposition Study.

Positron emission tomography (PET) provides a functional imaging modality to detect signs of dementias in human brains. Two-dimensional empirical mode decomposition (2D-EMD) provides means to analyze such images. It decomposes the latter into characteristic modes which represent textures on different spatial scales. These textures provide informative features for subsequent classification purposes. The study proposes a new EMD variant which relies on a Green's function based estimation method including a tension parameter to fast and reliably estimate the envelope hypersurfaces interpolating extremal points of the two-dimensional intensity distrubution of the images. The new method represents a fast and stable bi-dimensional EMD which speeds up computations roughly 100-fold. In combination with proper classifiers these exploratory feature extraction techniques can form a computer aided diagnosis (CAD) system to assist clinicians in identifying various diseases from functional images alone. PET images of subjects suffering from Alzheimer's disease are taken to illustrate this ability.

EMDLAB: A toolbox for analysis of single-trial EEG dynamics using empirical mode decomposition.

BACKGROUND: Empirical mode decomposition (EMD) is an empirical data decomposition technique. Recently there is growing interest in applying EMD in the biomedical field. NEW METHOD: EMDLAB is an extensible plug-in for the EEGLAB toolbox, which is an open software environment for electrophysiological data analysis. RESULTS: EMDLAB can be used to perform, easily and effectively, four common types of EMD: plain EMD, ensemble EMD (EEMD), weighted sliding EMD (wSEMD) and multivariate EMD (MEMD) on EEG data. In addition, EMDLAB is a user-friendly toolbox and closely implemented in the EEGLAB toolbox. COMPARISON WITH EXISTING METHODS: EMDLAB gains an advantage over other open-source toolboxes by exploiting the advantageous visualization capabilities of EEGLAB for extracted intrinsic mode functions (IMFs) and Event-Related Modes (ERMs) of the signal. CONCLUSIONS: EMDLAB is a reliable, efficient, and automated solution for extracting and visualizing the extracted IMFs and ERMs by EMD algorithms in EEG study.

EEG study on affective valence elicited by novel and familiar pictures using ERD/ERS and SVM-RFE.

EEG signals have been widely explored in emotional processing analyses, both in time and frequency domains. However, in such studies, habituation phenomenon is barely considered in the discrimination of different emotional responses. In this work, spectral features of the event-related potentials (ERPs) are studied by means of event-related desynchronization/synchronization computation. In order to determine the most relevant ERP features for distinguishing how positive and negative affective valences are processed within the brain, support vector machine-recursive feature elimination is employed. The proposed approach was applied for investigating in which way the familiarity of stimuli affects the affective valence processing as well as which frequency bands and scalp regions are more involved in this process. In a group composed of young adult women, results prove that parietooccipital region and theta band are especially involved in the processing of novelty in emotional stimuli. Furthermore, the proposed method has shown to perform successfully using a moderated number of trials.

Individual EEG differences in affective valence processing in women with low and high neuroticism.

OBJECTIVE: In this study, individual differences in brain electrophysiology during positive and negative affective valence processing in women with different neuroticism scores are quantified. METHODS: Twenty-six women scoring high and low on neuroticism participated on this experiment. A support vector machine (SVM)-based classifier was applied on the EEG single trials elicited by high arousal pictures with negative and positive valence scores. Based on the accuracy values obtained from subject identification tasks, the most distinguishing EEG channels among participants were detected, pointing which scalp regions show more distinct patterns. RESULTS: Significant differences were obtained, in the EEG heterogeneity between positive and negative valence stimuli, yielding higher accuracy in subject identification using negative pictures. Regarding the topographical analysis, significantly higher accuracy values were reached in occipital areas and in the right hemisphere (p < 0.001). CONCLUSIONS: Mainly, individual differences in EEG can be located in parietooccipital regions. These differences are likely to be due to the different reactivity and coping strategies to unpleasant stimuli in individuals with high neuroticism. In addition, the right hemisphere shows a greater individual specificity. SIGNIFICANCE: An SVM-based classifier asserts the individual specificity and its topographical differences in electrophysiological activity for women with high neuroticism compared to low neuroticism.

Brain connectivity analysis: a short survey.

This short survey the reviews recent literature on brain connectivity studies. It encompasses all forms of static and dynamic connectivity whether anatomical, functional, or effective. The last decade has seen an ever increasing number of studies devoted to deduce functional or effective connectivity, mostly from functional neuroimaging experiments. Resting state conditions have become a dominant experimental paradigm, and a number of resting state networks, among them the prominent default mode network, have been identified. Graphical models represent a convenient vehicle to formalize experimental findings and to closely and quantitatively characterize the various networks identified. Underlying these abstract concepts are anatomical networks, the so-called connectome, which can be investigated by functional imaging techniques as well. Future studies have to bridge the gap between anatomical neuronal connections and related functional or effective connectivities.

Exploratory matrix factorization for PET image analysis.

Features are extracted from PET images employing exploratory matrix factorization techniques such as nonnegative matrix factorization (NMF). Appropriate features are fed into classifiers such as a support vector machine or a random forest tree classifier. An automatic feature extraction and classification is achieved with high classification rate which is robust and reliable and can help in an early diagnosis of Alzheimer's disease.