Realness of face images can be decoded from non-linear modulation of EEG responses.

Artificially created human faces play an increasingly important role in our digital world. However, the so-called uncanny valley effect may cause people to perceive highly, yet not perfectly human-like faces as eerie, bringing challenges to the interaction with virtual agents. At the same time, the neurocognitive underpinnings of the uncanny valley effect remain elusive. Here, we utilized an electroencephalography (EEG) dataset of steady-state visual evoked potentials (SSVEP) in which participants were presented with human face images of different stylization levels ranging from simplistic cartoons to actual photographs. Assessing neuronal responses both in frequency and time domain, we found a non-linear relationship between SSVEP amplitudes and stylization level, that is, the most stylized cartoon images and the real photographs evoked stronger responses than images with medium stylization. Moreover, realness of even highly similar stylization levels could be decoded from the EEG data with task-related component analysis (TRCA). Importantly, we also account for confounding factors, such as the size of the stimulus face's eyes, which previously have not been adequately addressed. Together, this study provides a basis for future research and neuronal benchmarking of real-time detection of face realness regarding three aspects: SSVEP-based neural markers, efficient classification methods, and low-level stimulus confounders.

Cardiac activity impacts cortical motor excitability.

Human cognition and action can be influenced by internal bodily processes such as heartbeats. For instance, somatosensory perception is impaired both during the systolic phase of the cardiac cycle and when heartbeats evoke stronger cortical responses. Here, we test whether these cardiac effects originate from overall changes in cortical excitability. Cortical and corticospinal excitability were assessed using electroencephalographic and electromyographic responses to transcranial magnetic stimulation while concurrently monitoring cardiac activity with electrocardiography. Cortical and corticospinal excitability were found to be highest during systole and following stronger neural responses to heartbeats. Furthermore, in a motor task, hand-muscle activity and the associated desynchronization of sensorimotor oscillations were stronger during systole. These results suggest that systolic cardiac signals have a facilitatory effect on motor excitability-in contrast to sensory attenuation that was previously reported for somatosensory perception. Thus, it is possible that distinct time windows exist across the cardiac cycle, optimizing either perception or action.

Alterations in rhythmic and non-rhythmic resting-state EEG activity and their link to cognition in older age.

While many structural and biochemical changes in the brain have previously been associated with older age, findings concerning functional properties of neuronal networks, as reflected in their electrophysiological signatures, remain rather controversial. These discrepancies might arise due to several reasons, including diverse factors determining general spectral slowing in the alpha frequency range as well as amplitude mixing between the rhythmic and non-rhythmic parameters. We used a large dataset (N = 1703, mean age 70) to comprehensively investigate age-related alterations in multiple EEG biomarkers taking into account rhythmic and non-rhythmic activity and their individual contributions to cognitive performance. While we found strong evidence for an individual alpha peak frequency (IAF) decline in older age, we did not observe a significant relationship between theta power and age while controlling for IAF. Not only did IAF decline with age, but it was also positively associated with interference resolution in a working memory task primarily in the right and left temporal lobes suggesting its functional role in information sampling. Critically, we did not detect a significant relationship between alpha power and age when controlling for the 1/f spectral slope, while the latter one showed age-related alterations. These findings thus suggest that the entanglement of IAF slowing and power in the theta frequency range, as well as 1/f slope and alpha power measures, might explain inconsistencies reported previously in the literature. Finally, despite the absence of age-related alterations, alpha power was negatively associated with the speed of processing in the right frontal lobe while 1/f slope showed no consistent relationship to cognitive performance. Our results thus demonstrate that multiple electrophysiological features, as well as their interplay, should be considered for the comprehensive assessment of association between age, neuronal activity, and cognitive performance.

The impact of emotional facial expressions on reflexive attention depends on the aim of dynamic gaze changes: An ERP study.

The emotional expression and gaze direction of a face are important cues for human social interactions. However, the interplay of these factors and their neural correlates are only partially understood. In the current study, we investigated ERP correlates of gaze and emotion processing following the initial presentation of faces with different emotional expressions (happy, neutral, angry) and an averted or direct gaze direction as well as following a subsequent change in gaze direction that occurred in half of the trials. We focused on the time course and scalp topography of the N170 and EPN components. The N170 amplitude was larger to averted than direct gaze for the initial face presentation and larger to gaze changes from direct to averted than from averted to direct in response to the gaze change. For the EPN component in response to the initial face presentation, we replicate classic effects of emotion, which did not interact with gaze direction. As a major new finding, changes from direct to averted gaze elicited an EPN-like effect when the face showed a happy expression. No such effect was seen for angry expressions. We conclude that happy faces reflexively attract attention when they look at the observer rather than away from the observer. These results for happy expressions are in line with the shared signal hypothesis that posits a better processing of expressions if their approach or avoidance tendency is consistent with gaze direction. However, the shared signal hypothesis is not supported by the present results for angry faces.

Harmoni: A method for eliminating spurious interactions due to the harmonic components in neuronal data.

Cross-frequency synchronization (CFS) has been proposed as a mechanism for integrating spatially and spectrally distributed information in the brain. However, investigating CFS in Magneto- and Electroencephalography (MEG/EEG) is hampered by the presence of spurious neuronal interactions due to the non-sinusoidal waveshape of brain oscillations. Such waveshape gives rise to the presence of oscillatory harmonics mimicking genuine neuronal oscillations. Until recently, however, there has been no methodology for removing these harmonics from neuronal data. In order to address this long-standing challenge, we introduce a novel method (called HARMOnic miNImization - Harmoni) that removes the signal components which can be harmonics of a non-sinusoidal signal. Harmoni's working principle is based on the presence of CFS between harmonic components and the fundamental component of a non-sinusoidal signal. We extensively tested Harmoni in realistic EEG simulations. The simulated couplings between the source signals represented genuine and spurious CFS and within-frequency phase synchronization. Using diverse evaluation criteria, including ROC analyses, we showed that the within- and cross-frequency spurious interactions are suppressed significantly, while the genuine activities are not affected. Additionally, we applied Harmoni to real resting-state EEG data revealing intricate remote connectivity patterns which are usually masked by the spurious connections. Given the ubiquity of non-sinusoidal neuronal oscillations in electrophysiological recordings, Harmoni is expected to facilitate novel insights into genuine neuronal interactions in various research fields, and can also serve as a steppingstone towards the development of further signal processing methods aiming at refining within- and cross-frequency synchronization in electrophysiological recordings.

Respiration, Heartbeat, and Conscious Tactile Perception.

Previous studies have shown that timing of sensory stimulation during the cardiac cycle interacts with perception. Given the natural coupling of respiration and cardiac activity, we investigated here their joint effects on tactile perception. Forty-one healthy female and male human participants reported conscious perception of finger near-threshold electrical pulses (33% null trials) and decision confidence while electrocardiography, respiratory activity, and finger photoplethysmography were recorded. Participants adapted their respiratory cycle to expected stimulus onsets to preferentially occur during late inspiration/early expiration. This closely matched heart rate variation (sinus arrhythmia) across the respiratory cycle such that most frequent stimulation onsets occurred during the period of highest heart rate probably indicating highest alertness and cortical excitability. Tactile detection rate was highest during the first quadrant after expiration onset. Interindividually, stronger respiratory phase-locking to the task was associated with higher detection rates. Regarding the cardiac cycle, we confirmed previous findings that tactile detection rate was higher during diastole than systole and newly specified its minimum at 250-300 ms after the R-peak corresponding to the pulse wave arrival in the finger. Expectation of stimulation induced a transient heart deceleration which was more pronounced for unconfident decision ratings. Interindividually, stronger poststimulus modulations of heart rate were linked to higher detection rates. In summary, we demonstrate how tuning to the respiratory cycle and integration of respiratory-cardiac signals are used to optimize performance of a tactile detection task.SIGNIFICANCE STATEMENT Mechanistic studies on perception and cognition tend to focus on the brain neglecting contributions of the body. Here, we investigated how respiration and heartbeat influence tactile perception: respiration phase-locking to expected stimulus onsets corresponds to highest heart rate (and presumably alertness/cortical excitability) and correlates with detection performance. Tactile detection varies across the heart cycle with a minimum when the pulse reaches the finger and a maximum in diastole. Taken together with our previous finding of unchanged early event-related potentials across the cardiac cycle, we conclude that these effects are not a peripheral physiological artifact but a result of cognitive processes that model our body's internal state, make predictions to guide behavior, and might also tune respiration to serve the task.

Neural excitability and sensory input determine intensity perception with opposing directions in initial cortical responses.

Perception of sensory information is determined by stimulus features (e.g., intensity) and instantaneous neural states (e.g., excitability). Commonly, it is assumed that both are reflected similarly in evoked brain potentials, that is, larger amplitudes are associated with a stronger percept of a stimulus. We tested this assumption in a somatosensory discrimination task in humans, simultaneously assessing (i) single-trial excitatory post-synaptic currents inferred from short-latency somatosensory evoked potentials (SEPs), (ii) pre-stimulus alpha oscillations (8-13 Hz), and (iii) peripheral nerve measures. Fluctuations of neural excitability shaped the perceived stimulus intensity already during the very first cortical response (at ~20 ms) yet demonstrating opposite neural signatures as compared to the effect of presented stimulus intensity. We reconcile this discrepancy via a common framework based on the modulation of electro-chemical membrane gradients linking neural states and responses, which calls for reconsidering conventional interpretations of brain potential magnitudes in stimulus intensity encoding.

Temporal Signatures of Criticality in Human Cortical Excitability as Probed by Early Somatosensory Responses.

Brain responses vary considerably from moment to moment, even to identical sensory stimuli. This has been attributed to changes in instantaneous neuronal states determining the system's excitability. Yet the spatiotemporal organization of these dynamics remains poorly understood. Here we test whether variability in stimulus-evoked activity can be interpreted within the framework of criticality, which postulates dynamics of neural systems to be tuned toward the phase transition between stability and instability as is reflected in scale-free fluctuations in spontaneous neural activity. Using a novel noninvasive approach in 33 male human participants, we tracked instantaneous cortical excitability by inferring the magnitude of excitatory postsynaptic currents from the N20 component of the somatosensory evoked potential. Fluctuations of cortical excitability demonstrated long-range temporal dependencies decaying according to a power law across trials, a hallmark of systems at critical states. As these dynamics covaried with changes in prestimulus oscillatory activity in the alpha band (8-13 Hz), we establish a mechanistic link between ongoing and evoked activity through cortical excitability and argue that the co-emergence of common temporal power laws may indeed originate from neural networks poised close to a critical state. In contrast, no signatures of criticality were found in subcortical or peripheral nerve activity. Thus, criticality may represent a parsimonious organizing principle of variability in stimulus-related brain processes on a cortical level, possibly reflecting a delicate equilibrium between robustness and flexibility of neural responses to external stimuli.SIGNIFICANCE STATEMENT Variability of neural responses in primary sensory areas is puzzling, as it is detrimental to the exact mapping between stimulus features and neural activity. However, such variability can be beneficial for information processing in neural networks if it is of a specific nature, namely, if dynamics are poised at a so-called critical state characterized by a scale-free spatiotemporal structure. Here, we demonstrate the existence of a link between signatures of criticality in ongoing and evoked activity through cortical excitability, which fills the long-standing gap between two major directions of research on neural variability: the impact of instantaneous brain states on stimulus processing on the one hand and the scale-free organization of spatiotemporal network dynamics of spontaneous activity on the other.

Emotion effects within frontal alpha oscillation in a picture oddball paradigm.

In the current study we measured frontal alpha band oscillation in an oddball paradigm with emotional pictures as target stimuli. Within these emotional target pictures we varied valence and arousal separately. Irrespective of this emotional connotation, participants were asked to respond to the occurrence of any picture that deviates from the standard picture (a checkerboard). All stimuli were presented briefly and target stimuli were easily distinguishable from the standard stimulus based on mere perceptive features. Thus, the procedure reduces the probability that participants intentionally process or evaluate the emotional content of the pictures. With these incidental procedural conditions we yet observed a relative shift of alpha power to the right frontal site with increasing pleasantness of the pictures. Furthermore, frontal alpha band oscillation decreased with increasing picture arousal. These patterns were also evident when we controlled for valence and arousal of the pictures at the individual level. The results suggest that changes in frontal alpha band oscillation reflect reliable emotion correlates of incidental picture processing in the oddball paradigm.