The effect of face orientation on audiovisual speech integration in infancy: An electrophysiological study.

Humans pay special attention to faces and speech from birth, but the interplay of developmental processes leading to specialization is poorly understood. We investigated the effects of face orientation on audiovisual (AV) speech perception in two age groups of infants (younger: 5- to 6.5-month-olds; older: 9- to 10.5-month-olds) and adults. We recorded event-related potentials (ERP) in response to videos of upright and inverted faces producing /ba/ articulation dubbed with auditory syllables that were either matching /ba/ or mismatching /ga/ the mouth movement. We observed an increase in the amplitude of audiovisual mismatch response (AVMMR) to incongruent visual /ba/-auditory /ga/ syllable in comparison to other stimuli in younger infants, while the older group of infants did not show a similar response. AV mismatch response to inverted visual /ba/-auditory /ga/ stimulus relative to congruent stimuli was also detected in the right frontal areas in the younger group and the left and right frontal areas in adults. We show that face configuration affects the neural response to AV mismatch differently across all age groups. The novel finding of the AVMMR in response to inverted incongruent AV speech may potentially imply the featural face processing in younger infants and adults when processing inverted faces articulating incongruent speech. The lack of visible differential responses to upright and inverted incongruent stimuli obtained in the older group of infants suggests a likely functional cortical reorganization in the processing of AV speech.

The role of subjective significance, valence and arousal in the explicit processing of emotion-laden words.

Emotional categorisation (deciding whether a word is emotional or not) is a task that employs the explicit analysis of the emotional meaning of words. Therefore, it allows for assessing the role of emotional factors, i.e., valence, arousal, and subjective significance, in emotional word processing. The aim of the current experiment was to investigate the role of subjective significance, a reflective form of activation that is similar to arousal (the automatic form), in the processing of emotional meaning. We applied the orthogonal manipulation of three emotional factors. Thus, we were able to precisely differentiate the effects of each factor and search for interactions between them. We expected valence to shape the late positive complex LPC component, while subjective significance and arousal were expected to shape the P300 and N400 components. We observed the effects of subjective significance throughout the whole span of processing, while the arousal effect was present only in the LPC component. We also observed that amplitudes for N400 and LPC discriminated negative from positive valence. The results showed that all factors included in the analysis should be taken into account while explaining the processing of emotion-laden words; especially interesting is the subjective significance, which was shown to shape processing individually, as well as to come into interaction with valence and arousal.

The Affect Misattribution in the Interpretation of Ambiguous Stimuli in Terms of Warmth vs. Competence: Behavioral Phenomenon and Its Neural Correlates.

Warmth and competence are fundamental dimensions of social cognition. This also applies to the interpretation of ambiguous symbolic stimuli in terms of their relation to warmth or competence. The affective state of an individual may affect the way people interpret the neutral stimuli in the environment. As previous findings have shown, it is possible to alter the perception of neutral social stimuli in terms of warmth vs. competence by eliciting an incidental affect with the use of emotion-laden words. In the current experiment, we expected the valence and origin of an affective state, factors ascribing emotionally laden words, to be able to switch the interpretation of the neutral objects. We have shown in behavioural results that negative valence and reflective origins promote the interpretation of unknown objects in terms of competence rather than warmth. Furthermore, electrophysiological-response-locked analyses revealed differences specific to negative valence while making the decision in the ambiguous task and while executing it. The results of the current experiment show that the usage of warmth and competence in social cognition is susceptible to affective state manipulation. In addition, the results are coherent with the evolutionary perspective on social cognition (valence effects) as well as with predictions of the dual mind model of emotion (origin effects).

Inhibitory control effectiveness can be improved: The role of arousal, subjective significance and origin of words in modified Emotional Stroop Test.

The interference control measured in the Emotional Stroop Task is the phenomenon that gives us an insight into mechanisms of emotion-cognition interactions. Especially the role of dimensions of affect can be easily studied with this paradigm. In the current study, we were interested in the role of the complexity of emotional stimuli (origin). We also aimed at searching for activation-like factors that impair (arousal) or improve (subjective significance) the effectiveness of cognitive control. We have used an orthogonal manipulation of all the above dimensions in words. We expected to find the contrastive effects of arousal and subjective significance on reaction times and Event Related Potential's amplitudes. On a behavioural level, we observed the reduction of reaction times with increasing subjective significance of stimuli and reflective origin. We also found a correlation between subjective significance and reduction of amplitude polarisation in the N450 component associated with cognitive control execution effort. This experiment shows that subjective significance has an improving role for cognitive control effectiveness, even when valence, arousal and origin levels are controlled. This guides us to conclude that external stimuli may drive not only disruption of control but also its improvement.

Arousal, subjective significance and the origin of valence aligned words in the processing of an emotional categorisation task.

An emotional categorisation task allows us to study how emotionality is understood and how emotional factors influence decisions. As emotionality is not only the valence but is also composed of activation (arousal and subjective significance) and the type of process needed to produce emotion (origin), we wanted to test the influence of these emotional factors on with a group of stimuli not differing in valence. We predicted that increasing activation levels should lead to increased classification of stimuli as emotional, with a focus on the late processing stages, when explicit word processing occurs, which on the electrophysiological level corresponds to P300, N450 and LPC components. The behavioural results showed that the emotionality of words increased with increasing levels of arousal and subjective significance. Automatically originated words were assessed as more emotional than reflective ones. The amplitude of the N450 component revealed dissociation for subjective significance and origin effects, showing that these two dimensions ascribe distinct properties of emotionality. Finally, the LPC component was susceptible to all affective dimensions used in manipulation. Our study showed that arousal, subjective significance and origin are dimensions of affect that shape the processing of words' emotionality, when the values of valence were aligned among the stimuli.

ERP Analysis Using a Multi-Channel Matching Pursuit Algorithm.

In this study, we propose a new algorithm for analysing event-related components observed in EEG signals in psychological experiments. We investigate its capabilities and limitations. The algorithm is based on multivariate matching pursuit and clustering. It is aimed to find patterns in EEG signals which are similar across different experimental conditions, but it allows for variations in amplitude and slight variability in topography. The method proved to yield expected results in numerical simulations. For the real data coming from an emotional categorisation task experiment, we obtained two indications. First, the method can be used as a specific filter that reduces the variability of components, as defined classically, within each experimental condition. Second, equivalent dipoles fitted to items of the activity clusters identified by the algorithm localise in compact brain areas related to the task performed by the subjects across experimental conditions. Thus this activity may be studied as candidates for hypothetical latent components. The proposed algorithm is a promising new tool in ERP studies, which deserves further experimental evaluations.

Electrophysiological correlates of interference control in the modified emotional Stroop task with emotional stimuli differing in valence, arousal, and subjective significance.

The role of emotional factors in maintaining cognitive control is one of the most intriguing issues in understanding emotion-cognition interactions. In the current experiment, we assessed the role of emotional factors (valence, arousal, and subjective significance) in perceptual and conceptual inhibition processes. We operationalised both processes with the classical cognitive paradigms, i.e., the flanker task and the emotional Stroop task merged into a single experimental procedure. The procedure was based on the presentation of emotional words displayed in four different font colours flanked by the same emotional word printed with the same or different font colour. We expected to find distinct effects of both types of interference: earlier for perceptual and later for emotional interference. We also predicted an increased arousal level to disturb inhibitory control effectiveness, while increasing the subjective significance level should improve this process. As we used orthogonal manipulations of emotional factors, our study allowed us for the first time to assess interactions within emotional factors and between types of interference. We found on the behavioural level the main effects of flanker congruency as well as effects of emotionality. On the electrophysiological level, we found effects for EPN, P2, and N450 components of ERPs. The exploratory analysis revealed that effects due to perceptual interference appeared earlier than the effects of emotional interference, but they lasted for an extended period of processing, causing perceptual and emotional interference to partially overlap. Finally, in terms of emotional interference, we showed the effect of subjective significance: the reduction of interference cost in N450 for highly subjective significant stimuli. This study is the first one allowing for the investigation of two different types of interference in a single experiment, and provides insight into the role of emotion in cognitive control.

Event-Related Potential Correlates of Valence, Arousal, and Subjective Significance in Processing of an Emotional Stroop Task.

The present study is the first to measure event-related potentials associated with the processing of the emotional Stroop task (EST) with the use of an orthogonal factorial manipulation for emotional valence, arousal, and subjective significance (the importance of the current experience for goals and plans for the future). The current study aimed to investigate concurrently the role of the three dimensions describing the emotion-laden words for interference control measured in the classical version of the EST paradigm. The results showed that reaction times were affected by the emotional valence of presented words and the interactive effect of valence and arousal. The expected emotional arousal effect was only found in behavioral results for neutrally valenced words. Electrophysiological results showed valence and subjective significance correlated with the amplitude differences in the P2 component. Moreover, the amplitude of the N450 component varied with the level of subjective significance. This study also demonstrated that exploratory event-related potential analysis provides additional information beyond the classical component-based analysis. The obtained results show that cognitive control effects in the EST may be altered by manipulation in the subjective significance dimension.

Electrophysiological and Behavioral Correlates of Valence, Arousal and Subjective Significance in the Lexical Decision Task.

The emotional properties of words, such as valence and arousal, influence the way we perceive and process verbal stimuli. Recently, subjective significance was found to be an additional factor describing the activational aspect of emotional reactions, which is vital for the cognitive consequences of emotional stimuli processing. Subjective significance represents the form of mental activation specific to reflective mind processing. The Lexical Decision Task (LDT) is a paradigm allowing the investigation of the involuntary processing of meaning and differentiating this processing from the formal processing of the perceptual features of words. In this study, we wanted to search for the consequences of valence, arousal, and subjective significance for the involuntary processing of verbal stimuli meaning indexed by both behavioral measures (reaction latencies) and electrophysiological measures (Event-Related Potentials: ERPs). We expected subjective significance, as the reflective form of activation, to shorten response latencies in LDT. We also expected subjective significance to modulate the amplitude of the ERP FN400 component, reducing the negative-going deflection of the potential. We expected valence to shape the LPC component amplitude, differentiating between negative and positive valences, since the LPC indexes the meaning processing. Indeed, the results confirmed our expectations and showed that subjective significance is a factor independent from the arousal and valence that shapes the involuntary processing of verbal stimuli, especially the detection of a link between stimulus and meaning indexed by the FN400. Moreover, we found that the LPC amplitude was differentiated by valence level.

The N400/FN400 and Lateralized Readiness Potential Neural Correlates of Valence and Origin of Words' Affective Connotations in Ambiguous Task Processing.

Recent behavioral studies revealed an interesting phenomenon concerning the influence of affect on the interpretation of ambiguous stimuli. In a paradigm, where the participants' task was to read a word, remember its meaning for a while, and then choose one of two pictorial-alphabet-like graphical signs best representing the word sense, we observed that the decisions involving trials with reflective-originated verbal stimuli were performed significantly longer than decisions concerning other stimuli (i.e., automatic-originated). The origin of an affective reaction is a dimension which allows speaking of an affect as automatic (you feel it in your guts) or reflective (you feel it comes from your mind). The automatic affective reaction represents the immediate and inescapable as opposed to the reflective, i.e., the delayed and controllable affective responses to stimuli. In the current experiment, we investigated the neural correlates of performance in an QR-signs-selection ambiguous task. We found the effects of valence and origin in the N400/FN400 potential by means of a stimuli-locked analysis of the initial part of the task, that is, the remembering of a certain word stimulus in a working memory. The N400/FN400 effects were separated in space on scalp distribution. Reflective originated stimuli elicited more negative FN400 than other conditions, which means that such stimuli indeed are associated with conceptual incongruence or higher affective complexity of meaning, but distinct from purely cognitive concreteness. Moreover, the amplitude of the potential preceding the decision, analyzed in the response-locked way, was shaped by the origin of an affective state but not valence. Trials involving decisions concerning reflective-originated words were characterized by a more negative amplitude than trials involving automatic-originated and control word stimuli. This corresponds to the observed pattern of response latencies, where we found that latencies for reflective stimuli were longer than for automatic originated or control ones. Additionally, this study demonstrates that the proposed new ambiguous paradigm is useful in studies concerning the influence of affect on decisions.