Facial mimicry interference reduces working memory accuracy for facial emotion expressions.

Facial mimicry, the tendency to imitate facial expressions of other individuals, has been shown to play a critical role in the processing of emotion expressions. At the same time, there is evidence suggesting that its role might change when the cognitive demands of the situation increase. In such situations, understanding another person is dependent on working memory. However, whether facial mimicry influences working memory representations for facial emotion expressions is not fully understood. In the present study, we experimentally interfered with facial mimicry by using established behavioral procedures, and investigated how this interference influenced working memory recall for facial emotion expressions. Healthy, young adults (N = 36) performed an emotion expression n-back paradigm with two levels of working memory load, low (1-back) and high (2-back), and three levels of mimicry interference: high, low, and no interference. Results showed that, after controlling for block order and individual differences in the perceived valence and arousal of the stimuli, the high level of mimicry interference impaired accuracy when working memory load was low (1-back) but, unexpectedly, not when load was high (2-back). Working memory load had a detrimental effect on performance in all three mimicry conditions. We conclude that facial mimicry might support working memory for emotion expressions when task load is low, but that the supporting effect possibly is reduced when the task becomes more cognitively challenging.

Affective responses drive the impact neglect in sustainable behavior.

We need unparalleled human behavioral changes to mitigate the effects of climate change. However, recent studies suggest that people are not good at identifying mitigative behaviors that are effective in reducing carbon emissions. Thus, even when there is an intention to engage in climate action, people are not necessarily making the most effective choices. This suggests that there is an impact of neglecting in evaluative judgments about mitigative behaviors. Here, using an online survey (N = 555), we show that people have a rather poor understanding of the mitigation potential of human behaviors, and both impact judgments and the likelihood of adoption of mitigative behaviors are largely influenced by emotional processes. These findings have potential implications for how to motivate impactful climate action in the future and point toward the importance to fully understand how affect and emotions influence impact judgments and pro-environmental behavior.

A causal link between mental imagery and affect-laden perception of climate change related risks.

Previous studies have shed light on the importance of affect in risk perception and the role of mental imagery in generating affect. In the current study, we explore the causal relationship between mental imagery, affect, and risk perception by systematically varying the level of mental imagery in three levels (i.e., enhanced, spontaneous, or prevented). In light of the increasing environmental risk of adverse events caused by climate change, we operationalize risk as participants' perceived risk of climate change. One-thousand-fifty-five participants were recruited online and randomized to one of three levels of mental imagery. As predicted, we found a causal link between the level of mental imagery, affective experience, and perceived risk of climate change, in that enhanced mental imagery caused a larger decrease in positive affective valence and a larger increase in perceived risk of climate change. We argue that mental imagery enhances the negative affect associated with the risk event by creating a perceptual experience that mimics seeing the environmental risk events.

Prior information can alter how sounds are perceived and emotionally regulated.

In the current study, we provided participants with written information about emotional dimensions of a sound presented as a task-irrelevant sound in the context of a serial recall task. We were interested in whether this manipulation would influence sound perception and spontaneous use of emotion regulation strategies. Participants were informed that they would hear either an aversive and annoying sound, or a pleasant and calming sound. They subsequently performed three blocks of a serial recall task with the sound presented in the background and rated the sound after each block. Results showed that participants in the negative information group rated the sound as more negative, with effects diminishing over repeated trials. While not impacting emotion regulation strategy directly, the manipulation indirectly influenced the degree to which participants used mental suppression as a regulatory strategy via changing affective responses. In the negative information condition specifically, participants who experienced the sound as more negative were more inclined to use mental suppression to deal with the sound, whereas no such relationship was observed in the positive information condition. The study adds to our understanding of how sounds come to acquire emotional meaning and how individuals spontaneously cope with emotional, task-irrelevant sounds.

The continuous and changing impact of affect on risky decision-making.

Affective experience has an important role in decision-making with recent theories suggesting a modulatory role of affect in ongoing subjective value computations. However, it is unclear how varying expectations and uncertainty dynamically influence affective experience and how dynamic representation of affect modulates risky choices. Using hierarchical Bayesian modeling on data from a risky choice task (N = 101), we find that the temporal integration of recently encountered choice parameters (expected value, uncertainty, and prediction errors) shapes affective experience and impacts subsequent choice behavior. Specifically, self-reported arousal prior to choice was associated with increased loss aversion, risk aversion, and choice consistency. Taken together, these findings provide clear behavioral evidence for continuous affective modulation of subjective value computations during risky decision-making.

No sound is more distracting than the one you're trying not to hear: delayed costs of mental control of task-irrelevant neutral and emotional sounds.

BACKGROUND: Suppressing intrusive thoughts can result in a post-suppression rebound effect where the same thoughts become hyperaccessible. The current study aimed to investigate if similar so-called rebound effects could be observed when people attempted to mentally suppress awareness of nonsensical auditory stimuli. Based on previous research on thought suppression and mental control in other domains, we hypothesized that attempting to suppress awareness of a task-irrelevant sound while under cognitive load would impact evaluations of the sound on affective dimensions and loudness, and result in increased general vigilance, as evidenced by faster responding on subsequent tasks. METHODS: We performed two experiments where participants in a suppression condition were initially instructed to mentally suppress awareness of a sound while performing a mentally challenging task. Participants in a control condition performed the same task without receiving any instructions regarding the sound. In Experiment 1, the sound was affectively neutral, while in Experiment 2 participants were presented with an inherently aversive (tinnitus-like) sound. After this initial phase, participants performed tasks measuring vigilance and attention, and were also asked to give subjective ratings of the sounds on a number of affective dimensions and loudness. RESULTS: In Experiment 1, participants in the suppression condition showed faster response times on both a visual search task and an auditory spatial cueing task, as compared to participants in the control condition. Contrary to our predictions, participants in the suppression condition did not rate the distractor sound as louder than participants in the control condition, and there were no differences on affective dimensions. In Experiment 2, results revealed that participants in the suppression condition made more errors on a visual search task, specifically on trials where the previously suppressed sound was presented. In contrast to results from Experiment 1, participants in the suppression condition also rated the targeted sound as louder. CONCLUSIONS: The findings provide preliminary support for a post-suppression rebound effect in the auditory domain and further suggest that this effect may be moderated by the emotional properties of the auditory stimulus.

Affective context and its uncertainty drive momentary affective experience.

Affect fluctuates in a moment-to-moment fashion, reflecting the continuous relationship between the individual and the environment. Despite substantial research, there remain important open questions regarding how a stream of sensory input is dynamically represented in experienced affect. Here, approaching affect as a temporally dependent process, we show that momentary affect is shaped by a combination of the affective impact of stimuli (i.e., visual images for the current studies) and previously experienced affect. We also found that this temporal dependency is influenced by uncertainty of the affective context. Participants in each trial viewed sequentially presented images and subsequently reported their affective experience, which was modeled based on images' normative affect ratings and participants' previously reported affect. Study 1 showed that self-reported valence and arousal in a given trial is partly shaped by the affective impact of the given images and previously experienced affect. In Study 2, we manipulated context uncertainty by controlling occurrence probabilities for normatively pleasant and unpleasant images in separate blocks. Increasing context uncertainty (i.e., random occurrence of pleasant and unpleasant images) was associated with increased negative affect. In addition, the relative contribution of the most recent image to experienced pleasantness increased with increasing context uncertainty. Taken together, these findings provide clear behavioral evidence that momentary affect is a temporally dependent and continuous process, which reflects the affective impact of recent input variables and the previous internal state, and that this process is sensitive to the affective context and its uncertainty. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The goal-relevance of affective stimuli is dynamically represented in affective experience.

Affect is a continuous and temporally dependent process that represents an individual's ongoing relationship with its environment. However, there is a lack of evidence on how factors defining the dynamic sensory environment modulate changes in momentary affective experience. Here, we show that goal-dependent relevance of stimuli is a key factor shaping momentary affect in a dynamic context. Participants (N = 83) viewed sequentially presented images and reported their momentary affective experience after every fourth stimulus. Relevance was manipulated through an attentional task that rendered each image either task-relevant or task-irrelevant. Computational models were fitted to trial-by-trial affective responses to capture the key dynamic parameters explaining momentary affective experience. The findings from statistical analyses and computational models showed that momentary affective experience was shaped by the temporal integration of the affective impact of recently encountered stimuli, and that task-relevant stimuli, independent of stimulus affect, prompted larger changes in experienced pleasantness compared with task-irrelevant stimuli. These findings clearly show that dynamics of affective experience reflect goal-relevance of stimuli in our surroundings.

Affective calculus: The construction of affect through information integration over time.

Humans receive a constant stream of input that potentially influence their affective experience. Despite intensive research on affect, it is still largely unknown how various sources of information are integrated into the single, unified affective features that accompany consciousness. Here, we aimed to investigate how a stream of evocative input we receive is dynamically represented in self-reported affect. In 4 experiments, participants viewed a number of sequentially presented images and reported their momentary affective experience on valence and arousal scales. The number and duration of images in a trial varied across studies. In Study 4, we also measured participants' physiological responses while they viewed images. We formulated and compared several models with respect to their capacity to predict self-reported affect based on normative image ratings, physiological measurements, and prior affective experience (measured in the previous trial). Our data best supported a model incorporating a temporally sensitive averaging mechanism for affective integration that assigns higher weights to affectively more potent and recently represented stimuli. Crucially, affective averaging of sensory information and prior affect accounted for distinct contributions to currently experienced affect. Taken together, the current study provides evidence that prior affect and integrated affective impact of stimuli partly shape currently experienced affect. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Variation in the µ-Opioid Receptor Gene (OPRM1) Does Not Moderate Social-Rejection Sensitivity in Humans.

Given previous findings from animal studies and small-scale studies in humans, variation in the µ-opioid receptor gene (OPRM1) has been proposed as a strong biological candidate for moderating sensitivity to social rejection. Using a substantially larger sample (N = 490) than previous studies, a prospective genotyping strategy, and preregistered analysis plans, we tested the hypotheses that OPRM1 variation measured by the functional A118G polymorphism (rs1799971) moderates (a) dispositional sensitivity to rejection and feelings of distress following social exclusion and (b) decision making involving social cognition. In three experimental tasks commonly used to assess altruism, reciprocity, and trust in humans, we found no evidence in favor of the hypotheses; nine main tests were preregistered, and all of them yielded small and statistically insignificant estimates. In secondary analyses, we used Bayesian inference and estimation to quantify support for our findings. Taken together, our results strongly suggest that the link between OPRM1 A118G variation and social-rejection sensitivity is weaker than previously thought.

Exposure to arousal-inducing sounds facilitates visual search.

Exposure to affective stimuli could enhance perception and facilitate attention via increasing alertness, vigilance, and by decreasing attentional thresholds. However, evidence on the impact of affective sounds on perception and attention is scant. Here, a novel aspect of affective facilitation of attention is studied: whether arousal induced by task-irrelevant auditory stimuli could modulate attention in a visual search. In two experiments, participants performed a visual search task with and without auditory-cues that preceded the search. Participants were faster in locating high-salient targets compared to low-salient targets. Critically, search times and search slopes decreased with increasing auditory-induced arousal while searching for low-salient targets. Taken together, these findings suggest that arousal induced by sounds can facilitate attention in a subsequent visual search. This novel finding provides support for the alerting function of the auditory system by showing an auditory-phasic alerting effect in visual attention. The results also indicate that stimulus arousal modulates the alerting effect. Attention and perception are our everyday tools to navigate our surrounding world and the current findings showing that affective sounds could influence visual attention provide evidence that we make use of affective information during perceptual processing.

Auditory attentional selection is biased by reward cues.

Auditory attention theories suggest that humans are able to decompose the complex acoustic input into separate auditory streams, which then compete for attentional resources. How this attentional competition is influenced by motivational salience of sounds is, however, not well-understood. Here, we investigated whether a positive motivational value associated with sounds could bias the attentional selection in an auditory detection task. Participants went through a reward-learning period, where correct attentional selection of one stimulus (CS+) lead to higher rewards compared to another stimulus (CS-). We assessed the impact of reward-learning by comparing perceptual sensitivity before and after the learning period, when CS+ and CS- were presented as distractors for a different target. Performance decreased after reward-learning when CS+ was a distractor, while it increased when CS- was a distractor. Thus, the findings show that sounds that were associated with high rewards captures attention involuntarily. Additionally, when successful inhibition of a particular sound (CS-) was associated with high rewards then it became easier to ignore it. The current findings have important implications for the understanding of the organizing principles of auditory perception and provide, for the first time, clear behavioral evidence for reward-dependent attentional learning in the auditory domain in humans.

Auditory-Induced Emotion Mediates Perceptual Categorization of Everyday Sounds.

Research has shown that emotion categorization plays an important role in perception and categorization in the visual domain. In the present paper, we investigated the role of auditory-induced emotions for auditory perception. We further investigated whether the emotional responses mediate other perceptual judgments of sounds. In an experiment, participants either rated general dissimilarities between sounds or dissimilarities of specific aspects of sounds. The results showed that the general perceptual salience map could be explained by both the emotional responses to, and perceptual aspects of, the sounds. Importantly, the perceptual aspects were mediated by emotional responses. Together these results show that emotions are an integral part of auditory perception that is used as the intuitive basis for categorizing everyday sounds.

The Arithmetic of Emotion: Integration of Incidental and Integral Affect in Judgments and Decisions.

Research has demonstrated that two types of affect have an influence on judgment and decision making: incidental affect (affect unrelated to a judgment or decision such as a mood) and integral affect (affect that is part of the perceiver's internal representation of the option or target under consideration). So far, these two lines of research have seldom crossed so that knowledge concerning their combined effects is largely missing. To fill this gap, the present review highlights differences and similarities between integral and incidental affect. Further, common and unique mechanisms that enable these two types of affect to influence judgment and choices are identified. Finally, some basic principles for affect integration when the two sources co-occur are outlined. These mechanisms are discussed in relation to existing work that has focused on incidental or integral affect but not both.

Negative emotion provides cues for orienting auditory spatial attention.

The auditory stimuli provide information about the objects and events around us. They can also carry biologically significant emotional information (such as unseen dangers and conspecific vocalizations), which provides cues for allocation of attention and mental resources. Here, we investigated whether task-irrelevant auditory emotional information can provide cues for orientation of auditory spatial attention. We employed a covert spatial orienting task: the dot-probe task. In each trial, two task-irrelevant auditory cues were simultaneously presented at two separate locations (left-right or front-back). Environmental sounds were selected to form emotional vs. neutral, emotional vs. emotional, and neutral vs. neutral cue pairs. The participants' task was to detect the location of an acoustic target that was presented immediately after the task-irrelevant auditory cues. The target was presented at the same location as one of the auditory cues. The results indicated that participants were significantly faster to locate the target when it replaced the negative cue compared to when it replaced the neutral cue. The positive cues did not produce a clear attentional bias. Further, same valence pairs (emotional-emotional or neutral-neutral) did not modulate reaction times due to a lack of spatial attention capture by one cue in the pair. Taken together, the results indicate that negative affect can provide cues for the orientation of spatial attention in the auditory domain.

Attentional and emotional prioritization of the sounds occurring outside the visual field.

The ability to detect and localize sounds in an environment is critical for survival. Localizing sound sources is a computational challenge for the human brain because the auditory cortex seems to lack a topographical space representation. However, attention and task demands can modulate localization performance. Here, we investigated whether the localization performance for sounds occurring directly in front of or behind people could be modulated by emotional salience and sound-source location. We measured auditory-induced emotion by ecological sounds occurring in the frontal or rear perceptual fields, and employed a speeded localization task. The results showed that both localization speed and accuracy were higher, and that stronger negative emotions were induced when sound sources were behind the participants. Our results provide clear behavioral evidence that auditory attention can be influenced by sound-source location. Importantly, we also show that the effect of spatial location on attention is mediated by emotion, which is in line with the argument that emotional information is prioritized in processing. Auditory system functions as an alarm system and is in charge of detecting possible salient events, and alarming for an attention shift. Further, spatial processing in the auditory dorsal pathway has a function of guiding the visual system to a particular location of interest. Thus, an auditory bias toward the space outside the visual field can be useful, so that visual attention could be quickly shifted in case of emotionally significant information.

Emotional bias in change deafness in multisource auditory environments.

Theories of auditory attention suggest that humans decompose complex auditory input into individual auditory objects, which then compete for attention to dominate auditory perception. Since emotional significance of external stimuli has been argued to provide cues for sensory prioritization and allocation of attention, emotionally salient auditory objects can receive attention to dominate auditory perception. On the basis of the function of audition as an alarm system that informs the organism about its immediate surroundings, and on empirical evidence that emotion can modulate auditory perception, we argue that auditory stimuli with greater emotional saliency would dominate perception in multisource environments. To test our hypothesis, we employed a change detection task in which participants were asked to indicate whether multisource auditory scenes were identical or different. Participants were better at detecting changes at the presence of an emotionally negative environment compared to neutral environment. Further, we found that participants were better at detecting changes of emotionally negative targets compared to neutral targets. Our results demonstrate that detecting changes in auditory scenes is influenced by emotion. The findings are discussed in the light of the theories of auditory attention, emotional modulation of attention, and the adaptive function of emotion for perception.

Perception of loudness is influenced by emotion.

Loudness perception is thought to be a modular system that is unaffected by other brain systems. We tested the hypothesis that loudness perception can be influenced by negative affect using a conditioning paradigm, where some auditory stimuli were paired with aversive experiences while others were not. We found that the same auditory stimulus was reported as being louder, more negative and fear-inducing when it was conditioned with an aversive experience, compared to when it was used as a control stimulus. This result provides support for an important role of emotion in auditory perception.

Embodied auditory perception: the emotional impact of approaching and receding sound sources.

Research has shown the existence of perceptual and neural bias toward sounds perceived as sources approaching versus receding a listener. It has been suggested that a greater biological salience of approaching auditory sources may account for these effects. In addition, these effects may hold only for those sources critical for our survival. In the present study, we bring support to these hypotheses by quantifying the emotional responses to different sounds with changing intensity patterns. In 2 experiments, participants were exposed to artificial and natural sounds simulating approaching or receding sources. The auditory-induced emotional effect was reflected in the performance of participants in an emotion-related behavioral task, their self-reported emotional experience, and their physiology (electrodermal activity and facial electromyography). The results of this study suggest that approaching unpleasant sound sources evoke more intense emotional responses in listeners than receding ones, whereas such an effect of perceived sound motion does not exist for pleasant or neutral sound sources. The emotional significance attributed to the sound source itself, the loudness of the sound, and loudness change duration seem to be relevant factors in this disparity.