The neural dynamics underlying the interpersonal effects of emotional expression on decision making.

Although numerous studies explore the effects of emotion on decision-making, the existing research has mainly focused on the influence of intrapersonal emotions, leaving the influence of one person's emotions on another's decisions underestimated. To specify how interpersonal emotions shape decision-making and delineate the underlying neural dynamics involved, the present study examined brain responses to utilitarian feedback combined with angry or happy faces in competitive and cooperative contexts. Behavioral results showed that participants responded slower following losses than wins when competitors express happiness but responded faster following losses than wins when cooperators express anger. Importantly, angry faces in competitive context reversed the differentiation pattern of feedback-related negativity (FRN) between losses and wins and diminished the difference between losses and wins on both P300 and theta power, but only diminished the difference on FRN between losses and wins in cooperative context. However, when partner displays happiness, losses versus wins elicited larger FRN and theta power in competitive context but smaller P300 in both contexts. These results suggest that interpersonal emotions shape decisions during both automatic motivational salience valuation (FRN) and conscious cognitive appraisal (P300) stages of processing, in which different emotional expressions exert interpersonal influence through different routes.

Influence of attention on bimodal integration during emotional change decoding: ERP evidence.

Recent findings on audiovisual emotional interactions suggest that selective attention affects cross-sensory interaction from an early processing stage. However, the influence of attention manipulation on facial-vocal integration during emotional change perception is still elusive at this point. To address this issue, we asked participants to detect emotional changes conveyed by prosodies (vocal task) or facial expressions (facial task) while facial, vocal, and facial-vocal expressions were presented. At the same time, behavioral responses and electroencephalogram (EEG) were recorded. Behavioral results showed that bimodal emotional changes were detected with shorter response latencies compared to each unimodal condition, suggesting that bimodal emotional cues facilitated emotional change detection. Moreover, while the P3 amplitudes were larger for the bimodal change condition than for the sum of the two unimodal conditions regardless of attention direction, the N1 amplitudes were larger for the bimodal emotional change condition than for the sum of the two unimodal conditions under the attend-voice condition, but not under the attend-face condition. These findings suggest that selective attention modulates facial-vocal integration during emotional change perception in early sensory processing, but not in late cognitive processing stages.