Money or smiles: Independent ERP effects of associated monetary reward and happy faces.

In comparison to neutral faces, facial expressions of emotion are known to gain attentional prioritization, mainly demonstrated by means of event-related potentials (ERPs). Recent evidence indicated that such a preferential processing can also be elicited by neutral faces when associated with increased motivational salience via reward. It remains, however, an open question whether impacts of inherent emotional salience and associated motivational salience might be integrated. To this aim, expressions and monetary outcomes were orthogonally combined. Participants (N = 42) learned to explicitly categorize happy and neutral faces as either reward- or zero-outcome-related via an associative learning paradigm. ERP components (P1, N170, EPN, and LPC) were measured throughout the experiment, and separately analyzed before (learning phase) and after (consolidation phase) reaching a pre-defined learning criterion. Happy facial expressions boosted early processing stages, as reflected in enhanced amplitudes of the N170 and EPN, both during learning and consolidation. In contrast, effects of monetary reward became evident only after successful learning and in form of enlarged amplitudes of the LPC, a component linked to higher-order evaluations. Interactions between expressions and associated outcome were absent in all ERP components of interest. The present study provides novel evidence that acquired salience impacts stimulus processing but independent of the effects driven by happy facial expressions.

Implicit reward associations impact face processing: Time-resolved evidence from event-related brain potentials and pupil dilations.

The present study aimed at investigating whether associated motivational salience causes preferential processing of inherently neutral faces similar to emotional expressions by means of event-related brain potentials (ERPs) and changes of the pupil size. To this aim, neutral faces were implicitly associated with monetary outcome, while participants (N = 44) performed a face-matching task with masked primes that ensured performance around chance level and thus an equal proportion of gain, loss, and zero outcomes. During learning, motivational context strongly impacted the processing of the fixation, prime and mask stimuli prior to the target face, indicated by enhanced amplitudes of subsequent ERP components and increased pupil size. In a separate test session, previously associated faces as well as novel faces with emotional expressions were presented within the same task but without motivational context and performance feedback. Most importantly, previously gain-associated faces amplified the LPC, although the individually contingent face-outcome assignments were not made explicit during the learning session. Emotional expressions impacted the N170 and EPN components. Modulations of the pupil size were absent in both motivationally-associated and emotional conditions. Our findings demonstrate that neural representations of neutral stimuli can acquire increased salience via implicit learning, with an advantage for gain over loss associations.

Associated motivational salience impacts early sensory processing of human faces.

Facial expressions of emotion have an undeniable processing advantage over neutral faces, discernible both at behavioral level and in emotion-related modulations of several event-related potentials (ERPs). Recently it was proposed that also inherently neutral stimuli might gain salience through associative learning mechanisms. The present study investigated whether acquired motivational salience leads to processing advantages similar to biologically determined origins of inherent emotional salience by applying an associative learning paradigm to human face processing. Participants (N=24) were trained to categorize neutral faces to salience categories by receiving different monetary outcomes. ERPs were recorded in a subsequent test phase consisting of gender decisions on previously associated faces, as well as on familiarized and novel faces expressing happy, angry or no emotion. Previously reward-associated faces boosted the P1 component, indicating that acquired reward-associations modulate early sensory processing in extrastriate visual cortex. However, ERP modulations to emotional - primarily angry - expressions expanded to subsequent processing stages, as reflected in well-established emotion-related ERPs. The present study offers new evidence that motivational salience associated to inherently neutral stimuli can sharpen sensory encoding but does not obligatorily lead to preferential processing at later stages.