How Task Set and Task Switching Modulate Perceptual Processes: Is Recognition of Facial Emotion an Exception?

In Part 1 we review task-switching and other studies showing that, even with time for preparation, participants' ability to shift attention to a relevant attribute or object before the stimulus onset is limited: there is a 'residual cost'. In particular, several brain potential markers of perceptual encoding are delayed on task-switch trials, compared to task-repeat trials that require attention to the same attribute as before. Such effects have been documented even for a process often considered 'automatic' - visual word recognition: ERP markers of word frequency and word/nonword status are (1) delayed when the word recognition task follows a judgement of a perceptual property compared to repeating the lexical task, and (2) strongly attenuated during the perceptual judgements. Thus, even lexical access seems influenced by the task/attentional set. In Part 2, we report in detail a demonstration of what seems to be a special case, where task-set and a task switch have no such effect on perceptual encoding. Participants saw an outline letter superimposed on a face expressing neutral or negative emotion, and were auditorily cued to categorise the letter as vowel/consonant, or the face as emotional/neutral. ERPs exhibited a robust emotional-neutral difference (Emotional Expression Effect) no smaller or later when switching to the face task than when repeating it; in the first half of its time-course it did not vary with the task at all. The initial encoding of the valence of a fixated facial emotional expression appears to be involuntary and invariant, whatever the endogenous task/attentional set.

Serial or parallel proactive control of components of task-set? A task-switching investigation with concurrent EEG and eye-tracking.

Among the issues examined by studies of cognitive control in multitasking is whether processes underlying performance in the different tasks occur serially or in parallel. Here we ask a similar question about processes that pro-actively control task-set. In task-switching experiments, several indices of task-set preparation have been extensively documented, including anticipatory orientation of gaze to the task-relevant location (an unambiguous marker of reorientation of attention), and a positive polarity brain potential over the posterior cortex (whose functional significance is less well understood). We examine whether these markers of preparation occur in parallel or serially, and in what order. On each trial a cue required participants to make a semantic classification of one of three digits presented simultaneously, with the location of each digit consistently associated with one of three classification tasks (e.g., if the task was odd/even, the digit at the top of the display was relevant). The EEG positivity emerged following, and appeared time-locked to, the anticipatory fixation on the task-relevant location, which might suggest serial organisation. However, the fixation-locked positivity was not better defined than the cue-locked positivity; in fact, for the trials with the earliest fixations the positivity was better time-locked to the cue onset. This is more consistent with (re)orientation of spatial attention occurring in parallel with, but slightly before, the reconfiguration of other task-set components indexed by the EEG positivity.

The effect of tDCS on recognition depends on stimulus generalization: Neuro-stimulation can predictably enhance or reduce the face inversion effect.

This article reports results from three experiments that investigate how a particular neuro-stimulation procedure is able, in certain circumstances, to selectively increase the face inversion effect by enhancing recognition for upright faces, and argues that these effects can be understood in terms of the McLaren-Kaye-Mackintosh (MKM) theory of stimulus representation. We demonstrate how a specific transcranial direct current stimulation (tDCS) methodology can improve performance in circumstances where error-based salience modulation is making face recognition harder. The 3 experiments used an old/new recognition task involving sets of normal versus Thatcherized faces. The main characteristic of Thatcherized faces is that the eyes and the mouth are upside down, thus emphasizing features that tend to be common to other Thatcherized faces and so leading to stronger generalization making recognition worse. Experiment 1 combined a behavioral and event-related potential study looking at the N170 peak component, which helped us to calibrate the set of face stimuli needed for subsequent experiments. In Experiment 2, we used our tDCS procedure (between-subjects and double-blind) in an attempt to reduce the negative effects induced by error-based modulation of salience on recognition of upright Thatcherized faces. Results largely confirmed our predictions. In addition, they showed a significant improvement on recognition performance for upright normal faces. Experiment 3 provides the first direct evidence in a single study that the same tDCS procedure is able to both enhance performance when normal faces are presented with Thatcherized faces, and to reduce performance when normal faces are presented with other normal faces (i.e., male vs. female faces). We interpret our results by analyzing how salience modulation influences generalization between similar categories of stimuli. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Is preparing for a language switch like preparing for a task switch?

A key index of top-down control in task switching-preparation for a switch-is underexplored in language switching. The well-documented EEG "signature" of preparation for a task switch-a protracted positive-polarity modulation over the posterior scalp-has thus far not been reported in language switching, and the interpretation of previously reported effects of preparation on language switching performance is complicated by confounding factors. In an experiment using event-related potentials (ERPs) and an optimized picture-naming paradigm that addressed these confounds the language was specified by an auditory cue on every trial and changed unpredictably. There were two key manipulations. First, the cue-stimulus interval allowed either generous (1,500 ms) or little (100 ms) opportunity for preparation. Second, to explore the interplay between bottom-up and top-down language selection, we compared a highly transparent and familiar "supercue"-the name of the language spoken in that language to a relatively opaque cue (short speeded-up fragment of national anthem). Preparation for a switch elicited a brain potential strongly reminiscent of the posterior switch positivity documented in task switching. As previously shown in task switching, its amplitude inversely predicted the performance "switch cost," demonstrated by our ERP analyses contingent on reaction time (RT). This overlap in the electrophysiological correlates of preparing to switch tasks and languages suggests domain-general processes for top-down selection of task-set and language for production. But, the surprisingly small language switch cost following the supercue in the short CSI suggests that rapid and (possibly automatic) bottom-up selection-not typically observed in task switching-may also occur. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The effect of scrambling upright and inverted faces on the N170.

The face inversion effect refers to a decrement in performance when we try to recognise familiar faces turned upside down (inverted), compared with familiar faces presented in their usual (upright) orientation. Recently, we have demonstrated that the inversion effect can also be found with checkerboards drawn from prototype-defined categories when the participants have been trained with these categories, suggesting that factors such as expertise and the relationships between stimulus features may be important determinants of this effect. We also demonstrated that the typical inversion effect on the N170 seen with faces is found with checkerboards, suggesting that modulation of the N170 is a marker for disruption in the use of configural information. In the present experiment, we first demonstrate that our scrambling technique greatly reduces the inversion effect in faces. Following this, we used Event-Related Potentials ( ERPs) recorded while participants performed an Old/New recognition study on normal and scrambled faces presented in both upright and inverted orientations to investigate the impact of scrambling on the N170. We obtained the standard robust inversion effect for normal faces: The N170 was both larger and delayed for normal inverted faces as compared with normal upright faces, whereas a significantly reduced inversion effect was recorded for scrambled faces. These results show that the inversion effect on the N170 is greater for normal compared with scrambled faces, and we interpret the smaller effect for scrambled faces as being due to the reduction in expertise for those faces consequent on scrambling.

Shifting Attention Between Visual Dimensions as a Source of Switch Costs.

Task-switching experiments have documented a puzzling phenomenon: Advance warning of the switch reduces but does not eliminate the switch cost. Theoretical accounts have posited that the residual switch cost arises when one selects the relevant stimulus-response mapping, leaving earlier perceptual processes unaffected. We put this assumption to the test by seeking electrophysiological markers of encoding a perceptual dimension. Participants categorized a colored letter as a vowel or consonant or its color as "warm" or "cold." Orthogonally to the color manipulation, some colors were eight times more frequent than others, and the letters were in upper- or lowercase. Color frequency modulated the electroencephalogram amplitude at around 150 ms when participants repeated the color-classification task. When participants switched from the letter task to the color task, this effect was significantly delayed. Thus, even when prepared for, a task switch delays or prolongs encoding of the relevant perceptual dimension.

Proactive inhibitory control: A general biasing account.

Flexible behavior requires a control system that can inhibit actions in response to changes in the environment. Recent studies suggest that people proactively adjust response parameters in anticipation of a stop signal. In three experiments, we tested the hypothesis that proactive inhibitory control involves adjusting both attentional and response settings, and we explored the relationship with other forms of proactive and anticipatory control. Subjects responded to the color of a stimulus. On some trials, an extra signal occurred. The response to this signal depended on the task context subjects were in: in the 'ignore' context, they ignored it; in the 'stop' context, they had to withhold their response; and in the 'double-response' context, they had to execute a secondary response. An analysis of event-related brain potentials for no-signal trials in the stop context revealed that proactive inhibitory control works by biasing the settings of lower-level systems that are involved in stimulus detection, action selection, and action execution. Furthermore, subjects made similar adjustments in the double-response and stop-signal contexts, indicating an overlap between various forms of proactive action control. The results of Experiment 1 also suggest an overlap between proactive inhibitory control and preparatory control in task-switching studies: both require reconfiguration of task-set parameters to bias or alter subordinate processes. We conclude that much of the top-down control in response inhibition tasks takes place before the inhibition signal is presented.

Reorienting the mind: The impact of novel sounds on go/no-go performance.

The present study explores the link between attentional reorienting and response inhibition. Recent behavioral and neuroscience work indicates that both might rely on similar cognitive and neural mechanisms. We tested 2 popular accounts of the overlap: The "circuit breaker" account, which assumes that unexpected events produce global suppression of motor output, and the "stimulus detection" account, which assumes that attention is reoriented to unexpected events. In Experiment 1, we presented standard and (unexpected) novel sounds in a go/no-go task. Consistent with the stimulus detection account, we found longer reaction times on go trials and higher rates of commission errors on no-go trials when these were preceded by a novel sound compared with a standard sound. In Experiment 2, novel and standard sounds acted as no-go signals. In this experiment, the novel sounds produced an improvement on no-go trials. This further highlights the importance of stimulus detection for response inhibition. Combined, the 2 experiments support the idea that attention is oriented to novel or unexpected events, impairing no-go performance if these events are irrelevant but enhancing no-go performance when they are relevant. Our findings also indicate that the popular circuit breaker account of the overlap between response inhibition and attentional reorienting needs some revision.

Processing differences across regular and irregular inflections revealed through ERPs.

Research strongly suggests that printed words are recognized in terms of their constituent morphemes, but researchers have tended to consider the recognition of derivations and inflections in separate theoretical debates. Recently, Crepaldi et al. (2010) proposed a theory that claims to account for the recognition of both derivations and inflections. We investigated brain potentials in the context of masked priming to test 2 key predictions of this theory: (a) that regular inflections should prime their stems to a greater degree than irregular inflections should prime their stems and (b) that priming for regular inflections should arise earlier in the recognition process than priming for irregular inflections. Significant masked priming effects were observed for both regular and irregular inflections, though these effects were greater for regular inflections. ERP data further suggested that masked priming effects for regular and irregular inflections had different time courses. Priming for regular but not irregular inflections emerged in a time window reflecting processing up to 250 ms post target onset, and although priming for regular and irregular inflections was observed in a time window reflecting processing 400 to 600 ms post target onset, these effects arose earlier and were of greater magnitude for the regular inflections. These findings support a form-then-meaning characterization of the visual word processing system such as that proposed by Crepaldi et al. (2010) and raise challenges for alternative approaches.

A change of task prolongs early processes: evidence from ERPs in lexical tasks.

Switching tasks costs time. Allowing time to prepare reduces the cost, but usually leaves an irreducible "residual cost." Most accounts of this residual cost locate it within the response-selection stage of processing. To determine which processing stage is affected, we measured event-related potentials (ERPs) as participants performed a reading task or a perceptual judgment task, and examined the effect of a task switch on early markers of lexical processing. A task cue preceding a string of blue and red letters instructed the participant either to read the letter string (for a semantic classification in Experiment 1, and a lexical decision in Experiment 2) or to judge the symmetry of its color pattern. In Experiment 1, having to switch to the reading task delayed the evolution of the effect of word frequency on the reading task ERP by a substantial fraction of the effect on reaction time (RT). In Experiment 2, a task switch delayed the onset of the effect of lexical status on the ERP by about the same extent that it prolonged the RT. These effects indicate an early locus of (most of) the residual switch cost: We propose that this reflects a form of task-related attentional inertia. Other findings have implications for the automaticity of lexical access: Effects of frequency, lexicality, and orthographic familiarity on ERPs in the symmetry task indicated involuntary, but attenuated, orthographic and lexical processing even when attention was focused on a nonlexical property.

Perceptual learning and inversion effects: Recognition of prototype-defined familiar checkerboards.

The face inversion effect is a defection in performance in recognizing inverted faces compared with faces presented in their usual upright orientation typically believed to be specific for facial stimuli. McLaren (1997) was able to demonstrate that (a) an inversion effect could be obtained with exemplars drawn from a familiar category, such that upright exemplars were better discriminated than inverted exemplars; and (b) that the inversion effect required that the familiar category be prototype-defined. In this article, we replicate and extend these findings. We show that the inversion effect can be obtained in a standard old/new recognition memory paradigm, demonstrate that it is contingent on familiarization with a prototype-defined category, and establish that the effect is made up of two components. We confirm the advantage for upright exemplars drawn from a familiar, prototype-defined category, and show that there is a disadvantage for inverted exemplars drawn from this category relative to suitable controls. We also provide evidence that there is an N170 event-related potential signature for this effect. These results allow us to integrate a theory of perceptual learning originally proposed by McLaren, Kaye, and Mackintosh (1989) with explanations of the face inversion effect, first reported by Yin.

A brain-potential correlate of task-set conflict.

Brain-potential correlates of response conflict are well documented, but those of task conflict are not. Task-switching studies have suggested a plausible correlate of task conflict--a poststimulus posterior negativity--however, in such paradigms the negativity may also reflect poststimulus task-set reconfiguration postulated in some models. Here, participants alternated between single-task blocks of classifying letters and digits; hence, no within-block task-set reconfiguration was required. Presenting letters alongside digits slowed responses to the digits and elicited an ERP negativity from ≈ 350 ms, relative to task-neutral symbols presented alongside digits, consistent with task conflict. The negativity was also present for congruent digit-letter stimuli; this and the lack of behavioral response congruency effects indicate conflict at the level of task-set rather than response selection.

Tracking hierarchical processing in morphological decomposition with brain potentials.

One important debate in psycholinguistics concerns the nature of morphological decomposition processes in visual word recognition (e.g., darkness = {dark} + {-ness}). One theory claims that these processes arise during orthographic analysis and prior to accessing meaning (Rastle & Davis, 2008), and another argues that these processes arise through greater temporal overlap between the activation of orthographic and semantic information (Feldman, O'Connor, & Moscoso del Prado Martín, 2009). This issue has been the subject of intense debate in studies using masked priming but has yet to be resolved unequivocally. The present study takes another approach to resolving this controversy by examining brain potentials as participants made lexical decisions to unprimed morphological (darkness), pseudomorphological (corner), and nonmorphological (brothel) stimuli. Results revealed a difference from ∼190 ms between the nonmorphological condition and the other 2 conditions (which showed no differentiation), a likely correlate of morphological processing reliant exclusively on orthography. Only 60-70 ms later was there evidence of the activation of semantic information, when the pseudomorphological condition diverged from the other 2 conditions. These results provide unambiguous support for a hierarchical model of morphological processing whereby decomposition is based initially on orthographic analysis and is only later constrained by semantic information. (PsycINFO Database Record (c) 2012 APA, all rights reserved).

A brain-potential study of preparation for and execution of a task-switch with stimuli that afford only the relevant task.

Behavioural and neurophysiological studies of task-switching have tended to employ 'bivalent' stimuli (which afford responses in two tasks). Using brain potential recordings, we investigated task-switching with 'univalent' stimuli affording responses in only one of the tasks, and compared the outcomes to those recently obtained with bivalent stimuli (Lavric et al. [2008]: Eur J Neurosci 1-14), in order to examine two phenomena. First, when only univalent stimuli are presented, the processing of task cues becomes optional. Our results showed that in these circumstances linguistic (but not pictorial) cues were still effective in eliciting at least some degree of preparation for a task-switch, as evidenced by the reduction in the error cost of switching at the longer preparation interval and by a posterior switch-induced ERP positivity at about 450-800 ms in the cue-stimulus interval. Second, single affordance stimuli not only reduced behavioural switch costs relative to bivalent stimuli; they also produced a smaller post-stimulus switch-induced negativity, consistent with the latter being a marker of conflict between task-sets. However, using stimuli not associated with responses in the alternative task did not completely eliminate the negativity. We speculate that the residue reflects other sources of conflict: attention to the irrelevant perceptual dimension and/or persistence of task goals.