Relationship between reward-related brain activity and opportunities to sit.

The present study tested whether energy-minimizing behaviors evoke reward-related brain activity that promotes the repetition of these behaviors via reinforcement learning processes. Fifty-eight healthy young adults in a standing position performed a task where they could earn a reward either by sitting down or squatting while undergoing electroencephalographic (EEG) recording. Reward-prediction errors were quantified as the amplitude of the EEG-derived reward positivity. Results showed that reward positivity was larger on reward versus no reward trials, confirming the validity of our paradigm to measure evoked reward-related brain activity. However, results showed no evidence that sitting (versus standing and squatting) trials led to larger reward positivity. Moreover, we found no evidence suggesting that this effect was moderated by typical physical activity, physical activity on the day of the study, or energy expenditure during the experiment. However, at the behavioral level, results showed that the probability of choosing the stimulus more likely to lead to sitting than standing increased as the number of trials increased. In addition, results revealed that the probability of changing the selected stimulus was higher when the previous trial was a stand trial relative to a sit trial. In sum, neural results showed no evidence supporting the theory that opportunities to minimize energy expenditure are rewarding. However, behavioral findings suggested participants tend to choose the less effortful behavioral alternative and were therefore consistent with the theory of effort minimization (TEMPA).

Pathologists aren't pigeons: exploring the neural basis of visual recognition and perceptual expertise in pathology.

Visual (perceptual) reasoning is a critical skill in many medical specialties, including pathology, diagnostic imaging, and dermatology. However, in an ever-compressed medical curriculum, learning and practicing this skill can be challenging. Previous studies (including work with pigeons) have suggested that using reward-feedback-based activities, novices can gain expert levels of visual diagnostic accuracy in shortened training times. But is this level of diagnostic accuracy a result of image recognition (categorization) or is it the acquisition of diagnostic expertise? To answer this, the authors measured electroencephalographic data (EEG) and two components of the human event-related brain potential (reward positivity and N170) to explore the nature of visual expertise in a novice-expert study in pathology visual diagnosis. It was found that the amplitude of the reward positivity decreased with learning in novices (suggesting a decrease in reliance on feedback, as in other studies). However, this signal remained significantly different from the experts whose reward positivity signal did not change over the course of the experiment. There were no changes in the amplitude of the N170 (a reported neural marker of visual expertise) in novices over time. Novice N170 signals remained statistically and significantly lower in amplitude compared to experts throughout task performance. These data suggest that, while novices gained the ability to recognize (categorize) pathologies through reinforcement learning as quantified by the change in reward positivity, increased accuracy, and decreased time for responses, there was little change in the neural marker associated with visual expertise (N170). This is consistent with the multi-dimensional and complex nature of visual expertise and provides insight into future training programs for novices to bridge the expertise gap.

ERP evidence of heightened attentional response to visual stimuli in migraine headache disorders.

New findings from migraine studies have indicated that this common headache disorder is associated with anomalies in attentional processing. In tandem with the previous explorations, this study will provide evidence to show that visual attention is impacted by migraine headache disorders. 43 individuals were initially recruited in the migraine group and 33 people with non-migraine headache disorders were in the control group. The event-related potentials (ERP) of the participants were calculated using data from a visual oddball paradigm task. By analyzing the N200 and P300 ERP components, migraineurs, as compared to controls, had an exaggerated oddball response showing increased amplitude in N200 and P300 difference scores for the oddball vs. standard, while the latencies of the two components remained the same in the migraine and control groups. We then looked at two classifications of migraine with and without aura compared to non-migraine controls. One-Way ANOVA analysis of the two migraine groups and the non-migraine control group showed that the different level of N200 and P300 amplitude mean scores was greater between migraineurs without aura and the control group while these components' latency remained the same relatively in the three groups. Our results give more neurophysiological support that people with migraine headaches have altered processing of visual attention.

A win-win situation: Does familiarity with a social robot modulate feedback monitoring and learning?

Social species rely on the ability to modulate feedback-monitoring in social contexts to adjust one's actions and obtain desired outcomes. When being awarded positive outcomes during a gambling task, feedback-monitoring is attenuated when strangers are rewarded, as less value is assigned to the awarded outcome. This difference in feedback-monitoring can be indexed by an event-related potential (ERP) component known as the Reward Positivity (RewP), whose amplitude is enhanced when receiving positive feedback. While the degree of familiarity influences the RewP, little is known about how the RewP and reinforcement learning are affected when gambling on behalf of familiar versus nonfamiliar agents, such as robots. This question becomes increasingly important given that robots may be used as teachers and/or social companions in the near future, with whom children and adults will interact with for short or long periods of time. In the present study, we examined whether feedback-monitoring when gambling on behalf of oneself compared with a robot is impacted by whether participants have familiarized themselves with the robot before the task. We expected enhanced RewP amplitude for self versus other for those who did not familiarize with the robot and that self-other differences in the RewP would be attenuated for those who familiarized with the robot. Instead, we observed that the RewP was larger when familiarization with the robot occurred, which corresponded to overall worse learning outcomes. We additionally observed an enhanced P3 effect for the high-familiarity condition, which suggests an increased motivation to reward. These findings suggest that familiarization with robots may cause a positive motivational effect, which positively affects RewP amplitudes, but interferes with learning.

Hemispheric activation differences in novice and expert clinicians during clinical decision making.

Clinical decision making requires knowledge, experience and analytical/non-analytical types of decision processes. As clinicians progress from novice to expert, research indicates decision-making becomes less reliant on foundational biomedical knowledge and more on previous experience. In this study, we investigated how knowledge and experience were reflected in terms of differences in neural areas of activation. Novice and expert clinicians diagnosed simple or complex (easy, hard) cases while functional magnetic resonance imaging (fMRI) data were collected. Our results highlight key differences in the neural areas activated in novices and experts during the clinical decision-making process. fMRI data were collected from ten second year medical students (novices) and ten practicing gastroenterologists (experts) while they diagnosed sixteen (eight easy and eight hard) clinical cases via multiple-choice questions. Behavioral data were collected for diagnostic accuracy (correct/incorrect diagnosis) and time taken to assign a clinical diagnosis. Two analyses were performed with the fMRI data. First, data from easy and hard cases were compared within respective groups (easy > hard, hard > easy). Second, neural differences between novices and experts (novice > expert, expert > novice) were assessed. Experts correctly diagnosed more cases than novices and made their diagnoses faster than novices on both easy and hard cases (all p's < 0.05). Time taken to diagnose hard cases took significantly longer for both novices and experts. While similar neural areas were activated in both novices and experts during the decision making process, we identified significant hemispheric activation differences between novice and expert clinicians when diagnosing hard clinical cases. Specifically, novice clinicians had greater activations in the left anterior temporal cortex and left ventral lateral prefrontal cortex whereas expert clinicians had greater activations in the right dorsal lateral, right ventral lateral, and right parietal cortex. Hemispheric differences in activation were not observed between novices and experts while diagnosing easy clinical cases. While clinical decision-making engaged the prefrontal cortex (PFC) in both novices and experts, interestingly we observed expertise related differences in the regions and hemispheres of PFC activation between these groups for hard clinical cases. Specifically, in novices we observed activations in left hemisphere neural regions associated with factual rule-based knowledge, whereas in experts we observed right hemisphere activation in neural regions associated with experiential knowledge. Importantly, at the neural level, our data highlight differences in so called type 2 clinical decision-making processes related to prior knowledge and experience.

Working memory, reasoning, and expertise in medicine-insights into their relationship using functional neuroimaging.

Clinical reasoning is dependent upon working memory (WM). More precisely, during the clinical reasoning process stored information within long-term memory is brought into WM to facilitate the internal deliberation that affords a clinician the ability to reason through a case. In the present study, we examined the relationship between clinical reasoning and WM while participants read clinical cases with functional magnetic resonance imaging (fMRI). More specifically, we examined the impact of clinical case difficulty (easy, hard) and clinician level of expertise (2nd year medical students, senior gastroenterologists) on neural activity within regions of cortex associated with WM (i.e., the prefrontal cortex) during the reasoning process. fMRI was used to scan ten second-year medical students and ten practicing gastroenterologists while they reasoned through sixteen clinical cases [eight straight forward (easy) and eight complex (hard)] during a single 1-h scanning session. Within-group analyses contrasted the easy and hard cases which were then subsequently utilized for a between-group analysis to examine effects of expertise (novice > expert, expert > novice). Reading clinical cases evoked multiple neural activations in occipital, prefrontal, parietal, and temporal cortical regions in both groups. Importantly, increased activation in the prefrontal cortex in novices for both easy and hard clinical cases suggests novices utilize WM more so than experts during clinical reasoning. We found that clinician level of expertise elicited differential activation of regions of the human prefrontal cortex associated with WM during clinical reasoning. This suggests there is an important relationship between clinical reasoning and human WM. As such, we suggest future models of clinical reasoning take into account that the use of WM is not consistent throughout all clinical reasoning tasks, and that memory structure may be utilized differently based on level of expertise.

Two Interventions Decrease Anxiety Sensitivity Among High Anxiety Sensitive Women: Could Physical Exercise Be the Key?

A brief group-based cognitive behavioral therapy (CBT), with running as an interoceptive exposure (IE) component, was effective in reducing anxiety sensitivity (AS) levels in undergraduate women (Watt, Stewart, Lefaivre, & Uman, 2006). This study investigated whether the CBT/IE intervention would result in decreases in AS and emotional distress that would be maintained over 14 weeks. Female undergraduates, high (n = 81) or low (n = 73) in AS, were randomized to 3-day CBT plus forty-two 10-min running IE trials (n = 83) or 3-day health education control (HEC) with interactive discussions and problem solving on exercise, nutrition, and sleep (n = 71). The CBT/IE intervention led to decreases in AS, depression, and stress symptoms for high AS participants, which were maintained at 14 weeks. Unexpectedly, HEC participants experienced similar and lasting decreases in AS, depression, and anxiety symptoms. Furthermore, there were no post-intervention differences between CBT/IE and HEC participants in any of the outcomes. Low AS participants experienced few sustained changes. Clinical implications and the possible role of aerobic exercise in explaining outcomes of both interventions are discussed.

Using brain potentials to understand prism adaptation: the error-related negativity and the P300.

Prism adaptation (PA) is both a perceptual-motor learning task as well as a promising rehabilitation tool for visuo-spatial neglect (VSN)-a spatial attention disorder often experienced after stroke resulting in slowed and/or inaccurate motor responses to contralesional targets. During PA, individuals are exposed to prism-induced shifts of the visual-field while performing a visuo-guided reaching task. After adaptation, with goggles removed, visuomotor responding is shifted to the opposite direction of that initially induced by the prisms. This visuomotor aftereffect has been used to study visuomotor learning and adaptation and has been applied clinically to reduce VSN severity by improving motor responding to stimuli in contralesional (usually left-sided) space. In order to optimize PA's use for VSN patients, it is important to elucidate the neural and cognitive processes that alter visuomotor function during PA. In the present study, healthy young adults underwent PA while event-related potentials (ERPs) were recorded at the termination of each reach (screen-touch), then binned according to accuracy (hit vs. miss) and phase of exposure block (early, middle, late). Results show that two ERP components were evoked by screen-touch: an error-related negativity (ERN), and a P300. The ERN was consistently evoked on miss trials during adaptation, while the P300 amplitude was largest during the early phase of adaptation for both hit and miss trials. This study provides evidence of two neural signals sensitive to visual feedback during PA that may sub-serve changes in visuomotor responding. Prior ERP research suggests that the ERN reflects an error processing system in medial-frontal cortex, while the P300 is suggested to reflect a system for context updating and learning. Future research is needed to elucidate the role of these ERP components in improving visuomotor responses among individuals with VSN.

A biological mechanism for Bayesian feature selection: Weight decay and raising the LASSO.

Biological systems are capable of learning that certain stimuli are valuable while ignoring the many that are not, and thus perform feature selection. In machine learning, one effective feature selection approach is the least absolute shrinkage and selection operator (LASSO) form of regularization, which is equivalent to assuming a Laplacian prior distribution on the parameters. We review how such Bayesian priors can be implemented in gradient descent as a form of weight decay, which is a biologically plausible mechanism for Bayesian feature selection. In particular, we describe a new prior that offsets or "raises" the Laplacian prior distribution. We evaluate this alongside the Gaussian and Cauchy priors in gradient descent using a generic regression task where there are few relevant and many irrelevant features. We find that raising the Laplacian leads to less prediction error because it is a better model of the underlying distribution. We also consider two biologically relevant online learning tasks, one synthetic and one modeled after the perceptual expertise task of Krigolson et al. (2009). Here, raising the Laplacian prior avoids the fast erosion of relevant parameters over the period following training because it only allows small weights to decay. This better matches the limited loss of association seen between days in the human data of the perceptual expertise task. Raising the Laplacian prior thus results in a biologically plausible form of Bayesian feature selection that is effective in biologically relevant contexts.

Running as Interoceptive Exposure for Decreasing Anxiety Sensitivity: Replication and Extension.

A brief, group cognitive behavioural therapy with running as the interoceptive exposure (IE; exposure to physiological sensations) component was effective in decreasing anxiety sensitivity (AS; fear of arousal sensations) levels in female undergraduates (Watt et al., Anxiety and Substance Use Disorders: The Vicious Cycle of Comorbidity, 201-219, 2008). Additionally, repeated exposure to running resulted in decreases in cognitive (i.e., catastrophic thoughts) and affective (i.e., feelings of anxiety) reactions to running over time for high AS, but not low AS, participants (Sabourin et al., "Physical exercise as interoceptive exposure within a brief cognitive-behavioral treatment for anxiety-sensitive women", Journal of Cognitive Psychotherapy, 22:302-320, 2008). A follow-up study including the above-mentioned intervention with an expanded IE component also resulted in decreases in AS levels (Sabourin et al., under review). The goals of the present process study were (1) to replicate the original process study, with the expanded IE component, and (2) to determine whether decreases in cognitive, affective, and/or somatic (physiological sensations) reactions to running would be related to decreases in AS. Eighteen high AS and 10 low AS participants completed 20 IE running trials following the 3-day group intervention. As predicted, high AS participants, but not low AS participants, experienced decreases in cognitive, affective, and somatic reactions to running over time. Furthermore, decreases in cognitive and affective, but not in somatic, reactions to running were related to decreases in AS levels. These results suggest that the therapeutic effects of repeated exposure to running in decreasing sensitivity to anxiety-related sensations are not related to decreasing the experience of somatic sensations themselves. Rather, they are related to altering the cognitive and affective reactions to these sensations.

The role of visual processing in motor learning and control: Insights from electroencephalography.

Traditionally our understanding of goal-directed action been derived from either behavioral findings or neuroanatomically derived imaging (i.e., fMRI). While both of these approaches have proven valuable, they lack the ability to determine a direct locus of function while concurrently having the necessary temporal precision needed to understand millisecond scale neural interactions respectively. In this review we summarize some seminal behavioral findings across three broad areas (target perturbation, feed-forward control, and feedback processing) and for each discuss the application of electroencephalography (EEG) to the understanding of the temporal nature of visual cue utilization during movement planning, control, and learning using four existing scalp potentials. Specifically, we examine the appropriateness of using the N100 potential as an indicator of corrective behaviors in response to target perturbation, the N200 as an index of movement planning, the P300 potential as a metric of feed-forward processes, and the feedback-related negativity as an index of motor learning. Although these existing components have potential for insight into cognitive contributions and the timing of the neural processes that contribute to motor control further research is needed to expand the control-related potentials and to develop methods to permit their accurate characterization across a wide range of behavioral tasks.

How we learn to make decisions: rapid propagation of reinforcement learning prediction errors in humans.

Our ability to make decisions is predicated upon our knowledge of the outcomes of the actions available to us. Reinforcement learning theory posits that actions followed by a reward or punishment acquire value through the computation of prediction errors-discrepancies between the predicted and the actual reward. A multitude of neuroimaging studies have demonstrated that rewards and punishments evoke neural responses that appear to reflect reinforcement learning prediction errors [e.g., Krigolson, O. E., Pierce, L. J., Holroyd, C. B., & Tanaka, J. W. Learning to become an expert: Reinforcement learning and the acquisition of perceptual expertise. Journal of Cognitive Neuroscience, 21, 1833-1840, 2009; Bayer, H. M., & Glimcher, P. W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-141, 2005; O'Doherty, J. P. Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology, 14, 769-776, 2004; Holroyd, C. B., & Coles, M. G. H. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709, 2002]. Here, we used the brain ERP technique to demonstrate that not only do rewards elicit a neural response akin to a prediction error but also that this signal rapidly diminished and propagated to the time of choice presentation with learning. Specifically, in a simple, learnable gambling task, we show that novel rewards elicited a feedback error-related negativity that rapidly decreased in amplitude with learning. Furthermore, we demonstrate the existence of a reward positivity at choice presentation, a previously unreported ERP component that has a similar timing and topography as the feedback error-related negativity that increased in amplitude with learning. The pattern of results we observed mirrored the output of a computational model that we implemented to compute reward prediction errors and the changes in amplitude of these prediction errors at the time of choice presentation and reward delivery. Our results provide further support that the computations that underlie human learning and decision-making follow reinforcement learning principles.

Mind wandering and motor control: off-task thinking disrupts the online adjustment of behavior.

Mind wandering episodes have been construed as periods of "stimulus-independent" thought, where our minds are decoupled from the external sensory environment. In two experiments, we used behavioral and event-related potential (ERP) measures to determine whether mind wandering episodes can also be considered as periods of "response-independent" thought, with our minds disengaged from adjusting our behavioral outputs. In the first experiment, participants performed a motor tracking task and were occasionally prompted to report whether their attention was "on-task" or "mind wandering." We found greater tracking error in periods prior to mind wandering vs. on-task reports. To ascertain whether this finding was due to attenuation in visual perception per se vs. a disruptive effect of mind wandering on performance monitoring, we conducted a second experiment in which participants completed a time-estimation task. They were given feedback on the accuracy of their estimations while we recorded their EEG, and were also occasionally asked to report their attention state. We found that the sensitivity of behavior and the P3 ERP component to feedback signals were significantly reduced just prior to mind wandering vs. on-task attentional reports. Moreover, these effects co-occurred with decreases in the error-related negativity elicited by feedback signals (fERN), a direct measure of behavioral feedback assessment in cortex. Our findings suggest that the functional consequences of mind wandering are not limited to just the processing of incoming stimulation per se, but extend as well to the control and adjustment of behavior.

Electroencephalographic evidence of vector inversion in antipointing.

Mirror-symmetrical reaching movements (i.e., antipointing) produce a visual-field-specific pattern of endpoint bias consistent with a perceptual representation of visual space (Heath et al. in Exp Brain Res 192:275-286, 2009a; J Mot Behav 41:383-392 2009b). The goal of the present investigation was to examine the concurrent behavioural and event-related brain potentials (ERP) of pro- and antipointing to determine whether endpoint bias in the latter task is related to a remapping of the environmental parameters of a target (i.e., vector inversion hypothesis) or a shift of visual attention from a veridical to a cognitively represented target location (i.e., reallocation of attention hypothesis). As expected, results for antipointing-but not propointing-yielded a visual-field-specific pattern of endpoint bias. In terms of the ERP findings, an early component (i.e., the N100) related to the orienting of visuospatial attention was comparable across pro- and antipointing. In contrast, a later occurring component (i.e., the P300) demonstrated a reliable between-task difference in amplitude. Notably, the P300 has been linked to the revision of a 'mental model' when a mismatch is noted between a stimulus and a required task goal (so-called context-updating). Thus, we propose that the between-task difference in the P300 indicates that antipointing is associated with a remapping of a target's veridical location in mirror-symmetrical space (i.e., vector inversion). Moreover, our combined behavioural and ERP findings provide evidence that vector inversion is mediated via perception-based visual networks.

Reduced cortical motor potentials underlie reductions in memory-guided reaching performance.

We used the event-related potential (ERP) methodology to examine differences in neural processing between visually and memory-guided reaches. Consistent with previous findings (e.g., Westwood, Heath, & Roy, 2003), memory-guided reaches undershot veridical target location to a greater extent than their visually guided counterparts. Analysis of the ERP data revealed that memory-guided reaches were associated with reduced potentials over medial-frontal cortex at target presentation and following movement onset. Further, we found that the amplitudes of the potentials over medial-frontal cortex for visually and memory-guided reaches were significantly correlated with the peak accelerations and decelerations of the reaching movements. Our results suggest that memory-guided reaches are mediated by a motor plan that is generated while a target is visible, and then stored in memory until needed--a result counter to recent behavioral theories asserting that memory-guided reaches are planned just before movement onset via a stored, sensory-based target representation.

When "it" becomes "mine": attentional biases triggered by object ownership.

Previous research has demonstrated that higher-order cognitive processes associated with the allocation of selective attention are engaged when highly familiar self-relevant items are encountered, such as one's name, face, personal possessions and the like. The goal of our study was to determine whether these effects on attentional processing are triggered on-line at the moment self-relevance is established. In a pair of experiments, we recorded ERPs as participants viewed common objects (e.g., apple, socks, and ketchup) in the context of an "ownership" paradigm, where the presentation of each object was followed by a cue indicating whether the object nominally belonged either to the participant (a "self" cue) or the experimenter (an "other" cue). In Experiment 1, we found that "self" ownership cues were associated with increased attentional processing, as measured via the P300 component. In Experiment 2, we replicated this effect while demonstrating that at a visual-perceptual level, spatial attention became more narrowly focused on objects owned by self, as measured via the lateral occipital P1 ERP component. Taken together, our findings indicate that self-relevant attention effects are triggered by the act of taking ownership of objects associated with both perceptual and postperceptual processing in cortex.

The importance of skin color and facial structure in perceiving and remembering others: an electrophysiological study.

The own-race bias (ORB) is a well-documented recognition advantage for own-race (OR) over cross-race (CR) faces, the origin of which remains unclear. In the current study, event-related potentials (ERPs) were recorded while Caucasian participants age-categorized Black and White faces which were digitally altered to display either a race congruent or incongruent facial structure. The results of a subsequent surprise memory test indicated that regardless of facial structure participants recognized White faces better than Black faces. Additional analyses revealed that temporally-early ERP components associated with face-specific perceptual processing (N170) and the individuation of facial exemplars (N250) were selectively sensitive to skin color. In addition, the N200 (a component that has been linked to increased attention and depth of encoding afforded to in-group and OR faces) was modulated by color and structure, and correlated with subsequent memory performance. However, the LPP component associated with the cognitive evaluation of perceptual input was influenced by racial differences in facial structure alone. These findings suggest that racial differences in skin color and facial structure are detected during the encoding of unfamiliar faces, and that the categorization of conspecifics as members of our social in-group on the basis of their skin color may be a determining factor in our ability to subsequently remember them.