Stimulus Onset Asynchrony Affects Weighting-related Event-related Spectral Power in Self-motion Perception.

Self-motion perception relies primarily on the integration of the visual, vestibular, proprioceptive, and somatosensory systems. There is a gap in understanding how a temporal lag between visual and vestibular motion cues affects visual-vestibular weighting during self-motion perception. The beta band is an index of visual-vestibular weighting, in that robust beta event-related synchronization (ERS) is associated with visual weighting bias, and robust beta event-related desynchronization is associated with vestibular weighting bias. The present study examined modulation of event-related spectral power during a heading judgment task in which participants attended to either visual (optic flow) or physical (inertial cues stimulating the vestibular, proprioceptive and somatosensory systems) motion cues from a motion simulator mounted on a MOOG Stewart Platform. The temporal lag between the onset of visual and physical motion cues was manipulated to produce three lag conditions: simultaneous onset, visual before physical motion onset, and physical before visual motion onset. There were two main findings. First, we demonstrated that when the attended motion cue was presented before an ignored cue, the power of beta associated with the attended modality was greater than when visual-vestibular cues were presented simultaneously or when the ignored cue was presented first. This was the case for beta ERS when the visual-motion cue was attended to, and beta event-related desynchronization when the physical-motion cue was attended to. Second, we tested whether the power of feature-binding gamma ERS (demonstrated in audiovisual and visual-tactile integration studies) increased when the visual-vestibular cues were presented simultaneously versus with temporal asynchrony. We did not observe an increase in gamma ERS when cues were presented simultaneously, suggesting that electrophysiological markers of visual-vestibular binding differ from markers of audiovisual and visual-tactile integration. All event-related spectral power reported in this study were generated from dipoles projecting from the left and right motor areas, based on the results of Measure Projection Analysis.

Testing landmark-specific effects on route navigation in an ecologically valid setting: a simulated driving study.

We used a driving simulator to investigate landmark-based route navigation in young adults. Previous research has examined how proximal and distal landmarks influence route navigation, however, these effects have not been extensively tested in ecologically-relevant settings. We used a virtual town in which participants learned various routes while simultaneously driving. We first examined the effect of four different landmark conditions on navigation performance, such that each driver experienced one of four versions of the town with either proximal landmarks only, distal landmarks only, both proximal and distal landmarks, or no landmarks. Drivers were given real-time navigation directions along a route to a target destination, and were then tested on their ability to navigate to the same destination without directions. We found that the presence of proximal landmarks significantly improved route navigation. We then examined the effect of prior exposure to proximal vs. distal landmarks by testing the same drivers in the same environment they previously encountered, but with the landmarks removed. In this case, we found that prior exposure to distal landmarks significantly improved route navigation. The present results are in line with existing research on route navigation and landmarks, suggesting that these findings can be extended to ecologically-relevant settings.

Visual-vestibular integration is preserved with healthy aging in a simple acceleration detection task.

Aging is associated with a gradual decline in the sensory systems and noisier sensory information. Some research has found that older adults compensate for this with enhanced multisensory integration. However, less is known about how aging influences visual-vestibular integration, an ability that underlies self-motion perception. We examined how visual-vestibular integration changes in participants from across the lifespan (18-79 years old) with a simple reaction time task. Participants were instructed to respond to visual (optic flow) and vestibular (inertial motion) acceleration cues, presented either alone or at a stimulus onset asynchrony. We measured reaction times and computed the violation area relative to the race model inequality as a measure of visual-vestibular integration. Across all ages, the greatest visual-vestibular integration occurred when the vestibular cue was presented first. Age was associated with longer reaction times and a significantly lower detection rate in the vestibular-only condition, a finding that is consistent with an age-related increase in vestibular noise. Although the relationship between age and visual-vestibular integration was positive, the effect size was very small and did not reach statistical significance. Our results suggest that although age is associated with a significant increase in vestibular perceptual threshold, the relative amount of visual-vestibular integration remains largely intact.

Vestibular cues improve landmark-based route navigation: A simulated driving study.

It is well established that humans use self-motion and landmark cues to successfully navigate their environment. Existing research has demonstrated a critical role of the vestibular system in supporting navigation across many species. However, less is known about how vestibular cues interact with landmarks to promote successful navigation in humans. In the present study, we used a motion simulator to manipulate the presence or absence of vestibular cues during a virtual navigation task. Participants learned routes to a target destination in three different landmark blocks in a virtual town: one with proximal landmarks, one with distal landmarks, and one with no landmarks present. Afterwards, they were tested on their ability to retrace the route and find the target destination. We observed a significant interaction between vestibular cues and proximal landmarks, demonstrating that the potential for vestibular cues to improve route navigation is dependent on landmarks that are present in the environment. In particular, vestibular cues significantly improved route navigation when proximal landmarks were present, but this was not significant when distal landmarks or no landmarks were present. Overall, our results indicate that landmarks play an important role in the successful incorporation of vestibular cues to human spatial navigation.

Visual imagery influences attentional guidance during visual search: Behavioral and electrophysiological evidence.

Recent behavioral studies have shown that color imagery can benefit visual search when it is congruent with an upcoming target. In the present study we investigated whether this color imagery benefit was due to the processes underlying attentional guidance, as indicated by the electrophysiological marker known as the N2pc component. Participants were instructed to imagine a color prior to each trial of a singleton search task. On some trials, the imagined color was congruent with the target, and on other trials, it was congruent with the distractors. The analyses revealed that the N2pc was present when color imagery was congruent with the search target, and absent when it was congruent with the distractors. Further, there was preliminary evidence that attentional guidance depended on the vividness of color imagery and the frequency at which participants implemented the imagery instruction. Overall, the results of the present study indicate that color imagery can influence the attentional guidance processes underlying visual search.

Velocity influences the relative contributions of visual and vestibular cues to self-acceleration.

Self-motion perception is based on the integration of visual (optic flow) and vestibular (inertial) sensory information. Previous research has shown that the relative contribution of visual and vestibular cues can change in real time based on the reliability of that information. The present study assessed whether initial velocity and acceleration magnitude influence the relative contribution of these cues to the detection of self-acceleration. Participants performed a simple response time task with visual and vestibular self-acceleration cues as targets. Visual optic flow was presented at three possible initial velocities of 3, 9, or 15 m/s, and accelerated to result in three possible final velocities of 21, 27, or 33 m/s. Corresponding vestibular cues were presented at magnitudes between 0.01 and 0.04 g. The self-acceleration cues were presented at three possible stimulus onset asynchronies (SOAs): visual-first (by 100 ms), in-sync, and vestibular-first (by 100 ms). We found that presenting the cues in-sync resulted in the fastest responses across all velocities and acceleration magnitudes. Interestingly, presenting the visual cue first resulted in a relative advantage over vestibular-first at the slowest initial velocity of 3 m/s, and vice versa for the fastest initial velocity of 15 m/s. The fastest overall responses for visual-first and in-sync were observed at 9 m/s. The present results support the hypothesis that velocity of optic flow can alter the relative contribution of visual and vestibular cues to the detection of self-acceleration.

The relation between brain signal complexity and task difficulty on an executive function task.

On a daily basis, we constantly deal with changing environmental cues and perceptual conflicts and as such, our brains must flexibly adapt to current demands in order to act appropriately. Brains become more efficient and are able to switch states more readily by increasing the complexity of their neural networks. However, it is unclear how brain signal complexity relates to behavior in young adults performing cognitively demanding executive function tasks. Here we used multiscale entropy analysis and multivariate statistics on EEG data while participants performed a bivalency effect task-switching paradigm to show that brain signal complexity in young adults increases as task demands increase, that increases in brain signal complexity are associated with both speed gains and losses depending on scalp location, and that more difficult tasks are associated with more circumscribed complexity across the scalp. Overall, these findings highlight a critical role for brain signal complexity in predicting behavior on an executive function task among young adults.

Attention modulates event-related spectral power in multisensory self-motion perception.

Humans integrate visual and physical (vestibular and proprioceptive) cues to motion during self-motion perception. Theta and alpha-band oscillations have been associated with the processing of visual motion (e.g. optic flow). Alpha and beta-band oscillations have been shown to be associated with sensory-motor processing (e.g. walking). The present study examined modulation of theta, alpha, and beta oscillations while participants made heading direction judgments during a passive self-motion task which required selective attention to one of the simultaneously presented visual or physical motion stimuli. Attention to physical (while ignoring visual) motion produced a different time course of changes in spectral power compared to attention to visual (while ignoring physical) motion. We observed weaker theta event-related synchronization (ERS), as well as stronger beta and later onset of alpha event-related desynchronization (ERD) in the attend-physical condition compared to the attend-visual condition. We observed individual differences in terms of ability to perform the task. Specifically, some participants were not able to ignore or discount the visual input when visual and physical heading direction was incongruent; this was reflected by similar event-related spectral power for both conditions. The results demonstrated a possible electrophysiological signature of the time course of 1) cue conflict (congruency effects), 2) attention to specific motion cues, and 3) individual differences in perceptual weighting of motion stimuli (high-vs. low-accuracy effects).

Psychological ownership: The implicit association between self and already-owned versus newly-owned objects.

Evidence from explicit measures (e.g. favourability ratings, valuations) has led to the prevalent hypothesis that owned objects become cognitively associated with self-concept. Using a novel version of the Implicit Association Test (self-object IAT), wherein participants categorized objects by colour, we evaluated implicit cognitive associations involving self with already-owned and newly-owned objects. We observed faster responses when self-related words required the same response key as the colour that incidentally corresponded to self-owned objects, irrespective of length of ownership. These findings suggest that participants efficiently form cognitive associations between self and self-owned objects within mere minutes of ownership induction and inspire questions about the extent to which length of ownership drives the strength of this association.

The Effectiveness of Simulator Motion in the Transfer of Performance on a Tracking Task Is Influenced by Vision and Motion Disturbance Cues.

OBJECTIVE: To examine the importance of platform motion to the transfer of performance in motion simulators. BACKGROUND: The importance of platform motion in simulators for pilot training is strongly debated. We hypothesized that the type of motion (e.g., disturbance) contributes significantly to performance differences. METHODS: Participants used a joystick to perform a target tracking task in a pod on top of a MOOG Stewart motion platform. Five conditions compared training without motion, with correlated motion, with disturbance motion, with disturbance motion isolated to the visual display, and with both correlated and disturbance motion. The test condition involved the full motion model with both correlated and disturbance motion. We analyzed speed and accuracy across training and test as well as strategic differences in joystick control. RESULTS: Training with disturbance cues produced critical behavioral differences compared to training without disturbance; motion itself was less important. CONCLUSION: Incorporation of disturbance cues is a potentially important source of variance between studies that do or do not show a benefit of motion platforms in the transfer of performance in simulators. APPLICATION: Potential applications of this research include the assessment of the importance of motion platforms in flight simulators, with a focus on the efficacy of incorporating disturbance cues during training.

Event-related potentials reveal the relations between feature representations at different levels of abstraction.

In this paper, we use behavioural methods and event-related potentials (ERPs) to explore the relations between informational and instantiated features, as well as the relation between feature abstraction and rule type. Participants are trained to categorize two species of fictitious animals and then identify perceptually novel exemplars. Critically, two groups are given a perfectly predictive counting rule that, according to Hannah and Brooks (2009. Featuring familiarity: How a familiar feature instantiation influences categorization. Canadian Journal of Experimental Psychology/Revue Canadienne de Psychologie Expérimentale, 63, 263-275. Retrieved from http://doi.org/10.1037/a0017919), should orient them to using abstract informational features when categorizing the novel transfer items. A third group is taught a feature list rule, which should orient them to using detailed instantiated features. One counting-rule group were taught their rule before any exposure to the actual stimuli, and the other immediately after training, having learned the instantiations first. The feature-list group were also taught their rule after training. The ERP results suggest that at test, the two counting-rule groups processed items differently, despite their identical rule. This not only supports the distinction that informational and instantiated features are qualitatively different feature representations, but also implies that rules can readily operate over concrete inputs, in contradiction to traditional approaches that assume that rules necessarily act on abstract inputs.

Electrophysiological correlates of implicit valenced self-processing in high vs. low self-esteem individuals.

We provide the first high-temporal resolution account of the self-esteem implicit association test (IAT; Greenwald & Farnham, 2000) to highlight important similarities and differences between the cognitive processes corresponding to implicit valenced self-processing in high vs. low self-esteem individuals. We divided individuals into high and low self-esteem groups based on the Rosenberg self-esteem scale (Rosenberg, 1965) and administered the self-esteem IAT while recording electroencephalographic data. We show that the P2 captured group (high vs. low self-esteem) differences, the N250 and the late parietal positivity (LPP) captured differences corresponding to category pairing (self/positive vs. self/negative pairing), and the N1, P2, and P300-400 components captured interactions between self-esteem groups and whether the self was paired with positive or negative categories in the IAT. Overall, both high and low self-esteem groups were sensitive to the distinction between positive and negative information in relation to the self (me/negative generally displayed larger event-related potential amplitudes than me/positive), but for high self-esteem individuals, this difference was generally larger, earlier, and most pronounced over left-hemisphere electrodes. These electrophysiological differences may reflect differences in attentional resources devoted to teasing apart these two oppositely valenced associations. High self-esteem individuals appear to devote more automatic (early) attentional resources to strengthen the distinction between positively or negatively valenced information in relation to the self.

Support for a history-dependent predictive model of dACC activity in producing the bivalency effect: an event-related potential study.

In the present study, we examine electrophysiological correlates of factors influencing an adjustment in cognitive control known as the bivalency effect. During task-switching, the occasional presence of bivalent stimuli in a block of univalent trials is enough to elicit a response slowing on all subsequent univalent trials. Bivalent stimuli can be congruent or incongruent with respect to the response afforded by the irrelevant stimulus feature. Here we show that the incongruent bivalency effect, the congruent bivalency effect, and an effect of a simple violation of expectancy are captured at a frontal ERP component (between 300 and 550ms) associated with ACC activity, and that the unexpectedness effect is distinguished from both congruent and incongruent bivalency effects at an earlier component (100-120ms) associated with the temporal parietal junction. We suggest that the frontal component reflects the dACC's role in predicting future cognitive load based on recent history. In contrast, the posterior component may index early visual feature extraction in response to bivalent stimuli that cue currently ongoing tasks; dACC activity may trigger the temporal parietal activity only when specific task cueing is involved and not for simple violations of expectancy.

Afterimage induced neural activity during emotional face perception.

The N170 response differs when positive versus negative facial expressions are viewed. This neural response could be associated with the perception of emotions, or some feature of the stimulus. We used an aftereffect paradigm to clarify. Consistent with previous reports of emotional aftereffects, a neutral face was more likely to be described as happy following a sad face adaptation, and more likely to be described as sad following a happy face adaptation. In addition, similar to previous observations with actual emotional faces, we found differences in the latency of the N170 elicited by the neutral face following sad versus happy face adaptation, demonstrating that the emotion-specific effect on the N170 emerges even when emotion expressions are perceptually different but physically identical. The re-entry of emotional information from other brain regions may be driving the emotional aftereffects and the N170 latency differences.

A role for recency of response conflict in producing the bivalency effect.

The bivalency effect is a block-wise response slowing that is observed during task-switching when rare stimuli that cue two tasks (bivalent stimuli) are encountered. This adjustment in response style affects all trials that follow bivalent stimuli, including those trials that do not share any features with bivalent stimuli. However, the specific stimulus and response properties that trigger the bivalency effect are not well understood. In typical bivalency effect experiments, bivalent stimuli can be congruent or incongruent with respect to the response afforded by the irrelevant stimulus feature, and this distinction has never been examined. In the present study, we show that cognitive load defined by the response incongruence on bivalent trials plays a critical role in producing the subsequent response slowing observed in the bivalency effect, as well as maintaining the magnitude of the bivalency effect across practice. We propose that the bivalency effect reflects a process involved in predicting future cognitive load based on recent cognitive load experience. This is in line with a recent proposal for a role of the ACC in monitoring ongoing changes in the environment to optimize future performance (Sheth et al., in Nature 488:218-221, 2012).

Event-related potentials as brain correlates of item specific proportion congruent effects.

The item-specific proportion congruency (ISPC) effect is consistent with the idea that control processes can be applied rapidly in accord with previously experienced conflict for a particular category. An alternative account of this effect is that it reflects item-specific learning processes unrelated to control at the level of the category. The accounts predict the same behaviour but differ in terms of electrophysiological predictions. Two experiments examined the ISPC effect with a particular focus on neural correlates that might reveal whether, and how early in processing, high and low proportion congruent items are treated as distinct classes of stimuli. For both tasks, the proportion congruency category was distinguished prior to the congruence of the specific stimulus, as early as 100 ms post-stimulus onset for the global/local identification task (Experiment 1) and 150 ms for the Stroop task (Experiment 2). The results support an on-line control account of ISPC effects.

The bivalency effect in task switching: event-related potentials.

During task switching, if we occasionally encounter stimuli that cue more than one task (i.e., bivalent stimuli), response slowing is observed on all univalent trials within that block, even when no features overlap with the bivalent stimuli. This observation is known as the bivalency effect. Previous fMRI work (Woodward et al., 2008) clearly suggests a role for the dorsal anterior cingulate cortex (dACC) in the bivalency effect, but the time course remains uncertain. Here, we present the first high-temporal resolution account for the bivalency effect using stimulus-locked event-related potentials. Participants alternated among three simple tasks in six experimental blocks, with bivalent stimuli appearing occasionally in bivalent blocks (blocks 2, 4, and 6). The increased reaction times for univalent stimuli in bivalent blocks demonstrate that these stimuli are being processed differently from univalent stimuli in purely univalent blocks. Frontal electrode sites captured significant amplitude differences associated with the bivalency effect within time windows 100-120 ms, 375-450 ms, and 500-550 ms, which may reflect additional extraction of visual features present in bivalent stimuli (100-120 ms) and suppression of processing carried over from irrelevant cues (375-450 ms and 500-550 ms). Our results support the fMRI findings and provide additional evidence for involvement of the dACC. Furthermore, the bivalency effect dissipated with extended practice both behaviorally and electrophysiologically. These findings are discussed in relation to the differential processing involved in a controlled response style.

Relating brain signal variability to knowledge representation.

We assessed the hypothesis that brain signal variability is a reflection of functional network reconfiguration during memory processing. In the present experiments, we use multiscale entropy to capture the variability of human electroencephalogram (EEG) while manipulating the knowledge representation associated with faces stored in memory. Across two experiments, we observed increased variability as a function of greater knowledge representation. In Experiment 1, individuals with greater familiarity for a group of famous faces displayed more brain signal variability. In Experiment 2, brain signal variability increased with learning after multiple experimental exposures to previously unfamiliar faces. The results demonstrate that variability increases with face familiarity; cognitive processes during the perception of familiar stimuli may engage a broader network of regions, which manifests as higher complexity/variability in spatial and temporal domains. In addition, effects of repetition suppression on brain signal variability were observed, and the pattern of results is consistent with a selectivity model of neural adaptation.

Neural temporal dynamics of contingency judgement.

The present study captures the dynamics of neural processing across positively contingent, negatively contingent, and noncontingent relations. In the setting of a hypothetical chat room conversation, participants rated the contingency of emotional response between two individuals. Event-related potentials (ERPs) were time-locked to the onset of each emotional event. Although each event alone was ambiguous regarding contingency, its neural response was characteristic of the overall contingent relation and the subsequent contingency rating. Very early displays of contingency modified the ERP anterior N1 (AN1) component amplitude. In contrast, the ERP selection negativity (SN) component amplitude seemed to be more sensitive to display properties than contingency. Our results point to the recruitment of early attentional processes for contingency judgement and highlight the efficiency of statistical information processing.

Modality-specific control processes in verbal versus spatial working memory.

Over the past decade, neuroimaging and electrophysiological studies of working memory (WM) have made progress in distinguishing the neural substrates of central executive (CE) functions from substrates of temporary storage subsystems. However, the degree to which CE-related processes and their substrates may be further fractionated is less clear. The present study measured event-related potentials (ERPs) in a running memory paradigm, to study modality-specific CE-related processes in verbal and spatial WM. Participants were asked to remember either verbal (digit identity) or spatial (digit location) information for the first or last three items in a variable length sequence of spatially distributed digit stimuli. Modality-specific WM demand-sensitive ERP amplitude effects were selectively observed over left prefrontal areas under verbal WM performance and over right prefrontal areas under spatial WM performance. In addition, distinct patterns of item-by-item sensitivity under high-CE-demand conditions suggested qualitatively different processing strategies for verbal versus spatial tasks. These results suggest that both modality-specific and task-general CE-related processes are likely operational in many WM situations and that careful dissociative methods will be needed to properly further fractionate and characterize these component CE-related processes and their neurological substrates.