Trimodal processing of complex stimuli in inferior parietal cortex is modality-independent.

In humans, multisensory mechanisms facilitate object processing through integration of sensory signals that match in their temporal and spatial occurrence as well as their meaning. The generalizability of such integration processes across different sensory modalities is, however, to date not well understood. As such, it remains unknown whether there are cerebral areas that process object-related signals independently of the specific senses from which they arise, and whether these areas show different response profiles depending on the number of sensory channels that carry information. To address these questions, we presented participants with dynamic stimuli that simultaneously emitted object-related sensory information via one, two, or three channels (sight, sound, smell) in the MR scanner. By comparing neural activation patterns between various integration processes differing in type and number of stimulated senses, we showed that the left inferior frontal gyrus and areas within the left inferior parietal cortex were engaged independently of the number and type of sensory input streams. Activation in these areas was enhanced during bimodal stimulation, compared to the sum of unimodal activations, and increased even further during trimodal stimulation. Taken together, our findings demonstrate that activation of the inferior parietal cortex during processing and integration of meaningful multisensory stimuli is both modality-independent and modulated by the number of available sensory modalities. This suggests that the processing demand placed on the parietal cortex increases with the number of sensory input streams carrying meaningful information, likely due to the increasing complexity of such stimuli.

Does insufficient sleep affect how you learn from reward or punishment? Reinforcement learning after 2 nights of sleep restriction.

To learn from feedback (trial and error) is essential for all species. Insufficient sleep has been found to reduce the sensitivity to feedback as well as increase reward sensitivity. To determine whether insufficient sleep alters learning from positive and negative feedback, healthy participants (n = 32, mean age 29.0 years, 18 women) were tested once after normal sleep (8 hr time in bed for 2 nights) and once after 2 nights of sleep restriction (4 hr/night) on a probabilistic selection task where learning behaviour was evaluated in three ways: as generalised learning, short-term win-stay/lose-shift learning strategies, and trial-by-trial learning rate. Sleep restriction did not alter the sensitivity to either positive or negative feedback on generalised learning. Also, short-term win-stay/lose-shift strategies were not affected by sleep restriction. Similarly, results from computational models that assess the trial-by-trial update of stimuli value demonstrated no difference between sleep conditions after the first block. However, a slower learning rate from negative feedback when evaluating all learning blocks was found after sleep restriction. Despite a marked increase in sleepiness and slowed learning rate for negative feedback, sleep restriction did not appear to alter strategies and generalisation of learning from positive or negative feedback.

Multisensory Enhancement of Odor Object Processing in Primary Olfactory Cortex.

Identification of an object based on its odor alone is inherently difficult, but becomes easier when other senses provide supporting cues. This suggests that crossmodal sensory input facilitates neural processing of olfactory object information; however, direct evidence is still lacking. Here, we tested the effect of multisensory stimulation on information processing in the human posterior piriform cortex (PPC), a region linked to olfactory object encoding. Participants were exposed to familiar objects in the form of uni-, bi-, and trimodal combinations of odors, videos, and sounds. We hypothesized that the PPC would respond to non-olfactory object information, and that activity would increase linearly with the number of senses providing relevant object information. As predicted, visual object information activated the PPC and activity increased linearly with the number of relevant sensory channels. The crossmodal response pattern thus indicates that the PPC does not exclusively respond to olfactory information, but also to crossmodal object information important for olfactory processing. The continuous activity increase suggests that the PPC further acts as a multisensory binding site where pertinent input from multiple senses results in an increased neural response to the odor object. This potentially represents a neural mechanism for the well-known behavioral improvement present in odor object recognition during concurrent crossmodal sensory stimulation.

Sensory loss enhances multisensory integration performance.

Auditory and visual sensory loss has repeatedly been shown to alter abilities in remaining sensory modalities. It is, however, unclear whether sensory loss also impacts multisensory integration; an ability that is fundamental for the perception of the world around us. We determined effects of olfactory sensory deprivation on multisensory perception by assessing temporal as well as semantic aspects of audio-visual integration in 37 individuals with anosmia (complete olfactory sensory loss) and 37 healthy, matched controls. Participants performed a simultaneity judgement task to determine the temporal binding window, and a multisensory object identification task with individually degraded, dynamic visual, auditory, and audio-visual stimuli. Individuals with anosmia demonstrated an increased ability to detect multisensory temporal asynchronies, represented by a narrowing of the audio-visual temporal binding window. Furthermore, individuals with congenital, but not acquired, anosmia demonstrated indications of greater benefits from bimodal, as compared to unimodal, stimulus presentation when faced with degraded, semantic information. This suggests that the absence of the olfactory sense alters multisensory integration of remaining senses by sharpening the perception of cross-modal temporal violations, independent of sensory loss etiology. In addition, congenital sensory loss may further lead to increased gain from multisensory, compared to unisensory, information. Taken together, multisensory compensatory mechanisms at different levels of perceptual complexity are present in individuals with anosmia.

A mammalian blood odor component serves as an approach-avoidance cue across phylum border - from flies to humans.

Chemosignals are used by predators to localize prey and by prey to avoid predators. These cues vary between species, but the odor of blood seems to be an exception and suggests the presence of an evolutionarily conserved chemosensory cue within the blood odor mixture. A blood odor component, E2D, has been shown to trigger approach responses identical to those triggered by the full blood odor in mammalian carnivores and as such, is a key candidate as a food/alarm cue in blood. Using a multidisciplinary approach, we demonstrate that E2D holds the dual function of affecting both approach and avoidance behavior in a predator-prey predicted manner. E2D evokes approach responses in two taxonomically distant blood-seeking predators, Stable fly and Wolf, while evoking avoidance responses in the prey species Mouse. We extend this by demonstrating that this chemical cue is preserved in humans as well; E2D induces postural avoidance, increases physiological arousal, and enhances visual perception of affective stimuli. This is the first demonstration of a single chemical cue with the dual function of guiding both approach and avoidance in a predator-prey predicted manner across taxonomically distant species, as well as the first known chemosignal that affects both human and non-human animals alike.

Behavioral and neural correlates to multisensory detection of sick humans.

Throughout human evolution, infectious diseases have been a primary cause of death. Detection of subtle cues indicating sickness and avoidance of sick conspecifics would therefore be an adaptive way of coping with an environment fraught with pathogens. This study determines how humans perceive and integrate early cues of sickness in conspecifics sampled just hours after the induction of immune system activation, and the underlying neural mechanisms for this detection. In a double-blind placebo-controlled crossover design, the immune system in 22 sample donors was transiently activated with an endotoxin injection [lipopolysaccharide (LPS)]. Facial photographs and body odor samples were taken from the same donors when "sick" (LPS-injected) and when "healthy" (saline-injected) and subsequently were presented to a separate group of participants (n = 30) who rated their liking of the presented person during fMRI scanning. Faces were less socially desirable when sick, and sick body odors tended to lower liking of the faces. Sickness status presented by odor and facial photograph resulted in increased neural activation of odor- and face-perception networks, respectively. A superadditive effect of olfactory-visual integration of sickness cues was found in the intraparietal sulcus, which was functionally connected to core areas of multisensory integration in the superior temporal sulcus and orbitofrontal cortex. Taken together, the results outline a disease-avoidance model in which neural mechanisms involved in the detection of disease cues and multisensory integration are vital parts.

Extensive training leads to temporal and spatial shifts of cortical activity underlying visual category selectivity.

The human visual system is able to distinguish naturally occurring categories with exceptional speed and accuracy. At the same time, it exhibits substantial plasticity, permitting the seamless and fast learning of entirely novel categories. Here we investigate the interplay of these two processes by asking how category selectivity emerges and develops from initial to extended category learning. For this purpose, we combine a rapid event-related MEG adaptation paradigm, an extension of fMRI adaptation to high temporal resolution, a novel spatiotemporal analysis approach to separate adaptation effects from other effect origins, and source localization. The results demonstrate a spatiotemporal shift of cortical activity underlying category selectivity: after initial category acquisition, the onset of category selectivity was observed starting at 275ms together with stronger activity in prefrontal cortex. Following extensive training over 22 sessions, adding up to more than 16.600 trials, the earliest category effects occurred at a markedly shorter latency of 113ms and were accompanied by stronger occipitotemporal activity. Our results suggest that the brain balances plasticity and efficiency by relying on different mechanisms to recognize new and re-occurring categories.