Intersection of reality and fiction in art perception: pictorial space, body sway and mental imagery.

BACKGROUND: The thesis of embodied cognition claims that perception of the environment entails a complex set of multisensory processes which forms a basis for the agent's potential and immediate actions. However, in the case of artworks, an agent becomes an observer and action turns into a reaction. This raises questions about the presence of embodied or situated cognition involved in art reception. AIMS: The study aimed to assess the bodily correlates of perceiving fictional pictorial spaces in the absence of a possibility of an actual physical immersion or manipulation of represented forms. METHOD: The subjects were presented with paintings by Vermeer and De Hooch, whilst their body sway and eye movements were recorded. Moreover, test and questionnaires on mental imagery (MRT, VVIQ and OSIQ) were administered. RESULTS: Three major results were obtained: (1) the degree of pictorial depth did not influence body sway; (2) fixations to distant elements in paintings (i.e. backgrounds) were accompanied by an increase in body sway; and (3) mental rotation test scores correlated positively with body sway. CONCLUSIONS: Our results suggest that in certain cases--despite the fictional character of art--observers' reactions resemble reactions to real stimuli. It is proposed that these reactions are mediated by mental imagery (e.g. mental rotation) that contributes to the act of representing alternative to real artistic spaces.

An fMRI investigation on image generation in different sensory modalities: the influence of vividness.

In the present fMRI study the issue of the specific cortices activation during imagery generation in different sensory modalities is addressed. In particular, we tested whether the vividness variability of imagery was reflected in the BOLD signal within specific sensory cortices. Subjects were asked to generate a mental image for each auditory presented sentence. Each imagery modality was contrasted with an abstract sentence condition. In addition, subjects were asked to fill the Italian version of the Questionnaire Upon Mental Imagery (QMI) prior to each neuroimaging session. In general, greater involvement of sensory specific cortices in high-vivid versus low-vivid subjects was found for visual (occipital), gustatory (anterior insula), kinaesthetic (pre-motor), and tactile and for somatic (post-central parietal) imagery modalities. These results support the hypothesis that vividness is related to image format: high-vivid subjects would create more analogical representations relying on the same specific neural substrates active during perception with respect to low-vivid subjects. Results are also discussed according to the simulation perspective.

Successful extension of assessment and rehabilitation intervention for an adolescent with postcoma multiple disabilities through a learning setup.

Prior to the beginning of this study, the participant (an adolescent with postcoma multiple disabilities) had learned to use a forehead-skin response to access environmental stimuli. These learning data seemed to indicate a minimally conscious state (i.e., awareness of the link between response and stimuli) in spite of 1) a previous diagnosis of postcoma vegetative state; and 2) concomitant electrophysiological measurement showing no evidence of a passive P300 response and of mismatch negativity. The present study was an effort to extend the early learning investigation with two additional responses and related stimuli to broaden learning evidence and ascertain possible choice behavior. Results indicated that the participant learned the new responses and also provided evidence of choice behavior. These data were discussed in terms of the usefulness of the learning paradigm in the assessment and rehabilitation of persons with postcoma multiple disabilities and consciousness disorders.

Hypothalamus, sexual arousal and psychosexual identity in human males: a functional magnetic resonance imaging study.

In a recent functional magnetic resonance imaging study, a complex neural circuit was shown to be involved in human males during sexual arousal [A. Ferretti et al. (2005) Neuroimage, 26, 1086]. At group level, there was a specific correlation between penile erection and activations in anterior cingulate, insula, amygdala, hypothalamus and secondary somatosensory regions. However, it is well known that there are remarkable inter-individual differences in the psychological view and attitude to sex of human males. Therefore, a crucial issue is the relationship among cerebral responses, sexual arousal and psychosexual identity at individual level. To address this issue, 18 healthy male subjects were recruited. Their deep sexual identity (DSI) was assessed following the construct revalidation by M. Olivetti Belardinelli [(1994) Sci. Contrib. Gen. Psychol., 11, 131] of the Franck drawing completion test, a projective test providing, according to this revalidation, quantitative scores on 'accordance/non-accordance' between self-reported and psychological sexual identity. Cerebral activity was evaluated by means of functional magnetic resonance imaging during hard-core erotic movies and sport movies. Results showed a statistically significant positive correlation between the blood oxygen level-dependent signal in bilateral hypothalamus and the Franck drawing completion test score during erotic movies. The higher the blood oxygen level-dependent activation in bilateral hypothalamus, the higher the male DSI profile. These results suggest that, in male subjects, inter-individual differences in the DSI are strongly correlated with blood flow to the bilateral hypothalamus, a dimorphic brain region deeply implicated in instinctual drives including reproduction.

A frontoparietal network for spatial attention reorienting in the auditory domain: a human fMRI/MEG study of functional and temporal dynamics.

Several studies have identified a supramodal network critical to the reorienting of attention toward stimuli at novel locations and which involves the right temporoparietal junction and the inferior frontal areas. The present functional magnetic resonance imaging (fMRI)\magnetoencephalography (MEG) study investigates: 1) the cerebral circuit underlying attentional reorienting to spatially varying sound locations; 2) the circuit related to the regular change of sound location in the same hemifield, the change of sound location across hemifields, or sounds presented randomly at different locations on the azimuth plane; 3) functional temporal dynamics of the observed cortical areas exploiting the complementary characteristics of the fMRI and MEG paradigms. fMRI results suggest 3 distinct roles: the supratemporal plane appears modulated by variations of sound location; the inferior parietal lobule is modulated by the cross-meridian effect; and the inferior frontal cortex is engaged by the inhibition of a motor response. MEG data help to elucidate the temporal dynamics of this network by providing high-resolution time series with which to measure latency of neural activation manipulated by the reorienting of attention.

Brain network for passive word listening as evaluated with ICA and Granger causality.

Brain network modeling is probably the biggest challenge in fMRI data analysis. Higher cognitive processes in fact, rely on complex dynamics of temporally and spatially segregated brain activities. A number of different techniques, mostly derived from paradigmatic hypothesis-driven methods, have been successfully applied for such purpose. This paper instead, presents a new data-driven analysis approach that applies both independent components analysis (ICA) and the Granger causality (GC). The method includes two steps: (1) ICA is used to extract the independent functional activities; (2) the GC is applied to the independent component (IC) most correlated with the stimuli, to indicate its functional relation with other ICs. This new method is applied to the analysis of fMRI study of listening to high-frequency trisyllabic words, non-words and reversed words. As expected, activity was found in the primary and secondary auditory cortices. Additionally, a parieto-frontal network of activations, supported by temporal and causality relationships, was found. This network is modulated by experimental conditions in agreement with the most recent models presented for word perception. The results have confirmed the validity of the proposed method, and seem promising for the detection of cognitive causal relationships in neuroimaging data.

Cross-modal plasticity of the motor cortex while listening to a rehearsed musical piece.

Learning a musical piece requires the development of a strong linkage between sensory and motor representations. Audition plays a central role and a tight cortical auditory-motor corepresentation is a characteristic feature of music processing. Recent works have indicated the establishment of a functional connection between auditory and motor cortices during the learning of a novel piece, although no causal relation has yet been demonstrated. Here transcranial magnetic stimulation of the cortical motor representation involved in musical performance was used to test excitability changes in piano players during auditory presentation of a rehearsed and a non-rehearsed piece. Results showed an increased motor excitability for the rehearsed but not for the non-rehearsed piece. Moreover, we observed an increase of excitability over time as intracortical facilitation was already present after 30 min of training whereas cortico-spinal facilitation increased after a longer training period (5 days).

"What" versus "where" in the audiovisual domain: an fMRI study.

Similar "what/where" functional segregations have been proposed for both visual and auditory cortical processing. In this fMRI study, we investigated if the same segregation exists in the crossmodal domain, when visual and auditory stimuli have to be matched in order to perform either a recognition or a localization task. Recent neuroimaging research highlighted the contribution of different heteromodal cortical regions during various forms of crossmodal binding. Interestingly, crossmodal effects during audiovisual speech and object recognition have been found in the superior temporal sulcus, while crossmodal effects during the execution of spatial tasks have been found over the intraparietal sulcus, suggesting an underlying "what/where" segregation. In order to directly compare the specific involvement of these two heteromodal regions, we scanned ten male right-handed subjects during the execution of two crossmodal matching tasks. Participants were simultaneously presented with a picture and an environmental sound, coming from either the same or the opposite hemifield and representing either the same or a different object. The two tasks required a manual YES/NO response respectively about location or semantic matching of the presented stimuli. Both group and individual subject analysis were performed. Task-related differences in BOLD response were observed in the right intraparietal sulcus and in the left superior temporal sulcus, providing a direct confirmation of the "what-where" functional segregation in the crossmodal audiovisual domain.

Human brain activation during passive listening to sounds from different locations: an fMRI and MEG study.

Recent animal and human studies indicate the existence of a neural pathway for sound localization, which is similar to the "where" pathway of the visual system and distinct from the sound identification pathway. This study sought to highlight this pathway using a passive listening protocol. We employed fMRI to study cortical areas, activated during the processing of sounds coming from different locations, and MEG to disclose the temporal dynamics of these areas. In addition, the hypothesis of different activation levels in the right and in the left hemispheres, due to hemispheric specialization of the human brain, was investigated. The fMRI results indicate that the processing of sound, coming from different locations, activates a complex neuronal circuit, similar to the sound localization system described in monkeys known as the auditory "where" pathway. This system includes Heschl's gyrus, the superior temporal gyrus, the supramarginal gyrus, and the inferior and middle frontal lobe. The MEG analysis allowed assessment of the timing of this circuit: the activation of Heschl's gyrus was observed 139 ms after the auditory stimulus, the peak latency of the source located in the superior temporal gyrus was at 156 ms, and the inferior parietal lobule and the supramarginal gyrus peaked at 162 ms. Both hemispheres were found to be involved in the processing of sounds coming from different locations, but a stronger activation was observed in the right hemisphere.