Multisensory perception constrains the formation of object categories: a review of evidence from sensory-driven and predictive processes on categorical decisions.

Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Longitudinal grip strength is associated with susceptibility to the Sound Induced Flash Illusion in older adults.

The precision of temporal multisensory integration is associated with specific aspects of physical functioning in ageing, including gait speed and incidents of falling. However, it is unknown if such an association exists between multisensory integration and grip strength, an important index of frailty and brain health and predictor of disease and mortality in older adults. Here, we investigated whether temporal multisensory integration is associated with longitudinal (eight-year) grip strength trajectories in a large sample of 2,061 older adults (mean age = 64.42 years, SD = 7.20; 52% female) drawn from The Irish Longitudinal Study on Ageing (TILDA). Grip strength (kg) for the dominant hand was assessed with a hand-held dynamometer across four testing waves. Longitudinal k-means clustering was applied to these data separately for sex (male, female) and age group (50-64, 65-74, 75+ years). At wave 3, older adults participated in the Sound Induced Flash Illusion (SIFI), a measure of the precision of temporal audio-visual integration, which included three audio-visual stimulus onset asynchronies (SOAs): 70, 150 and 230 ms. Results showed that older adults with a relatively lower (i.e., weaker) grip strength were more susceptible to the SIFI at the longer SOAs compared to those with a relatively higher (i.e., stronger) grip strength (p <.001). These novel findings suggest that older adults with relatively weaker grip strength exhibit an expanded temporal binding window for audio-visual events, possibly reflecting a reduction in the integrity of the central nervous system.

Older adults with slow sit to stand times show reduced temporal precision of audio-visual integration.

Sustained integration of sensory inputs over increased temporal delays is associated with reduced cognitive and physical functioning in older adults and adverse outcomes such as falls. Here, we explored the relationship between multisensory integration and a clinically relevant measure of balance/postural control; Sit-to-Stand Time, the efficiency with which an older adult can transition between a seated and a standing posture. We investigated whether temporal multisensory integration was associated with performance on the Five-Times Sit-to-Stand Test (FTSST) in a large sample of 2556 older adults (mean age = 63.62 years, SD = 7.50; 55% female) drawn from The Irish Longitudinal Study on Ageing (TILDA). K-means clustering was applied to FTSST data, yielding three clusters characterised by fast (mean = 10.88 s; n = 1122), medium (mean = 14.34 s; n = 1133) and slow (mean = 18.97 s; n = 301) sit-to-stand times. At wave 3 of TILDA, older adults participated in the Sound Induced Flash Illusion (SIFI), a measure of the precision of temporal audio-visual integration, which included three audio-visual stimulus onset asynchronies (SOAs): 70, 150 and 230 ms. Older adults with the slowest sit-to-stand times were more susceptible to the SIFI at the longest SOA (230 ms) compared to the shortest SOA (70 ms) relative to those with the fastest times (p = 0.02). Older adults who take longer to repeatedly transition from a seated to a standing posture exhibit an expanded temporal binding window for audio-visual events, supporting a link between multisensory perception and balance/postural control in ageing.

Self-reported vividness of tactile imagery for object properties and body regions: An exploratory study.

Mental imagery ability has been examined principally in the visual domain. Despite evidence for tactile mental representations in the absence of direct stimulation, this ability is poorly understood. We investigated tactile imagery for both active and passive tasks in a large sample (N = 118). Vividness of imagery was tested across two different tasks: somatosensory imagery (of body sensitivity) and tactile imagery (of object properties) in all participants. Evidence for vivid imagery across tactile and somatosensory dimensions was found with a positive, albeit weak, correlation in imagery strength between dimensions. Imagery ratings varied across objects and object properties in the tactile imagery task and across body sites in the somatosensory imagery task. These findings shed light on the capacity for, and characteristics of, tactile mental imagery in the general population and suggest that the ability to experience vivid tactile mental images may mediate performance across a number of perceptual tasks.

The rubber hand illusion is influenced by self-recognition.

Susceptibility to the Rubber Hand Illusion (RHI) demonstrates that body ownership can be modulated by visuotactile inputs. In contrast to body-like images, other objects cannot be embodied suggesting that crossmodal interactions on body ownership are based on a 'goodness-of-fit' mechanism relative to one's own body. However, it is not clear whether visual self-recognition influences susceptibility to the RHI, although evidence for individual differences in the perceptual body image on the RHI suggests that this may be the case. We investigated the role of self-recognition on the subjective experience of the RHI and measured proprioceptive drift and onset time of the RHI between two groups, one with the ability to identify an image of their own hand and the other without this ability. A typical RHI response was found overall with no group difference in the subjective experience of the RHI. However, a larger proprioceptive drift and an earlier onset time for the RHI was found for the non-recognisers than the self-recognition group. Our findings provide evidence for a link between a visual representation of one's own body in long-term memory and plasticity of the body representation.

Control of cardiac-specific transcription by p300 through myocyte enhancer factor-2D.

The transcriptional integrator p300 regulates gene expression by interaction with sequence-specific DNA-binding proteins and local remodeling of chromatin. p300 is required for cardiac-specific gene transcription, but the molecular basis of this requirement is unknown. Here we report that the MADS (MCM-1, agamous, deficiens, serum response factor) box transcription factor myocyte enhancer factor-2D (MEF-2D) acts as the principal conduit for cardiac transcriptional activation by p300. p300 activation of the native 2130-base pair human skeletal alpha-actin promoter required a single hybrid MEF-2/GATA-4 DNA motif centered at -1256 base pairs. Maximal expression of the promoter in cultured myocytes and in vivo correlated with binding of both MEF-2 and p300, but not GATA-4, to this AT-rich motif. p300 and MEF-2 were coprecipitated from cardiac nuclear extracts by an oligomer containing this element. p300 was found exclusively in a complex with MEF-2D at this and related sites in other cardiac-restricted promoters. MEF-2D, but not other MEFs, significantly potentiated cardiac-specific transcription by p300. No physical or functional interaction was observed between p300 and other factors implicated in skeletal actin transcription, including GATA-4, TEF-1, or SRF. These results show that, in the intact cell, p300 interactions with its protein targets are highly selective and that MEF-2D is the preferred channel for p300-mediated transcriptional control in the heart.