Multisensory perception constrains the formation of object categories: a review of evidence from sensory-driven and predictive processes on categorical decisions.

Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Longitudinal grip strength is associated with susceptibility to the Sound Induced Flash Illusion in older adults.

The precision of temporal multisensory integration is associated with specific aspects of physical functioning in ageing, including gait speed and incidents of falling. However, it is unknown if such an association exists between multisensory integration and grip strength, an important index of frailty and brain health and predictor of disease and mortality in older adults. Here, we investigated whether temporal multisensory integration is associated with longitudinal (eight-year) grip strength trajectories in a large sample of 2,061 older adults (mean age = 64.42 years, SD = 7.20; 52% female) drawn from The Irish Longitudinal Study on Ageing (TILDA). Grip strength (kg) for the dominant hand was assessed with a hand-held dynamometer across four testing waves. Longitudinal k-means clustering was applied to these data separately for sex (male, female) and age group (50-64, 65-74, 75+ years). At wave 3, older adults participated in the Sound Induced Flash Illusion (SIFI), a measure of the precision of temporal audio-visual integration, which included three audio-visual stimulus onset asynchronies (SOAs): 70, 150 and 230 ms. Results showed that older adults with a relatively lower (i.e., weaker) grip strength were more susceptible to the SIFI at the longer SOAs compared to those with a relatively higher (i.e., stronger) grip strength (p <.001). These novel findings suggest that older adults with relatively weaker grip strength exhibit an expanded temporal binding window for audio-visual events, possibly reflecting a reduction in the integrity of the central nervous system.

Older adults with slow sit to stand times show reduced temporal precision of audio-visual integration.

Sustained integration of sensory inputs over increased temporal delays is associated with reduced cognitive and physical functioning in older adults and adverse outcomes such as falls. Here, we explored the relationship between multisensory integration and a clinically relevant measure of balance/postural control; Sit-to-Stand Time, the efficiency with which an older adult can transition between a seated and a standing posture. We investigated whether temporal multisensory integration was associated with performance on the Five-Times Sit-to-Stand Test (FTSST) in a large sample of 2556 older adults (mean age = 63.62 years, SD = 7.50; 55% female) drawn from The Irish Longitudinal Study on Ageing (TILDA). K-means clustering was applied to FTSST data, yielding three clusters characterised by fast (mean = 10.88 s; n = 1122), medium (mean = 14.34 s; n = 1133) and slow (mean = 18.97 s; n = 301) sit-to-stand times. At wave 3 of TILDA, older adults participated in the Sound Induced Flash Illusion (SIFI), a measure of the precision of temporal audio-visual integration, which included three audio-visual stimulus onset asynchronies (SOAs): 70, 150 and 230 ms. Older adults with the slowest sit-to-stand times were more susceptible to the SIFI at the longest SOA (230 ms) compared to the shortest SOA (70 ms) relative to those with the fastest times (p = 0.02). Older adults who take longer to repeatedly transition from a seated to a standing posture exhibit an expanded temporal binding window for audio-visual events, supporting a link between multisensory perception and balance/postural control in ageing.