Sensory augmentation for a rapid motor task in a multisensory environment.

BACKGROUND: Sensory substitution and augmentation systems (SSASy) seek to either replace or enhance existing sensory skills by providing a new route to access information about the world. Tests of such systems have largely been limited to untimed, unisensory tasks. OBJECTIVE: To test the use of a SSASy for rapid, ballistic motor actions in a multisensory environment. METHODS: Participants played a stripped-down version of air hockey in virtual reality with motion controls (Oculus Touch). They were trained to use a simple SASSy (novel audio cue) for the puck's location. They were tested on ability to strike an oncoming puck with the SASSy, degraded vision, or both. RESULTS: Participants coordinated vision and the SSASy to strike the target with their hand more consistently than with the best single cue alone, t(13) = 9.16, p <.001, Cohen's d = 2.448. CONCLUSIONS: People can adapt flexibly to using a SSASy in tasks that require tightly timed, precise, and rapid body movements. SSASys can augment and coordinate with existing sensorimotor skills rather than being limited to replacement use cases - in particular, there is potential scope for treating moderate vision loss. These findings point to the potential for augmenting human abilities, not only for static perceptual judgments, but in rapid and demanding perceptual-motor tasks.

Multisensory perception and decision-making with a new sensory skill.

It is clear that people can learn a new sensory skill-a new way of mapping sensory inputs onto world states. It remains unclear how flexibly a new sensory skill can become embedded in multisensory perception and decision-making. To address this, we trained typically sighted participants (N = 12) to use a new echo-like auditory cue to distance in a virtual world, together with a noisy visual cue. Using model-based analyses, we tested for key markers of efficient multisensory perception and decision-making with the new skill. We found that 12 of 14 participants learned to judge distance using the novel auditory cue. Their use of this new sensory skill showed three key features: (a) It enhanced the speed of timed decisions; (b) it largely resisted interference from a simultaneous digit span task; and (c) it integrated with vision in a Bayes-like manner to improve precision. We also show some limits following this relatively short training: Precision benefits were lower than the Bayes-optimal prediction, and there was no forced fusion of signals. We conclude that people already embed new sensory skills in flexible multisensory perception and decision-making after a short training period. A key application of these insights is to the development of sensory augmentation systems that can enhance human perceptual abilities in novel ways. The limitations we reveal (sub-optimality, lack of fusion) provide a foundation for further investigations of the limits of these abilities and their brain basis. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Newly learned shape-color associations show signatures of reliability-weighted averaging without forced fusion or a memory color effect.

Reliability-weighted averaging of multiple perceptual estimates (or cues) can improve precision. Research suggests that newly learned statistical associations can be rapidly integrated in this way for efficient decision-making. Yet, it remains unclear if the integration of newly learned statistics into decision-making can directly influence perception, rather than taking place only at the decision stage. In two experiments, we implicitly taught observers novel associations between shape and color. Observers made color matches by adjusting the color of an oval to match a simultaneously presented reference. As the color of the oval changed across trials, so did its shape according to a novel mapping of axis ratio to color. Observers showed signatures of reliability-weighted averaging-a precision improvement in both experiments and reweighting of the newly learned shape cue with changes in uncertainty in Experiment 2. To ask whether this was accompanied by perceptual effects, Experiment 1 tested for forced fusion by measuring color discrimination thresholds with and without incongruent novel cues. Experiment 2 tested for a memory color effect, observers adjusting the color of ovals with different axis ratios until they appeared gray. There was no evidence for forced fusion and the opposite of a memory color effect. Overall, our results suggest that the ability to quickly learn novel cues and integrate them with familiar cues is not immediately (within the short duration of our experiments and in the domain of color and shape) accompanied by common perceptual effects.

Internal biases are linked to disrupted cue combination in children and adults.

Cue combination describes the use of two sensory cues together to increase perceptual precision. Internal relative bias describes a situation in which two cues to the same state of the world are perceived as signaling different states of the world on average. Current theory and evidence have difficulty accounting for many instances where cue combination is absent, such as in children under 10 years old, and in a variety of tasks. Here we show that internal relative biases between cues could be a key explanatory factor. Experiment 1, studying children's three-dimensional (slant) perception via disparity and texture, found a negative cross-sectional correlation between internal relative bias and cue combination behavior in 7- to 10-year-olds. Strikingly, children who had below-median levels of internal relative bias were able to combine cues, unlike the typical result for that age range. Experiment 2, studying adults' visual-auditory localization, found that cue combination behavior increased after an intervention designed to decrease internal relative bias. We interpret this as strong but preliminary evidence that internal relative bias can disrupt cue combination behavior. This provides a plausible mechanism to explain why children under 10 generally do not combine cues and why the audiovisual cue combination is so inconsistent in adults. Moving forward, we suggest that researchers who fail to find an expected cue combination effect should further investigate the possibility of issues with internal relative bias. Decreasing internal relative bias may also be an important goal for rehabilitation and sensory substitution or augmentation approaches to promoting efficient multisensory perception.

Functional Imaging of Audio-Visual Selective Attention in Monkeys and Humans: How do Lapses in Monkey Performance Affect Cross-Species Correspondences?

The cross-species correspondences and differences in how attention modulates brain responses in humans and animal models are poorly understood. We trained 2 monkeys to perform an audio-visual selective attention task during functional magnetic resonance imaging (fMRI), rewarding them to attend to stimuli in one modality while ignoring those in the other. Monkey fMRI identified regions strongly modulated by auditory or visual attention. Surprisingly, auditory attention-related modulations were much more restricted in monkeys than humans performing the same tasks during fMRI. Further analyses ruled out trivial explanations, suggesting that labile selective-attention performance was associated with inhomogeneous modulations in wide cortical regions in the monkeys. The findings provide initial insights into how audio-visual selective attention modulates the primate brain, identify sources for "lost" attention effects in monkeys, and carry implications for modeling the neurobiology of human cognition with nonhuman animals.

Individually customisable non-invasive head immobilisation system for non-human primates with an option for voluntary engagement.

BACKGROUND: Head immobilisation is often necessary for neuroscientific procedures. A number of Non-invasive Head Immobilisation Systems (NHIS) for monkeys are available, but the need remains for a feasible integrated system combining a broad range of essential features. NEW METHOD: We developed an individualised macaque NHIS addressing several animal welfare and scientific needs. The system comprises a customised-to-fit facemask that can be used separately or combined with a back piece to form a full-head helmet. The system permits presentation of visual and auditory stimuli during immobilisation and provides mouth access for reward. RESULTS: The facemask was incorporated into an automated voluntary training system, allowing the animals to engage with it for increasing periods leading to full head immobilisation. We evaluated the system during performance on several auditory or visual behavioural tasks with testing sessions lasting 1.5-2h, used thermal imaging to monitor for and prevent pressure points, and measured head movement using MRI. COMPARISON WITH EXISTING METHODS: A comprehensive evaluation of the system is provided in relation to several scientific and animal welfare requirements. Behavioural results were often comparable to those obtained with surgical implants. Cost-benefit analyses were conducted comparing the system with surgical options, highlighting the benefits of implementing the non-invasive option. CONCLUSIONS: The system has a number of potential applications and could be an important tool in neuroscientific research, when direct access to the brain for neuronal recordings is not required, offering the opportunity to conduct non-invasive experiments while improving animal welfare and reducing reliance on surgically implanted head posts.

Auditory artificial grammar learning in macaque and marmoset monkeys.

Artificial grammars (AG) are designed to emulate aspects of the structure of language, and AG learning (AGL) paradigms can be used to study the extent of nonhuman animals' structure-learning capabilities. However, different AG structures have been used with nonhuman animals and are difficult to compare across studies and species. We developed a simple quantitative parameter space, which we used to summarize previous nonhuman animal AGL results. This was used to highlight an under-studied AG with a forward-branching structure, designed to model certain aspects of the nondeterministic nature of word transitions in natural language and animal song. We tested whether two monkey species could learn aspects of this auditory AG. After habituating the monkeys to the AG, analysis of video recordings showed that common marmosets (New World monkeys) differentiated between well formed, correct testing sequences and those violating the AG structure based primarily on simple learning strategies. By comparison, Rhesus macaques (Old World monkeys) showed evidence for deeper levels of AGL. A novel eye-tracking approach confirmed this result in the macaques and demonstrated evidence for more complex AGL. This study provides evidence for a previously unknown level of AGL complexity in Old World monkeys that seems less evident in New World monkeys, which are more distant evolutionary relatives to humans. The findings allow for the development of both marmosets and macaques as neurobiological model systems to study different aspects of AGL at the neuronal level.

Assessing the potential for rhizoremediation of PCB contaminated soils in northern regions using native tree species.

Rhizosphere bioremediation of polychlorinated biphenyls (PCBs) offers a potentially inexpensive approach to remediating contaminated soils that is particularly attractive in remote regions including the Arctic. We assessed the abilities of two tree species native to Alaska, Salix alaxensis (felt-leaf willow) and Picea glauca (white spruce), to promote microbial biodegradation of PCBs via the release of phytochemicals upon fine root death. Crushed fine roots, biphenyl (PCB analogue) or salicylate (willow secondary compound) were added to microcosms containing soil spiked with PCBs and resultant PCB disappearance, soil toxicity and microbial community changes were examined. After 180d, soil treated with willow root crushates showed a significantly greater PCB loss than untreated soils for some PCB congeners, including the toxic congeners, PCB 77, 105 and 169, and showed a similar PCB loss pattern (in both extent of degradation and congeners degraded) to biphenyl-treated microcosms. Neither P. glauca (white spruce) roots nor salicylate enhanced PCB loss, indicating that biostimulation is plant species specific and was not mediated by salicylate. Soil toxicity assessed using the Microtox bioassay indicated that the willow treatment resulted in a less toxic soil environment. Molecular microbial community analyses indicated that biphenyl and salicylate promoted shifts in microbial community structure and composition that differed distinctly from each other and from the crushed root treatments. The biphenyl utilizing bacterium, Cupriavidus spp. was isolated from the soil. The findings suggest that S. alaxensis may be an effective plant for rhizoremediation by altering microbial community structure, enhancing the loss of some PCB congeners and reducing the toxicity of the soil environment.