Cross-Modal Interaction and Integration Through Stimulus-Specific Adaptation in the Thalamic Reticular Nucleus of Rats / 神经科学通报·英文版

Stimulus-specific adaptation (SSA), defined as a decrease in responses to a common stimulus that only partially generalizes to other rare stimuli, is a widespread phenomenon in the brain that is believed to be related to novelty detection. Although cross-modal sensory processing is also a widespread phenomenon, the interaction between the two phenomena is not well understood. In this study, the thalamic reticular nucleus (TRN), which is regarded as a hub of the attentional system that contains multi-modal neurons, was investigated. The results showed that SSA existed in an interactive oddball stimulation, which mimics stimulation changes from one modality to another. In the bimodal integration, SSA to bimodal stimulation was stronger than to visual stimulation alone but similar to auditory stimulation alone, which indicated a limited integrative effect. Collectively, the present results provide evidence for independent cross-modal processing in bimodal TRN neurons.

Research progress of MR imaging for prediction of CT imaging / 中国辐射卫生

Medical images can provide clinicans with accurate and comprehensive patients’ information. Morphological or functional abnormalities caused by various diseases can be manifested in many aspects. Although MR images and CT images can highlight the medical image data of different tissue structures of patients, single MR images or CT images cannot fully reflect the complexity of diseases. Using MR image to predict CT image is one of the cross-modal prediction of medical images. In this paper, the methods of MR image prediction for CTmage are classified into four categoriesincluding registration based on atlas, based on image segmentationmethod, based on learning method and based on deep learning method. In our research, we concluded that the method based on deep learning should bemore promoted in the future by compering the existing problems and future development of MR image predicting CT image method.

Cross-modal retrieval method for thyroid ultrasound image and text based on generative adversarial network / 生物医学工程学杂志

Ultrasonic examination is a common method in thyroid examination, and the results are mainly composed of thyroid ultrasound images and text reports. Implementation of cross modal retrieval method of images and text reports can provide great convenience for doctors and patients, but currently there is no retrieval method to correlate thyroid ultrasound images with text reports. This paper proposes a cross-modal method based on the deep learning and improved cross-modal generative adversarial network: ①the weight sharing constraints between the fully connection layers used to construct the public representation space in the original network are changed to cosine similarity constraints, so that the network can better learn the common representation of different modal data; ②the fully connection layer is added before the cross-modal discriminator to merge the full connection layer of image and text in the original network with weight sharing. Semantic regularization is realized on the basis of inheriting the advantages of the original network weight sharing. The experimental results show that the mean average precision of cross modal retrieval method for thyroid ultrasound image and text report in this paper can reach 0.508, which is significantly higher than the traditional cross-modal method, providing a new method for cross-modal retrieval of thyroid ultrasound image and text report.

Synesthesia and music perception / Sinestesia e percepção musical

The present review examined the cross-modal association of sensations and their relationship to musical perception. Initially, the study focuses on synesthesia, its definition, incidence, forms, and genetic and developmentalfactors. The theories of the neural basis of synesthesia were also addressed by comparing theories emphasizing the anatomical aspect against others reinforcing the importance of physiological processes. Secondly, cross-modal sensory associations, their role in perception, and relationship to synesthesia were analyzed. We propose the existence of a lower, unconscious degree of synesthesia in non-synesthetes. This latent synesthesia (without explicit sensory manifestations) would be functional, aiding the construction of abstract associations between different perceptual s. Musical meaningmight be constructed largely by synesthetic processes, where the sensory associations from sound activate memories, images, and emotions.

No presente trabalho de revisão, investigamos o cruzamento de sensações e sua relação com a percepção musical. Inicialmente, nos debruçamos sobre o estudos da sinestesia, sua definição, incidência, formas, fatores genéticos e de desenvolvimento. Abordamos ainda as teorias sobre as bases neurais da sinestesia, comparando teorias que enfatizam os aspectos anatômicos a outras que reforçam a importância de processos fisiológicos. Numa segunda seção tratamos dos cruzamentos de modos sensoriais, seu papel na percepção e sua relação com a sinestesia. Cogitamos haver um grau desinestesia mais baixo e inconsciente em não sinestetas, esta sinestesia latente (sem manifestações sensoriais explícitas) seria funcional, auxiliando na construção de associações abstratas entre campos perceptivos diferentes. A significação musical talvez seja construída, em grande parte, por processos sinestésicos, em que as associações sensoriais a partir do sonoro ativam memórias, imagens e emoções.