Role of line junctions in expert object recognition: The case of musical notation.

Line junctions are well-known to be important for real-world object recognition, and sensitivity to line junctions is enhanced with perceptual experience with an object category. However, it remains unclear whether these very simple visual features are involved in expert object representations at the neural level, and if yes, at what level(s) they are involved. In this EEG study, 31 music reading experts and 31 novices performed a one-back task with intact musical notation, musical notation with line junctions removed and pseudo-letters. We observed more separable neural representations of musical notation from pseudo-letter for experts than for novices when line junctions were present and during 180-280 ms after stimulus onset. Also, the presence of line junctions was better decoded in experts than in novices during 320-580 ms, and the decoding accuracy in this time window predicted the behavioral recognition advantage of musical notation when line junctions were present. These suggest that, with perceptual expertise, line junctions are more involved in category selective representation of objects, and are more explicitly represented in later stages of processing to support expert recognition performance.

Are there associations between daily multitasking experience and multitasking performance?

Research showed mixed findings regarding the relationships between daily multitasking experience and laboratory multitasking performance. One measurement issue was the low reliability and validity of using a single measurement for daily multitasking experience. Another measurement issue was the popular use of simple laboratory paradigms that may or may not capture well cognitive processes underlying real-life multitasking. The current study revisited the relationship between daily multitasking experience and multitasking performance with a better design. Multiple measurements were used to ensure good reliability and validity. This included a mobile phone task switching measurement-an arguably better proxy for daily multitasking experience and three realistic multitasking paradigms that mimic real life multitasking situations. The results showed that (1) phone switching was not significantly associated with the media multitasking index, suggesting that they were measuring different aspects of multitasking experience; (2) indicators of the multitasking performance were moderately correlated among themselves, suggesting that different realistic multitasking paradigms were measuring overlapping multitasking abilities; and, intriguingly, (3) no significant association between multitasking experience and performance indicators was found. One possibility is that people can only benefit from daily multitasking practice when they engaged in daily multitasking activities with an intention to improve the performance. Other possibilities and implications were also discussed.

An early perceptual locus of absolute pitch.

Absolute pitch (AP) refers to the naming of musical tone without external reference. The influential two-component model states that AP is limited by the late-emerging pitch labeling process only and not the earlier perceptual and memory processes. Over the years, however, support for this model at the neural level has been mixed with various methodological limitations. Here, the electroencephalography responses of 27 AP possessors and 27 non-AP possessors were recorded. During both name verification and passive listening, event-related potential analyses showed a difference between AP and non-AP possessors at about 200 ms in their response toward tones compared with noise stimuli. Multivariate pattern analyses suggested that pitch naming was subserved by a series of transient processes for the first 250 ms, followed by a stage-like process for both AP and non-AP possessors with no group differences between them. These findings are inconsistent with the predictions of the two-component model, and instead suggest the existence of an early perceptual locus of AP.

Visual and visual association abilities predict skilled reading performance: The case of music sight-reading.

The role of visual shape processing in skilled reading is an understudied topic. This study focused on the role of visual and visual association skills in a type of skilled reading, music sight-reading, which refers to the ability to play a piece of music when one reads the score for the first time. One hundred and 43 intermediate-to-advanced musicians were assessed on their sight-reading performance as well as visual fluency for notes, general visual fluency, motor dexterity, visual-auditory association for notes, visual-motor association for numbers, working memory capacity, and executive function. Correlation and regression analyses showed that sight-reading performance can be largely explained by three abilities related to vision, including visual fluency for notes, visual-auditory association for notes, and visual-motor association for numbers (9.99, 10.11, and 4.62% respectively). The findings led to a better understanding of music sight-reading that takes into account the long-overlooked association between visual shape processing ability and sight-reading, which has clear educational implications. The importance of visual shape processing ability may also apply to other domains of skilled reading requiring visual perceptual extraction of visual codes, such as word reading. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The effect of task on object processing revealed by EEG decoding.

Recent studies showed that task demand affects object representations in higher-level visual areas and beyond but not so much in earlier areas. There are, however, limitations in those studies including the relatively weak manipulation of task due to the use of familiar real-life objects, the low temporal resolution in functional magnetic resonance imaging (fMRI) and the emphasis on the amount and not the source of information carried by brain activations. In the current study, observers categorised images of artificial objects in one of two orthogonal dimensions, shape and texture, while their brain activity was recorded with electroencephalogram (EEG). Results showed that object processing along the texture dimension was affected by task demand starting from a relatively late time (320- to 370-ms time window) after image onset. The findings are consistent with the view that task exerts an effect on the later phases of object processing.

Perceptual expertise with Chinese characters predicts Chinese reading performance among Hong Kong Chinese children with developmental dyslexia.

This study explores the theoretical proposal that developmental dyslexia involves a failure to develop perceptual expertise with words despite adequate education. Among a group of Hong Kong Chinese children diagnosed with developmental dyslexia, we investigated the relationship between Chinese word reading and perceptual expertise with Chinese characters. In a perceptual fluency task, the time of visual exposure to Chinese characters was manipulated and limited such that the speed of discrimination of a short sequence of Chinese characters at an accuracy level of 80% was estimated. Pair-wise correlations showed that perceptual fluency for characters predicted speeded and non-speeded word reading performance. Exploratory hierarchical regressions showed that perceptual fluency for characters accounted for 5.3% and 9.6% variance in speeded and non-speeded reading respectively, in addition to age, non-verbal IQ, phonological awareness, morphological awareness, rapid automatized naming (RAN) and perceptual fluency for digits. The findings suggest that perceptual expertise with words plays an important role in Chinese reading performance in developmental dyslexia, and that perceptual training is a potential remediation direction.

A reliable and valid tool for measuring visual recognition ability with musical notation.

Recognizing musical notation is an important skill to a full participation of Western classical music, but remains a largely under-researched topic in the psychology of music. One plausible reason of such omission is that, in the past, the research field has heavily relied on self-report of music reading ability, which was subjective and highly variable. This paper presents a reliable and valid tool for objectively measuring individual abilities in visual recognition of musical notation. The visual fluency task measures how fast one can accurately recognize a sequence of musical notation at a desired accuracy level using the adaptive psychometric method QUEST. We checked the reliability of this task in over 200 participants in terms of Guttman's λ-2 and Cronbach's alpha. Also, we evaluated the construct validity of this task by considering the convergent validity of this task with multiple external real-world measures of one's musical training background, with numerous experimental measures of visual tendencies of musical notation recognition and with sight-reading performance. Overall, the visual fluency task achieved satisfactory reliability and validity for measuring abilities in recognizing musical notation. This opens the door for characterizing the cognitive mechanisms, development, and individual differences in musical notation recognition, for understanding music learning and music psychology and for understanding of visual perceptual expertise in general.

Absolute pitch learning in adults speaking non-tonal languages.

Absolute pitch (AP) refers to labelling individual pitches in the absence of external reference. A widely endorsed theory regards AP as a privileged ability enjoyed by selected few with rare genetic makeup and musical training starting in early childhood. However, recent evidence showed that even adults can learn AP, and some can attain a performance level comparable to natural AP possessors. These training studies involved native tonal language speakers, whose acquisition of AP might be facilitated by tonal language exposure during early childhood. In this study, adults speaking non-tonal languages went through AP training that was 20-hr long, computerised and personalised. Performance on average improved, which was accompanied by enhanced working memory for tones, whereas relative pitch judgement and sensitivity to small pitch differences remained unchanged. Notably, two out of 13 learned to label all 12 pitches within an octave, with accuracy and response time comparable to natural AP possessors. Overall, the findings suggest that tonal language exposure is not a prerequisite for AP learning in adulthood. The understanding of the origin of AP would benefit from considering the role of lifelong learning instead of focusing only on early childhood experience.

Is it impossible to acquire absolute pitch in adulthood?

Absolute pitch (AP) refers to the rare ability to name the pitch of a tone without external reference. It is widely believed to be only for the selected few with rare genetic makeup and early musical training during the critical period, and therefore acquiring AP in adulthood is impossible. Previous studies have not offered a strong test of the effect of training because of issues like small sample size and insufficient training. In three experiments, adults learned to name pitches in a computerized, gamified and personalized training protocol for 12 to 40 hours, with the number of pitches gradually increased from three to twelve. Across the three experiments, the training covered different octaves, timbre, and training environment (inside or outside laboratory). AP learning showed classic characteristics of perceptual learning, including generalization of learning dependent on the training stimuli, and sustained improvement for at least one to three months. 14% of the participants (6 out of 43) were able to name twelve pitches at 90% or above accuracy, comparable to that of 'AP possessors' as defined in the literature. Overall, AP continues to be learnable in adulthood, which challenges the view that AP development requires both rare genetic predisposition and learning within the critical period. The finding calls for reconsideration of the role of learning in the occurrence of AP, and pushes the field to pinpoint and explain the differences, if any, between the aspects of AP more trainable in adulthood and the aspects of AP that are potentially exclusive for the few exceptional AP possessors observed in the real world.

Beauty and the beast: Promotion concerns and the pursuit of physically attractive mates.

OBJECTIVE: In the mating market, individuals differ in their aspirations to pursue opposite-sex mates who have a relatively higher (vs. similar) level of physical attractiveness. Few studies have explored how motivational concerns outside the mating domain can account for these individual differences in romantic aspiration. Based on regulatory focus theory, this research tested how broad concerns for promotion and prevention influence the aspiration and dating outcome. METHOD: Four studies tested whether promotion concerns increase romantic aspiration and the chance to mate with a more physically attractive partner. The first three studies tested how promotion concerns, either measured (Studies 1a and 2) or manipulated (Study 1b), can influence romantic aspiration. Study 3 further tested how one's chronic promotion concerns are related to the physical attractiveness of the current partner (as rated by observers). RESULTS: The first three studies supported the prediction that promotion concerns increase aspiration to pursue more physically attractive mates. The last study also found that, controlling for their own physical attractiveness, individuals with stronger promotion concerns tend to mate with physically attractive partners. CONCLUSIONS: The results highlight the significant roles of broad motivational concerns in determining both aspiration and chance to date a more physically attractive partner.

Visual training with musical notes changes late but not early electrophysiological responses in the visual cortex.

Visual expertise with musical notation is unique. Fluent music readers show selectively higher activity to musical notes than to other visually similar patterns in both the retinotopic and higher-level visual areas and both very early (e.g., C1) and later (e.g., N170) visual event-related potential (ERP) components. This is different from domains such as face and letter perception, of which the neural expertise marker is typically found in the higher-level ventral visual areas and later (e.g., N170) ERP components. An intriguing question concerns whether the visual skills and neural selectivity observed in music-reading experts are a result of the effects of extensive visual experience with musical notation. The current study aimed to investigate the causal relationship between visual experience and its neural changes with musical notation. Novices with no formal musical training experience were trained to visually discriminate between note patterns in the laboratory for 10-26 hr such that their performance was comparable with fluent music readers. The N170 component became more selective for musical notes after training. Training was not, however, followed by changes in the earlier C1 component. The findings show that visual training is enough for causing changes in the responses of the higher-level visual areas to musical notation while the engagement of the early visual areas may involve additional nonvisual factors.

Sensitivity to configural information and expertise in visual word recognition.

Holistic processing has been regarded as a marker of perceptual expertise for many object categories. However, visual word processing, a common form of perceptual expertise in the population, is traditionally considered part-based instead of holistic, and whether it involves holistic processing remains inconclusive. In 4 experiments, we examined a well-known yet less studied indicator of holistic word processing-observers' sensitivity to changes in configural information of objects. A paradigm was designed with 2 crucial elements: specific requirement to process configural information within a word and an inversion manipulation. Experiments 1 and 2 showed that experienced observers were more sensitive to configural changes when words were presented in the familiar upright than unfamiliar inverted orientation. Of importance, such an inversion effect was correlated with one's fluency in word recognition in 1 of the conditions (nonnative Chinese readers viewing Chinese characters) where there was a larger variability in word recognition fluency. Experiments 3 and 4 compared sensitivity to configural and component changes in word processing, showing that expert readers were more sensitive to configural changes than component changes (defined as line thickness of parts) in words. The current findings suggest that, similar to face recognition and other domains of perceptual expertise, word recognition involves holistic processing. Instead of being a hallmark of face recognition, holistic processing is a general expertise marker shared by different domains of perceptual expertise. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The role of line junctions in object recognition: The case of reading musical notation.

Previous work has shown that line junctions are informative features for visual perception of objects, letters, and words. However, the sources of such sensitivity and their generalizability to other object categories are largely unclear. We addressed these questions by studying perceptual expertise in reading musical notation, a domain in which individuals with different levels of expertise are readily available. We observed that removing line junctions created by the contact between musical notes and staff lines selectively impaired recognition performance in experts and intermediate readers, but not in novices. The degree of performance impairment was predicted by individual fluency in reading musical notation. Our findings suggest that line junctions provide diagnostic information about object identity across various categories, including musical notation. However, human sensitivity to line junctions does not readily transfer from familiar to unfamiliar object categories, and has to be acquired through perceptual experience with the specific objects.

Revisiting facial resemblance in couples.

It is widely believed that couples look alike. Consistently, previous research reported higher facial similarity for couples than non-couples, and that facial similarity predicts marital satisfaction. However, it is unclear if facial similarity in couples shown in previous studies was solely driven by extrinsic features like hairstyle, glasses, etc. Also unclear is what attributes are perceived as similar from the faces of a couple. In three experiments, we showed that faces were considered more similar in couples than non-couples even without extrinsic features. Personality and age perceived from faces were also more similar in couples. Importantly, by matching pairs of faces according to their perceived personality, we found that a higher similarity in the perceived personality of a face pair led to higher facial similarity and couple likelihood ratings. These findings suggest that, instead of a result of pure physical analyses, facial similarity in couples is partly based on active social cognitive judgments on perceived personality, which may reveal the actual personality of the couples and thus inform relationship quality.

Music-reading training alleviates crowding with musical notation.

Crowding refers to the disrupted recognition of an object by nearby distractors. Prior work has shown that real-world music-reading experts experience reduced crowding specifically for musical stimuli. However, it is unclear whether music-reading training reduced the magnitude of crowding or whether individuals showing less crowding are more likely to learn and excel in music reading later. To examine the first possibility, we tested whether crowding can be alleviated by music-reading training in the laboratory. Intermediate-level music readers completed 8 hr of music-reading training within 2 weeks. Their threshold duration for reading musical notes dropped by 44.1% after training to a level comparable with that of extant expert music readers. Importantly, crowding was reduced with musical stimuli but not with the nonmusical stimuli Landolt Cs. In sum, the reduced crowding for musical stimuli in expert music readers can be explained by music-reading training.

Perceptual expertise and top-down expectation of musical notation engages the primary visual cortex.

Most theories of visual processing propose that object recognition is achieved in higher visual cortex. However, we show that category selectivity for musical notation can be observed in the first ERP component called the C1 (measured 40-60 msec after stimulus onset) with music-reading expertise. Moreover, the C1 note selectivity was observed only when the stimulus category was blocked but not when the stimulus category was randomized. Under blocking, the C1 activity for notes predicted individual music-reading ability, and behavioral judgments of musical stimuli reflected music-reading skill. Our results challenge current theories of object recognition, indicating that the primary visual cortex can be selective for musical notation within the initial feedforward sweep of activity with perceptual expertise and with a testing context that is consistent with the expertise training, such as blocking the stimulus category for music reading.

Absolute pitch memory: its prevalence among musicians and dependence on the testing context.

Absolute pitch (AP) is widely believed to be a rare ability possessed by only a small group of gifted and special individuals (AP possessors). While AP has fascinated psychologists, neuroscientists, and musicians for more than a century, no theory can satisfactorily explain why this ability is so rare and difficult to learn. Here, we show that AP ability appears rare because of the methodological issues of the standard pitch-naming test. Specifically, the standard test unnecessarily poses a high decisional demand on AP judgments and uses a testing context that is highly inconsistent with one's musical training. These extra cognitive challenges are not central to AP memory per se and have thus led to consistent underestimation of AP ability in the population. Using the standard test, we replicated the typical findings that the accuracy for general violinists was low (12.38 %; chance level = 0 %). With identical stimuli, scoring criteria, and participants, violinists attained 25 % accuracy in a pitch verification test in which the decisional demand of AP judgment was reduced. When the testing context was increasingly similar to their musical experience, verification accuracy improved further and reached 39 %, three times higher than that for the standard test. Results were replicated with a separate group of pianists. Our findings challenge current theories about AP and suggest that the prevalence of AP among musicians has been highly underestimated in prior work. A multimodal framework is proposed to better explain AP memory.

Music-reading expertise alters visual spatial resolution for musical notation.

Crowding occurs when the perception of a suprathreshold target is impaired by nearby distractors, reflecting a fundamental limitation on visual spatial resolution. It is likely that crowding limits music reading, as each musical note is crowded by adjacent notes and by the five-line staff, similar to word reading, in which letter recognition is reduced by crowding from adjacent letters. Here, we tested the hypothesis that, with extensive experience, music-reading experts have acquired visual skills such that they experience a smaller crowding effect, resulting in higher music-reading fluency. Experts experienced a smaller crowding effect than did novices, but only for musical stimuli, not for control stimuli (Landolt Cs). The magnitude of the crowding effect for musical stimuli could be predicted by individual fluency in music reading. Our results highlight the role of experience in crowding: Visual spatial resolution can be improved specifically for objects associated with perceptual expertise. Music-reading rates are likely limited by crowding, and our results are consistent with the idea that experience alleviates these limitations.

Holistic processing of musical notation: Dissociating failures of selective attention in experts and novices.

Holistic processing (i.e., the tendency to process objects as wholes) is associated with face perception and also with expertise individuating novel objects. Surprisingly, recent work also reveals holistic effects in novice observers. It is unclear whether the same mechanisms support holistic effects in experts and in novices. In the present study, we measured holistic processing of music sequences using a selective attention task in participants who vary in music-reading expertise. We found that holistic effects were strategic in novices but were relatively automatic in experts. Correlational analyses revealed that individual holistic effects were predicted by both individual music-reading ability and neural responses for musical notation in the right fusiform face area (rFFA), but in opposite directions for experts and novices, suggesting that holistic effects in the two groups may be of different natures. To characterize expert perception, it is important not only to measure the tendency to process objects as wholes, but also to test whether this effect is dependent on task constraints.

A multimodal neural network recruited by expertise with musical notation.

Prior neuroimaging work on visual perceptual expertise has focused on changes in the visual system, ignoring possible effects of acquiring expert visual skills in nonvisual areas. We investigated expertise for reading musical notation, a skill likely to be associated with multimodal abilities. We compared brain activity in music-reading experts and novices during perception of musical notation, Roman letters, and mathematical symbols and found selectivity for musical notation for experts in a widespread multimodal network of areas. The activity in several of these areas was correlated with a behavioral measure of perceptual fluency with musical notation, suggesting that activity in nonvisual areas can predict individual differences in visual expertise. The visual selectivity for musical notation is distinct from that for faces, single Roman letters, and letter strings. Implications of the current findings to the study of visual perceptual expertise, music reading, and musical expertise are discussed.