Effects of wearing an opaque or transparent face mask on the perception of facial expressions: A comparative study between Japanese school-aged children and adults.

The negative side effects of mask-wearing on reading facial emotional cues have been investigated in several studies with adults post-2020. However, little is known about children. This study aimed to determine the negative influence of mask-wearing on reading emotions of adult faces by Japanese school-aged children, compared to Japanese adults. We also examined whether this negative influence could be alleviated by using a transparent face mask instead of an opaque one (surgical mask). The performance on reading emotions was measured using emotion categorization and emotion intensity rating tasks for adult faces. As per the findings, the accuracy of emotion recognition in children was impaired for various facial expressions (disgust, fear, happy, neutral, sad, and surprise faces), except for angry faces. Conversely, in adults, it was impaired for a few facial expressions. The perceived intensity for happy faces with a surgical mask was weaker in both children and adults than in those without the mask. A negative influence of wearing surgical masks was generally not observed for faces wearing a transparent mask in both children and adults. Thus, negative side effects of mask-wearing on reading emotions are observed for more facial expressions in children than in adults; transparent masks can help remedy these.

Prefrontal GABA and glutamate-glutamine levels affect sustained attention.

Attention levels fluctuate during the course of daily activities. However, factors underlying sustained attention are still unknown. We investigated mechanisms of sustained attention using psychological, neuroimaging, and neurochemical approaches. Participants were scanned with functional magnetic resonance imaging (fMRI) while performing gradual-onset, continuous performance tasks (gradCPTs). In gradCPTs, narrations or visual scenes gradually changed from one to the next. Participants pressed a button for frequent Go trials as quickly as possible and withheld responses to infrequent No-go trials. Performance was better for the visual gradCPT than for the auditory gradCPT, but the 2 were correlated. The dorsal attention network was activated during intermittent responses, regardless of sensory modality. Reaction-time variability of gradCPTs was correlated with signal changes (SCs) in the left fronto-parietal regions. We also used magnetic resonance spectroscopy (MRS) to measure levels of glutamate-glutamine (Glx) and γ-aminobutyric acid (GABA) in the left prefrontal cortex (PFC). Glx levels were associated with performance under undemanding situations, whereas GABA levels were related to performance under demanding situations. Combined fMRI-MRS results demonstrated that SCs of the left PFC were positively correlated with neurometabolite levels. These findings suggest that a neural balance between excitation and inhibition is involved in attentional fluctuations and brain dynamics.

Processing symmetry between visual and auditory spatial representations in updating working memory.

Updating spatial representations in visual and auditory working memory relies on common processes, and the modalities should compete for attentional resources. If competition occurs, one type of spatial information is presumably weighted over the other, irrespective of sensory modality. This study used incompatible spatial information conveyed from two different cue modalities to examine relative dominance in memory updating. Participants mentally manoeuvred a designated target in a matrix according to visual or auditory stimuli that were presented simultaneously, to identify a terminal location. Prior to the navigation task, the relative perceptual saliences of the visual cues were manipulated to be equal, superior, or inferior to the auditory cues. The results demonstrate that visual and auditory information competed for attentional resources, such that visual/auditory guidance was impaired by incongruent cues delivered from the other modality. Although visual bias was generally observed in working-memory navigation, stimuli of relatively high salience interfered with or facilitated other stimuli regardless of modality, demonstrating the processing symmetry of spatial updating in visual and auditory spatial working memory. Furthermore, this processing symmetry can be identified during the encoding of sensory inputs into working-memory representations. The results imply that auditory spatial updating is comparable to visual spatial updating in that salient stimuli receive a high priority when selecting inputs and are used when tracking spatial representations.

Effects of wearing a transparent face mask on perception of facial expressions.

Wearing face masks in public has become the norm in many countries post-2020. Although mask-wearing is effective in controlling infection, it has the negative side effect of occluding the mask wearer's facial expressions. The purpose of this study was to investigate the effects of wearing transparent masks on the perception of facial expressions. Participants were required to categorize the perceived facial emotion of female (Experiment 1) and male (Experiment 2) faces with different facial expressions and to rate the perceived emotion intensity of the faces. Based on the group, the participants were assigned to, the faces were presented with a surgical mask, a transparent mask, or without a mask. The results showed that wearing a surgical mask impaired the performance of reading facial expressions, both with respect to recognition and perceived intensity of facial emotions. Specifically, the impairments were robustly observed in fear and happy faces for emotion recognition, and in happy faces for perceived intensity of emotion in Experiments 1 and 2. However, the impairments were moderated by wearing a transparent mask instead of a surgical mask. During the coronavirus disease 2019 (COVID-19) pandemic, the transparent mask can be used in a range of situations where face-to-face communication is important.

Attentional biases toward real images and drawings of negative faces.

The allocation of attention is affected by internal emotional states, such as anxiety and depression. The attention captured by real images of negative faces can be quantified by emotional probe tasks. The present study investigated whether attentional bias toward drawings of negative faces (line drawings and cartoon faces) differs from that of real faces. Non-clinical university students indicated their levels of anxiety and depression via self-report questionnaires, and completed a probe discrimination task under three face image conditions in a between-participants design. Significant correlations were found between bias scores and scores on the self-reported BDI-II under the real face condition. However, two types of face drawings were only weakly correlated with self-report scores. In our probe task to investigate attentional bias to facial stimuli in nonclinical adults, the strength of the relationship between depression and attentional bias to negative face was stronger for real faces than for face drawings.

The Attractiveness of Masked Faces Is Influenced by Race and Mask Attitudes.

This study tests the influence of wearing a protective face mask on the perceived attractiveness of the wearer. Participants who identified as White, and who varied in their ideological stance toward mask wearing, rated the attractiveness of facial photographs. The photos varied in baseline attractiveness (low, medium, and high), race (White and Asian), and whether or not the face was wearing a protective mask. Attitudes regarding protective masks were measured after the rating task using a survey to identify participants as either pro- or anti-mask. The results showed that masked individuals of the same race were generally rated as more attractive than unmasked individuals, but that masked individuals of another race were rated as less attractive than unmasked individuals. Moreover, pro-mask participants rated masked individuals as generally more attractive than unmasked individuals, whereas anti-maskers rated masked individuals as less attractive. A control experiment, replicating the procedure but replacing the protective masks with a partially occluding notebook, showed that these effects were mask-specific. These results demonstrate that perceived attractiveness is affected by characteristics of the viewer (attitudes toward protective masks), their relationship to the target (same or different race), and by circumstances external to both (pandemic).

Dynamic Transitions Between Brain States Predict Auditory Attentional Fluctuations.

Achievement of task performance is required to maintain a constant level of attention. Attentional level fluctuates over the course of daily activities. However, brain dynamics leading to attentional fluctuation are still unknown. We investigated the underlying mechanisms of sustained attention using functional magnetic resonance imaging (fMRI). Participants were scanned with fMRI while performing an auditory, gradual-onset, continuous performance task (gradCPT). In this task, narrations gradually changed from one to the next. Participants pressed a button for frequent Go trials (i.e., male voices) as quickly as possible and withheld responses to infrequent No-go trials (i.e., female voices). Event-related analysis revealed that frontal and temporal areas, including the auditory cortex, were activated during successful and unsuccessful inhibition of predominant responses. Reaction-time (RT) variability throughout the auditory gradCPT was positively correlated with signal changes in regions of the dorsal attention network: superior frontal gyrus and superior parietal lobule. Energy landscape analysis showed that task-related activations could be clustered into different attractors: regions of the dorsal attention network and default mode network. The number of alternations between RT-stable and erratic periods increased with an increase in transitions between attractors in the brain. Therefore, we conclude that dynamic transitions between brain states are closely linked to auditory attentional fluctuations.

Auditory enhancement of visual searches for event scenes.

Increasing research has revealed that uninformative spatial sounds facilitate the early processing of visual stimuli. This study examined the crossmodal interactions of semantically congruent stimuli by assessing whether the presentation of event-related characteristic sounds facilitated or interfered with the visual search for corresponding event scenes in pictures. The search array consisted of four images: one target and three non-target pictures. Auditory stimuli were presented to participants in synchronization with picture onset using three types of sounds: a sound congruent with a target, a sound congruent with a distractor, or a control sound. The control sound varied across six experiments, alternating between a sound unrelated to the search stimuli, white noise, and no sound. Participants were required to swiftly localize a target position while ignoring the sound presentation. Visual localization resulted in rapid responses when a sound that was semantically related to the target was played. Furthermore, when a sound was semantically related to a distractor picture, the response times were longer. When the distractor-congruent sound was used, participants incorrectly localized the distractor position more often than at the chance level. These findings were replicated when the experiments ruled out the possibility that participants would learn picture-sound pairs during the visual tasks (i.e., the possibility of brief training during the experiments). Overall, event-related crossmodal interactions occur based on semantic representations, and audiovisual associations may develop as a result of long-term experiences rather than brief training in a laboratory.

Occlusion of faces by sanitary masks improves facial attractiveness of other races.

Recent studies provide mixed results regarding whether the perception of facial attractiveness is increased or decreased by partial occlusion with a sanitary mask. One set of studies demonstrated that occluding the bottom half of a face increased facial attractiveness. This effect is thought to occur because the occluded area is interpolated by an average facial representation that is perceived as attractive. However, several groups of studies showed that partial occlusion can increase or decrease perceived attractiveness depending on the attractiveness of the original (unoccluded) face, due to regression to the mean. To reconcile this inconsistency, we propose that the occluded area is interpolated not by an average facial representation, but by a template of moderate attractiveness, shaped by the distribution of each viewer's experience. This hypothesis predicts an interaction between occlusion and the attractiveness of the original face so that occluded attractive faces are rated as less attractive, while occluded unattractive faces are rated as more attractive. To examine this hypothesis, the present study used attractiveness-rating tasks with mask-free versus masked faces in own-race and other-races categories. Viewers were familiar with own-race faces and unfamiliar with other-races faces. If moderate-attractiveness interpolation were the explanatory factor, the interaction between the occlusion and the attractiveness of the original face should be found only in the rating of own-race faces. Consistent with this hypothesis, the interaction between the occlusion and the attractiveness of the original faces was significant only for the own-race faces. Specifically, wearing a sanitary mask decreased the facial attractiveness of attractive faces in the own-race, while it increased the attractiveness regardless of the level of facial attractiveness in other-races. These findings suggest that the occluded area of own-race faces is interpolated by a facial template of moderate attractiveness. The other-races template could be developed using familiar exemplars such as celebrities. Thus, interpolation by such a template should result in elevated attractiveness relative to that by an own-race template. Accordingly, the apparent inconsistency in the literature regarding the effect of partial occlusion on physical attractiveness can be explained in terms of differences in the template involving interpolation of the occluded area.

Beat Patterns Determine Inter-Hand Differences in Synchronization Error in a Bimanual Coordination Tapping Task.

A previous study reported the unique finding that people tapping a beat pattern with the right hand produce larger negative synchronization error than when tapping with the left hand or other effectors, in contrast to previous studies that have shown that the hands tap patterns simultaneously without any synchronization errors. We examined whether the inter-hand difference in synchronization error occurred due to handedness or to a specificity of the beat pattern employed in that study. Two experiments manipulated the hand-beat assignments. A comparison between the identical beat to the pacing signal and a beat with a longer interval excluded the handedness hypothesis and demonstrated that beat patterns with relatively shorter intervals were tapped earlier (Experiment 1). These synchronization errors were not local but occurred consistently throughout the beat patterns. Experiment 2 excluded alternative explanations. These results indicate that the apparent inconsistency in previous studies was due to the specificity of the beat patterns, suggesting that a beat pattern with a relatively shorter interval between hands is tapped earlier than beats with longer intervals. Our finding that the bimanual tapping of different beat patterns produced different synchronization errors suggests that the notion of a central timing system may need to be revised.

A label indicating an old year of establishment improves evaluations of restaurants and shops serving traditional foods.

This study examined whether the presence of product information focused on a past era (e.g., year of establishment) improved consumers' evaluations of a shop serving traditional products when the label and shop were congruent in terms of temporal focus. Across five experiments, participants viewed and evaluated advertisements from traditional food restaurants and shops that showed an old year of establishment. They showed favorable evaluations of the restaurants and food shops more frequently when a label focused on the past was displayed than when the label was absent or when a label focused on the present was displayed. Subsequent experiments indicated that this labeling effect was strongest when the label and shop were consistent in terms of traditional culture such that the year of establishment on the label showed the Japanese era name (Japan's traditional date format) and was accompanied by Japanese classic foods. Importantly, in this study, qualitative domains were consistently improved more often than were ratings of visit intention and expected taste. The results suggest that temporal congruence between the label and restaurants rated plays an essential role in ensuring that these advertisements are effective in improving positive evaluations.

Effects of Masks Worn to Protect Against COVID-19 on the Perception of Facial Attractiveness.

Wearing a sanitary mask tended, in the main, to reduce the wearer's sense of perceived facial attractiveness before the COVID-19 epidemic. This phenomenon, termed the sanitary-mask effect, was explained using a two-factor model involving the occlusion of cues used for the judgment of attractiveness and unhealthiness priming (e.g., presumed illness). However, these data were collected during the pre-COVID-19 period. Thus, in this study, we examined whether the COVID-19 epidemic changed the perceived attractiveness and healthiness when viewing faces with and without sanitary masks. We also used questionnaires to evaluate beliefs regarding mask wearers. We found that the perception of mask-worn faces differed before versus after the onset of the COVID-19 epidemic. Specifically, mask-wearing improved wearers' sense of the attractiveness of faces, which were rated as less attractive when a mask was not worn after the onset of the COVID-19 epidemic. Furthermore, mask-worn faces were rated as healthier after the onset of the COVID-19. The proportion of respondents with negative associations regarding mask-wearing (e.g., unhealthiness) decreased relative to before the epidemic. We suggest that the weakening of this association altered the sanitary-mask effect with a relative emphasis on the occlusion component, reflecting the temporal impact of a global social incident (the COVID-19 epidemic) on the perception of facial attractiveness.

Commonalities of visual and auditory working memory in a spatial-updating task.

Although visual and auditory inputs are initially processed in separate perception systems, studies have built on the idea that to maintain spatial information these modalities share a component of working memory. The present study used working memory navigation tasks to examine functional similarities and dissimilarities in the performance of updating tasks. Participants mentally updated the spatial location of a target in a virtual array in response to sequential pictorial and sonant directional cues before identifying the target's final location. We predicted that if working memory representations are modality-specific, mixed-modality cues would demonstrate a cost of modality switching relative to unimodal cues. The results indicate that updating performance using visual unimodal cues positively correlated with that using auditory unimodal cues. Task performance using unimodal cues was comparable to that using mixed modality cues. The results of a subsequent experiment involving updating of target traces were consistent with those of the preceding experiments and support the view of modality-nonspecific memory.

Common principles underlie the fluctuation of auditory and visual sustained attention.

Sustained attention plays an important role in adaptive behaviours in everyday activities. As previous studies have mostly focused on vision, and attentional resources have been thought to be specific to sensory modalities, it is still unclear how mechanisms of attentional fluctuations overlap between visual and auditory modalities. To reduce the effects of sudden stimulus onsets, we developed a new gradual-onset continuous performance task (gradCPT) in the auditory domain and compared dynamic fluctuation of sustained attention in vision and audition. In the auditory gradCPT, participants were instructed to listen to a stream of narrations and judge the gender of each narration. In the visual gradCPT, they were asked to observe a stream of scenery images and indicate whether the scene was a city or mountain. Our within-individual comparison revealed that auditory and visual attention are similar in terms of the false alarm rate and dynamic properties including fluctuation frequency. Absolute timescales of the fluctuation in the two modalities were comparable, notwithstanding the difference in stimulus onset asynchrony. The results suggest that fluctuations of visual and auditory attention are underpinned by common principles and support models with a more central, modality-general controller.

Replicability of the Curvature Effect as a Function of Presentation Time and Response Measure in Japanese Observers.

Although objects with curved contours are generally preferred over those with sharp-angled contours, the strength of this preference varies according to several factors. In the present study, non-Western Japanese observers viewed and rated their preferences (e.g., liking or attractiveness) for real and meaningless objects with curved or sharp-angled contours. We varied the presentation time (90 ms vs. until a response was received) and the response measure (like/dislike vs. 1-100 rating scale). When using like/dislike ratings, a preference for curved objects was found only when images of real objects were presented briefly (90 ms), whereas this effect was reversed (i.e., increased preference for sharp-angled contours) when using the 1 to 100 scale under the until-response condition. In addition, the curvature effect was not observed for real objects when the like/dislike rating and the until-response condition were employed or when the 1 to 100 scale and 90 ms presentation time were used. The curvature effect for meaningless objects remained unstable regardless of presentation time or response measure. Similar to the preference for real objects, a preference for sharp-angled objects was observed when preference was measured using a 1 to 100 rating scale. Taken together, the present findings indicate that the preferences for curved objects were situation-dependent in Japanese observers.

Effects of Visual Working Memory on Individual Differences in Echolocation Performance in Sighted Participants.

Echolocation performance differs widely among individuals. This study examined a possible factor that may explain this variation, namely, visual working memory, which is a subcomponent of spatial working memory. Sighted participants performed an object-detection task consisting of initial testing on 2 separate days (up to 8 days apart) with follow-up testing on a third day (up to 1 month after the second day of testing) while manipulating the target distance from 20 to 50 cm. Participants performed two types of visual spatial working memory tasks, one of which required them to memorize color-location combinations and the other, an imaginary pathway. The participants' performance on the object-detection task generally improved in the first 2 days, but there were substantial individual differences in detection ability. A positive correlation was observed between performance on these tasks and visual working memory capacity, except on the second day, after detection ability had improved. These findings suggest that factors contributing to echolocation skill are related to nonauditory factors in a sighted group.

Association between cue lead time and template-for-rejection effect.

The human visual system can actively prioritize task-relevant features to search for a target. Recent studies have reported cases in which the system may suppress irrelevant features by using a template for rejection. However, in those studies, the templates used for rejection were limited to the color domain, and they have yielded mixed results. Our literature review identified three differences among studies that may be responsible for such mixed results: differences in the spatial segmentation of items (i.e., segregated or intermixed across the display), differences in how features are defined and reported (i.e., combined or separate), and differences in cue lead times (short or long). Participants searched for a target-line segment in a shape and identified its orientation from among non-target line-shaped compound shapes that were preceded by one of three cue displays. Positive cues indicated that the target segment would appear in a shape, and negative cues that it would not appear in a shape. Neutral cues indicated that a particular shape would not appear in the current search display. The results demonstrated that reaction times were faster under the negative-cue condition than the neutral-cue condition, reflecting the effect of a shape-based template for rejection (Experiment 1). Experiment 2 replicated the absence of the effect in the shape domain. Experiment 3 indicated that the template-for-rejection effect occurred only when the cue lead time was relatively long, suggesting that time is required (approximately 2,400 ms or longer) for the visual system to form rejection templates. Experiment 4 excluded the possibility that a confound in the target-defining/reporting feature was involved. These results indicated that apparent inconsistencies in research on the template-for-rejection effect can be explained in terms of the time required for templates to be configured.

A singleton distractor updates the inhibitory template for visual marking.

Visual marking, which is based on the assumption that previewing some distractors increases the efficiency of subsequent visual searches, constitutes one of the most efficient inhibitions on visual searches. The preview search task consists of a display of a subset of distractors followed by an additional display containing the remaining distractors and a target. During the preview period, an inhibitory template is thought to be formed, resulting in the prioritization of the subsequently presented items and the inhibition of the previewed items. Although the previous studies have mainly examined the determinants that impair the inhibitory templates resulting in inefficient visual searches, the present study examined the possibility that the template could be updated to increase search efficiency. To this end, we used a preview search task and manipulated the presence of a singleton distractor in the display of the additional items. We examined whether the singleton increased the efficiency of the search performance by determining if the inhibitory template would be updated such that participants would treat the singleton as if it had been previewed. The results demonstrated that the response times were faster with the singleton included, suggesting that an inhibitory template for visual marking could be updated and lead to improved search performance.

Sex Differences in Temporal but Not Spatial Attentional Capture.

The accuracy of detecting or identifying a target decreases when a salient distractor is presented. This decrease is explained by the temporal or spatial diversion of attention to the distractor and thus is referred to as attentional capture. Using temporal and spatial visual search tasks, we examined whether there are sex differences in attentional capture. In Experiment 1A, a temporal visual search task measured attentional capture in the temporal domain by asking participants (97 men and 92 women) to identify a target embedded in a rapid stream of nontarget letters while ignoring a preceding peripheral distractor. In Experiment 2, a spatial visual search task measured attentional capture in the spatial domain by asking participants (146 men and 83 women) to detect a target among spatially distributed nontarget items while ignoring a distractor presented simultaneously. Our results indicate that attentional capture occurred in both tasks. In Experiment 1A, the magnitude of capture was significantly larger for women than men. In Experiment 1B, we confirmed sex differences in temporal attentional capture by recruiting a new set of participants (141 men and 85 women). In Experiment 2, the magnitude of capture was comparable between the sexes. These results suggest that women are more sensitive to bottom-up signals than men when they engage in a temporal search task and could be explained in terms of sex differences in the ability of adjusting the size of attentional window, within which attention is allocated to the most salient item.