Can deepfakes be used to study emotion perception? A comparison of dynamic face stimuli.

Video recordings accurately capture facial expression movements; however, they are difficult for face perception researchers to standardise and manipulate. For this reason, dynamic morphs of photographs are often used, despite their lack of naturalistic facial motion. This study aimed to investigate how humans perceive emotions from faces using real videos and two different approaches to artificially generating dynamic expressions - dynamic morphs, and AI-synthesised deepfakes. Our participants perceived dynamic morphed expressions as less intense when compared with videos (all emotions) and deepfakes (fearful, happy, sad). Videos and deepfakes were perceived similarly. Additionally, they perceived morphed happiness and sadness, but not morphed anger or fear, as less genuine than other formats. Our findings support previous research indicating that social responses to morphed emotions are not representative of those to video recordings. The findings also suggest that deepfakes may offer a more suitable standardized stimulus type compared to morphs. Additionally, qualitative data were collected from participants and analysed using ChatGPT, a large language model. ChatGPT successfully identified themes in the data consistent with those identified by an independent human researcher. According to this analysis, our participants perceived dynamic morphs as less natural compared with videos and deepfakes. That participants perceived deepfakes and videos similarly suggests that deepfakes effectively replicate natural facial movements, making them a promising alternative for face perception research. The study contributes to the growing body of research exploring the usefulness of generative artificial intelligence for advancing the study of human perception.

New evidence for the sensorimotor mismatch theory of weight perception and the size-weight illusion.

The size-weight illusion is a phenomenon where a smaller object is perceived heavier than an equally weighted larger object. The sensorimotor mismatch theory proposed that this illusion occurs because of a mismatch between efferent motor commands and afferent sensory feedback received when lifting large and small objects (i.e., the application of too little and too much lifting force, respectively). This explanation has been undermined by studies demonstrating a separation between the perceived weight of objects and the lifting forces that are applied on them. However, this research suffers from inconsistencies in the choice of lifting force measures reported. Therefore, we examined the contribution of sensorimotor mismatch in the perception of weight in the size-weight illusion and in non-size-weight illusion stimuli and evaluated the use of a lifting force aggregate measure comprising the four most common lifting force measures used in previous research. In doing so, the sensorimotor mismatch theory was mostly supported. In a size-weight illusion experiment, the lifting forces correlated with weight perception and, contrary to some earlier research, did not adapt over time. In a non-size-weight illusion experiment, switches between lifting light and heavy objects resulted in perceiving the weight of these objects differently compared to no switch trials, which mirrored differences in the manner participants applied forces on the objects. Additionally, we reveal that our force aggregate measure can allow for a more sensitive and objective examination of the effects of lifting forces on objects.

Linear perspective cues have a greater effect on the perceptual rescaling of distant stimuli than textures in the virtual environment.

The presence of pictorial depth cues in virtual environments is important for minimising distortions driven by unnatural viewing conditions (e.g., vergence-accommodation conflict). Our aim was to determine how different pictorial depth cues affect size constancy in virtual environments under binocular and monocular viewing conditions. We systematically removed linear perspective cues and textures of a hallway in a virtual environment. The experiment was performed using the method of constant stimuli. The task required participants to compare the size of 'far' (10 m) and 'near' (5 m) circles displayed inside a virtual environment with one or both or none of the pictorial depth cues. Participants performed the experiment under binocular and monocular viewing conditions while wearing a virtual reality headset. ANOVA revealed that size constancy was greater for both the far and the near circles in the virtual environment with pictorial depth cues compared to the one without cues. However, the effect of linear perspective cues was stronger than textures, especially for the far circle. We found no difference between the binocular and monocular viewing conditions across the different virtual environments. We conclude that linear perspective cues exert a stronger effect than textures on the perceptual rescaling of far stimuli placed in the virtual environment, and that this effect does not vary between binocular and monocular viewing conditions.

Comparison of Tiling Artifact Removal Methods in Secondary Ion Mass Spectrometry Images.

Time-of-flight secondary ion mass spectrometry (ToF-SIMS) imaging is used across many fields for the atomic and molecular characterization of surfaces, with both high sensitivity and high spatial resolution. When large analysis areas are required, standard ToF-SIMS instruments allow for the acquisition of adjoining tiles, which are acquired by rastering the primary ion beam. For such large area scans, tiling artifacts are a ubiquitous challenge, manifesting as intensity gradients across each tile and/or sudden changes in intensity between tiles. Such artifacts are thought to be related to a combination of sample charging, local detector sensitivity issues, and misalignment of the primary ion gun, among other instrumental factors. In this work, we investigated six different computational tiling artifact removal methods: tensor decomposition, multiplicative linear correction, linear discriminant analysis, seamless stitching, simple averaging, and simple interpolating. To ensure robustness in the study, we applied these methods to three hyperspectral ToF-SIMS data sets and one OrbiTrapSIMS data set. Our study includes a carefully designed statistical analysis and a quantitative survey that subjectively assessed the quality of the various methods employed. Our results demonstrate that while certain methods are useful and preferred more often, no one particular approach can be considered universally acceptable and that the effectiveness of the artifact removal method is strongly dependent on the particulars of the data set analyzed. As examples, the multiplicative linear correction and seamless stitching methods tended to score more highly on the subjective survey; however, for some data sets, this led to the introduction of new artifacts. In contrast, simple averaging and interpolation methods scored subjectively poorly on the biological data set, but more highly on the microarray data sets. We discuss and explore these findings in depth and present general recommendations given our findings to conclude the work.

A review of the impairments, preserved visual functions, and neuropathology in 21 patients with visual form agnosia - A unique defect with line drawings.

We present a comprehensive review of the rare syndrome visual form agnosia (VFA). We begin by documenting its history, including the origins of the term, and the first case study labelled as VFA. The defining characteristics of the syndrome, as others have previously defined it, are then described. The impairments, preserved aspects of visual perception, and areas of brain damage in 21 patients who meet these defining characteristics are described in detail, including which tests were used to verify the presence or absence of key symptoms. From this, we note important similarities along with notable areas of divergence between patients. Damage to the occipital lobe (20/21), an inability to recognise line drawings (19/21), preserved colour vision (14/21), and visual field defects (16/21) were areas of consistency across most cases. We found it useful to distinguish between shape and form as distinct constructs when examining perceptual abilities in VFA patients. Our observations suggest that these patients often exhibit difficulties in processing simplified versions of form. Deficits in processing orientation and size were uncommon. Motion perception and visual imagery were not widely tested for despite being typically cited as defining features of the syndrome - although in the sample described, motion perception was never found to be a deficit. Moreover, problems with vision (e.g., poor visual acuity and the presence of hemianopias/scotomas in the visual fields) are more common than we would have thought and may also contribute to perceptual impairments in patients with VFA. We conclude that VFA is a perceptual disorder where the visual system has a reduced ability to synthesise lines together for the purposes of making sense of what images represent holistically.

Visual illusions in young people reporting psychotic-like experiences.

BACKGROUND AND OBJECTIVES: A disruption in the co-ordination of bottom-up and top-down processing is thought to underlie anomalous perceptual experiences in psychosis. Visual illusions represent a valuable methodology in exploring this disruption. Here, we examined visual illusions in a group of young people having psychotic-like experiences. We also examined the relationship between illusion susceptibility and appraisal of psychotic-like experiences as well as depression, anxiety and stress levels. METHOD: 25 young people reporting psychotic-like experiences and 53 healthy participants performed an adjustment task that measured susceptibility to a battery of 13 visual illusions. Levels of depression, anxiety and stress were quantified in both groups. The clinical group also completed measures examining frequency, appraisals and emotional responses to psychotic-like experiences. RESULTS: A general increase of illusion susceptibility was found in the clinical group compared to the control group. However, when depression, anxiety and stress levels were controlled for, this difference disappeared. Stress turned out to be the best predictor of illusion susceptibility in the clinical group, whereas anomalous experiences, depression and anxiety were unrelated to overall illusion strength. LIMITATIONS: This study is limited to young participants reporting significant mental health difficulties and psychotic-like experiences. Findings should be replicated in an Ultra High Risk (prodromal) group. CONCLUSIONS: Increased levels of stress explained the enhanced vulnerability to illusions in the clinical group. This increased susceptibility suggests a perceptual style that relies too heavily on prior expectations at the expense of the true sensory evidence, potentially leading to an altered perceptual experience of the world.

Seeing Things: A Community Science Investigation into Motion Illusion Susceptibility in Domestic Cats (Felis silvestris catus) and Dogs (Canis lupus familiaris).

Illusions-visual fields that distort perception-can inform the understanding of visual perception and its evolution. An example of one such illusion, the Rotating Snakes illusion, causes the perception of motion in a series of static concentric circles. The current study investigated pet dogs' and cats' perception of the Rotating Snakes illusion in a community science paradigm. The results reveal that neither species spent significantly more time at the illusion than at either of the controls, failing to indicate susceptibility to the illusion. Specific behavioral data at each stimulus reveal that the most common behaviors of both species were Inactive and Stationary, while Locomotion and Pawing were the least common, supporting the finding that susceptibility may not be present. This study is the first to examine susceptibility to the Rotating Snakes illusion in dogs, as well as to directly compare the phenomenon between dogs and cats. We suggest future studies might consider exploring alternative methods in testing susceptibility to motion illusions in non-human animals.

The Effects of Adding Pictorial Depth Cues to the Poggendorff Illusion.

We tested if the misapplication of perceptual constancy mechanisms might explain the perceived misalignment of the oblique lines in the Poggendorff illusion. Specifically, whether these mechanisms might treat the rectangle in the middle portion of the Poggendorff stimulus as an occluder in front of one long line appearing on either side, causing an apparent decrease in the rectangle's width and an apparent increase in the misalignment of the oblique lines. The study aimed to examine these possibilities by examining the effects of adding pictorial depth cues. In experiments 1 and 2, we presented a central rectangle composed of either large or small bricks to determine if this manipulation would change the perceived alignment of the oblique lines and the perceived width of the central rectangle, respectively. The experiments demonstrated no changes that would support a misapplication of perceptual constancy in driving the illusion, despite some evidence of perceptual size rescaling of the central rectangle. In experiment 3, we presented Poggendorff stimuli in front and at the back of a corridor background rich in texture and linear perspective depth cues to determine if adding these cues would affect the Poggendorff illusion. The central rectangle was physically large and small when presented in front and at the back of the corridor, respectively. The strength of the Poggendorff illusion varied as a function of the physical size of the central rectangle, and, contrary to our predictions, the addition of pictorial depth cues in both the central rectangle and the background decreased rather than increased the strength of the illusion. The implications of these results with regards to different theories are discussed. It could be the case that the illusion depends on both low-level and cognitive mechanisms and that deleterious effects occur on the former when the latter ascribes more certainty to the oblique lines being the same line receding into the distance.

fMRI form adaptation and size repetition enhancement in different subdivisions of the lateral occipital complex.

Research findings on which brain areas demonstrate fMRI adaptation to the form, orientation, and size of visual stimuli has been mixed. Studies demonstrate effects in various subdivisions of the lateral occipital complex (LOC), including retinotopically tuned areas LO-1 and LO-2, and dorsal stream areas in the intraparietal sulcus (IPS). Therefore, we aimed to examine fMRI adaptation in four subdivisions of the LOC (LO-proper, posterior fusiform sulcus, LO-1, and LO-2) and three discrete regions in the IPS (caudal IPS, IPS-proper, and anterior IPS) to clarify the role that these structures play in form, orientation, and size processing. Participants performed three tasks which involved judging whether two serially presented novel objects shared the same form, orientation, or size. On each version of the task, one feature varied from trial-to-trial (e.g., form) while the other two features (e.g., orientation and size) were held constant. In this way, we were able to examine the unique fMRI signal changes in response to changes in form, orientation, and size in isolation. Form adaptation - a decrease in fMRI signal following repeated presentation of the same stimulus - was present in LO-proper and pFS, highlighting the role of LOC in form processing. Size repetition enhancement - an increase in fMRI signal following repeated presentations of the same stimulus - was observed in pFs. We propose that the latter result demonstrates the effects that top-down factors can have on visual areas, specifically when there is stimulus uncertainty. There was no evidence of orientation processing in any of the regions examined. Neither form adaptation nor size repetition enhancement was present in the three IPS regions-of-interest. Last, retinotopically defined LO1 and LO2 could not be reliably identified in participants and therefore we were unable to examine adaptation in these areas as we originally intended to do.

The Effects of Word Identity, Case, and SOA on Word Priming in a Subliminal Context.

It is widely assumed that subliminal word priming is case insensitive and that a short SOA (< 100 ms) is required to observe any effects. Here we attempted to replicate results from an influential study with the inclusion of a longer SOA to re-examine these assumptions. Participants performed a semantic categorisation task on visible word targets that were preceded either 64 or 192 ms by a subliminal prime. The prime and target were either the same or different word and could appear in the same or different case. We confirmed the presence of subliminal word priming (same word < different word reaction times). The word priming effect did not differ when case was the same or different, which supports case insensitive word priming. However, there was a general facilitation effect driven by case (same case < different case). Finally, there was a significant difference between the two SOA conditions; however, there were no interactions between SOA and any other factor, demonstrating that subliminal priming did not differ between short and long SOAs. The results demonstrate that word priming is case insensitive but that there is nevertheless an overall facilitation when words, regardless if they are repeated or not, are presented in the same case. This facilitation in case may reflect modularity in the low-level processing of the visual characteristics of words.

Enhancing Community Suicide Risk Assessment and Protective Intervention Action Plans Through a Bystander Intervention Model-Informed Video.

Aim: The effects of a bystander intervention model (BIM)-informed intervention (video) for the general community on participant risk of suicide assessment ability (ROSAA) and protective intervention ability (PIA) were compared with an active control (non-BIM-informed video). Method: Video interventions with 628 participants (Mage = 47.99, SDage = 17.34, range = 18-85 years) were conducted online. ROSAA and PIA were assessed immediately preintervention, postintervention, and at 2 months follow-up (n = 126). Results: Linear mixed model analyses indicated that the experimental and control conditions improved on both outcome variables postintervention/Time 2 (T2); however, the former yielded better outcomes than the latter (moderate ESs in both variables). Follow-up/Time 3 (T3) experimental ROSAA scores were higher than Time 1 (T1) and lower than T2 scores. Follow-up experimental PIA scores were higher than T1 and lower than T2 scores. Follow-up control ROSAA scores were higher than those of T1 and similar to T2. Follow-up control PIA scores were similar to T1 and T2 scores. Limitations: Limitations of the study include: sample homogeneity, small n at follow-up, self-report data only (no observable behavior was tested), fair inter-rater reliability, and a brief follow-up time frame. Conclusion: Current community information increased ROSAA and PIA. A BIM-informed intervention significantly enhanced these effects, which seemed to wane somewhat over time with the effect being lower at follow-up compared with postintervention. The BIM should be explored further as a basis for community suicide prevention interventions.

A review on various explanations of Ponzo-like illusions.

This article reviews theoretical and empirical arguments for and against various theories that explain the classic Ponzo illusion and its variants from two different viewpoints concerning the role of perceived depth in size distortions. The first viewpoint argues that all Ponzo-like illusions are driven by perceived depth. The second viewpoint argues that the classic Ponzo illusion is unrelated to depth perception. This review will give special focus to the first viewpoint and consists of three sections. In the first section, the role of the number of pictorial depth cues and previous experience in the strength of all Ponzo-like illusions are discussed. In the second section, we contrast the first viewpoint against the theories that explain the classic Ponzo illusion with mechanisms that are unrelated to depth perception. In the last section, we propose a Bayesian-motivated reconceptualization of Richard Gregory's misapplied size constancy theory that explains Ponzo-variant illusions in terms of prior information and prediction errors. The new account explains why some studies have provided inconsistent evidence for misapplied size constancy theory.

The development of the Poggendorff illusion in typically developing children.

We examined how the strength of the Poggendorff illusion changes with age in typically developing children. To this end, we recruited children aged 6 to 14 years and quantified the degree to which they experienced the illusion. The illusion was strongest in the youngest children and decreased with age logarithmically-reaching adult levels (as established by an earlier study) by 21.6 years, as determined by nonlinear interpolation. We also measured the ability to align two lines together in a nonillusory condition, receptive language, and abstract reasoning to determine whether changes in illusion strength were also associated with these factors. Alignment-matching abilities, receptive language, and abstract reasoning increased with age. However, only receptive language and abstract reasoning were correlated with illusion strength. Abilities in alignment matching were not related to illusion strength and reached adult levels (as established by a previous study) earlier at 14.7 years, as determined by nonlinear interpolation. A multiple regression analysis further revealed that receptive language and abstract reasoning did not contribute beyond their shared variance with age. Based on these findings, we suggest that the illusion is exaggerated in early development and attenuates as low-level and high-level processes mature. The theoretical implications of these findings are discussed.

The conceptual understanding of depth rather than the low-level processing of spatial frequencies drives the corridor illusion.

Our objective was to determine how different spatial frequencies affect the perceptual size rescaling of stimuli in the corridor illusion. Two experiments were performed using the method of constant stimuli. In experiment 1, the task required participants to compare the size of comparison and standard rings displayed over the same background image. ANOVA on the points of subject equality (PSEs) revealed that the perceived size of the top and bottom standard rings changed as a function of the availability of the high, medium, and low spatial frequency information. In experiment 2, the task required participants to compare the size of a comparison ring presented outside of the background image with a standard ring presented inside it. ANOVA on the PSEs revealed that the apparent size of the top and not the bottom standard ring changed depending on the availability of medium spatial frequency information. Eye-tracking revealed that the spatial frequency range of the background image in the periphery affected participants' eye positioning, which may explain why the effects of different spatial frequencies fluctuated across experiments. Nonetheless, when we consider these findings together, we propose that the conceptual understanding of depth plays a more important role in explaining the corridor illusion than the low-level processing of depth information extracted from different spatial frequencies along separate channels.

A priming study on naming real versus pictures of tools.

There is a growing body of literature demonstrating the relationship between the activation of sensorimotor processes in object recognition. It is unclear, however, if these processes are influenced by the differences in how real (3D) tools and two-dimensional (2D) images of tools are processed by the brain. Here, we examined if these differences could influence the naming of tools. Participants were presented with a prime stimulus that was either a picture of a tool, or a real tool, followed by a target stimulus that was always a real tool. They were then required to name each tool as they appeared. The functional use action required by the target tool was either the same (i.e., squeegee-paint roller) or different (i.e. knife-whisk) to the prime. We found that the format in which the prime tool was presented (i.e., a picture or real tool) had no influence on the participants' response times to naming the target tool. Furthermore, participants were faster at naming target tools relative to prime tools when the exact same tool was presented as both the prime and target. There was no difference in response times to naming the target tool relative to the prime when they were different tools, regardless of whether the tools' functional actions were the same or different. We also found more errors in naming target tools relative to the primes when different tools had a different functional action compared to when the same tool was presented as both the prime and the target. Taken together, our results highlight that the functional actions associated with tools do not facilitate or interfere with the recognition of tools for the purposes of naming. The theoretical implications of these results are discussed.

Alterations in Rapid Social Evaluations in Individuals with High Autism Traits.

Typically developing adults with low and high Autism Spectrum Quotient (AQ) scores made rapid social evaluations of neutral faces when these were primed by briefly presented emotional faces. High AQ participants rated neutral faces as more threatening than low AQ participants, regardless of the prime condition. Both groups rated target neutral faces as more threatening with fearful compared with neutral primes, while neither group demonstrated an effect of happy primes on the ratings of neutral target faces. These results demonstrate subtle anomalies in rapid visual processing of emotional faces across the broader autism spectrum. They suggest that higher autism traits may be associated with a generalized threat bias in rapid social evaluations.

Grey-Matter Thickness of the Left But Not the Right Primary Visual Area Correlates with Autism Traits in Typically Developing Adults.

We examined whether functional and structural variability in the primary visual area (V1) correlated with autism traits. Twenty-nine participants (16 males; MAge = 26.4 years, SDAge = 4.0 years) completed the autism-spectrum quotient (AQ) questionnaire prior to a magnetic resonance imaging session. The total AQ scores was used to assess the degree of self-reported autism traits. The average functional activation in V1 to visual stimulation and its average grey-matter thickness were calculated. There were no correlations between functional activation in V1 and autism traits. Conversely, grey-matter thickness of the left but not the right V1 correlated with autism traits. We conclude that structural changes in the left V1 could be a marker for the presence of autism traits.

Interocular transfer effects of linear perspective cues and texture gradients in the perceptual rescaling of size.

Our objective was to determine whether the influence of linear perspective cues and texture gradients in the perceptual rescaling of stimulus size transfers from one eye to the other. In experiment 1, we systematically added linear perspective cues and texture gradients in a background image of the corridor illusion. To determine whether perceptual size rescaling takes place at earlier or later stages, we tested how the perceived size of top and bottom rings changed under binocular (rings and background presented to both eyes), monocular (rings and background presented to the dominant eye only), and dichoptic (rings and background presented separately to the dominant and nondominant eyes, respectively) viewing conditions. We found differences between viewing conditions in the perceived size of the rings when linear perspective cues, but not texture gradients, were presented. Specifically, linear perspective cues produced a stronger illusion under the monocular compared to the dichoptic viewing condition. Hence, there was partial interocular transfer from the linear perspective cues, suggesting a dominant role of monocular neural populations in mediating the corridor illusion. In experiment 2, we repeated similar procedures with a more traditional Ponzo illusion background. Contrary to findings from experiment 1, there was a full interocular transfer with the presence of the converging lines, suggesting a dominant role of binocular neural populations. We conclude that higher order visual areas, which contain binocular neural populations, are more involved in the perceptual rescaling of size evoked by linear perspective cues in the Ponzo compared to the corridor illusion.

Grip Constancy but Not Perceptual Size Constancy Survives Lesions of Early Visual Cortex.

Object constancies are central constructs in theories of visual phenomenology. A powerful example is "size constancy," in which the perceived size of an object remains stable despite changes in viewing distance [1-4]. Evidence from neuropsychology [5], neuroimaging [6-11], transcranial magnetic stimulation [12, 13], single-unit and lesion studies in monkey [14-20], and computational modeling [21] suggests that re-entrant processes involving reciprocal interactions between primary visual cortex (V1) and extrastriate visual areas [22-26] play an essential role in mediating size constancy. It is seldom appreciated, however, that object constancies must also operate for the visual guidance of goal-directed action. For example, when reaching out to pick up an object, the hand's in-flight aperture scales with size of the goal object [27-30] and is refractory to the decrease in retinal-image size with increased viewing distance [31-41] (Figure 1), a phenomenon we call "grip constancy." Does grip constancy, like perceptual constancy, depend on V1 or can it be mediated by pathways that bypass it altogether? We tested these possibilities in an individual, M.C., who has bilateral lesions encompassing V1 and much of the ventral visual stream. We show that her perceptual estimates of object size co-vary with retinal-image size rather than real-world size as viewing distance varies. In contrast, M.C. shows near-normal scaling of in-flight grasp aperture to object size despite changes in viewing distance. Thus, although early visual cortex is necessary for perceptual object constancy, it is unnecessary for grip constancy, which is mediated instead by separate visual inputs to dorsal-stream visuomotor areas [42-48].