The precision of signals encoding active self-movement.

Everyday actions like moving the head, walking around and grasping objects are typically self-controlled. This presents a problem when studying the signals encoding such actions because active self-movement is difficult to control experimentally. Available techniques demand repeatable trials, but each action is unique, making it difficult to measure fundamental properties like psychophysical thresholds. We present a novel paradigm that recovers both precision and bias of self-movement signals with minimal constraint on the participant. The paradigm relies on linking image motion to previous self-movement, and two experimental phases to extract the signal encoding the latter. The paradigm takes care of a hidden source of external noise not previously accounted for in techniques that link display motion to self-movement in real time (e.g. virtual reality). We use head rotations as an example of self-movement, and show that the precision of the signals encoding head movement depends on whether they are being used to judge visual motion or auditory motion. We find that perceived motion is slowed during head movement in both cases. The 'non-image' signals encoding active head rotation (motor commands, proprioception and vestibular cues) are therefore biased towards lower speeds and/or displacements. In a second experiment, we trained participants to rotate their heads at different rates and found that the imprecision of the head rotation signal rises proportionally with head speed (Weber's Law). We discuss the findings in terms of the different motion cues used by vision and hearing, and the implications they have for Bayesian models of motion perception.

Gaze and behavioural metrics in the refractive correction of presbyopia.

PURPOSE: To investigate gaze and behavioural metrics at different viewing distances with multifocal contact lenses (MFCLs), single vision contact lenses (SVCLs) and progressive addition lenses (PALs). METHODS: Fifteen presbyopic contact lens wearers participated over five separate study visits. At each visit, participants were randomly assigned to wear one of five refractive corrections: habitual PAL spectacles, delefilcon A (Alcon Inc.) MFCLs and three separate pairs of delefilcon A single vision lenses worn as distance, intermediate and near corrections. Participants wore a Pupil Core headset to record eye and head movements while performing three visual tasks: reading, visual search and scene observation. Data were investigated using linear regression and post-hoc testing. Parameters of interest included gaze (fixation duration, head movement) and behavioural (reading speed, reading accuracy, visual search time) metrics. RESULTS: Reading speed in SVCLs was significantly faster than in MFCLs and PAL spectacles (F = 16.3, p < 0.0001). Refractive correction worn did not influence visual search times (F = 0.16, p = 0.85). Fixation duration was significantly affected by the type of visual task (F = 60.2, p < 0.001), and an interaction effect was observed between viewing distance and refractive correction (F = 4.3, p = 0.002). There was significantly more horizontal and vertical head movement (F = 3.2, p = 0.01 and F = 3.3, p = 0.01, respectively) during visual search tasks when wearing PAL spectacles compared to SVCLs or MFCLs. CONCLUSION: This work showed that the type of refractive correction affects behavioural metrics such as reading speed and gaze behaviour by affecting horizontal and vertical head movements. The findings of this study suggest that under certain conditions, wearers of MFCLs make fewer head movements compared to PAL spectacles. Gaze behaviour metrics offer a new approach to compare and understand contact lens and spectacle performance, with potential applications including peripheral optical designs for myopia management.

The role of preSMA and STS in face recognition: A transcranial magnetic stimulation (TMS) study.

Current models propose that facial recognition is mediated by two independent yet interacting anatomo-functional systems: one processing facial features mainly mediated by the Fusiform Face Area and the other involved in the extraction of dynamic information from faces, subserved by Superior Temporal Sulcus (STS). Also, the pre-Supplementary Motor Area (pre-SMA) is implicated in facial expression processing as it is involved in its motor mimicry. However, the literature only shows evidence of the implication of STS and preSMA for facial expression recognition, without relating it to face recognition. In addition, the literature shows a facilitatory role of facial motion in the recognition of unfamiliar faces, particularly for poor recognizers. The present study aimed at studying the role of STS and preSMA in unfamiliar face recognition in people with different face recognition skills. 34 healthy participants received repetitive transcranial magnetic stimulation over the right posterior STS, pre-SMA and as sham during a task of matching of faces encoded through: facial expression, rigid head movement or as static (i.e., absence of any facial or head motion). All faces were represented without emotional content. Results indicate that STS has a direct role in recognizing identities through rigid head movement and an indirect role in facial expression processing. This dissociation represents a step forward with respect to current face processing models suggesting that different types of motion involve separate brain and cognitive processes. PreSMA interacts with face recognition skills, increasing the performance of poor recognizers and decreasing that of good recognizers in all presentation conditions. Together, the results suggest the use of at least partially different mechanisms for face recognition in poor and good recognizers and a different role of STS and preSMA in face recognition.

Gaze tracking of large-billed crows (Corvus macrorhynchos) in a motion capture system.

Previous studies often inferred the focus of a bird's attention from its head movements because it provides important clues about their perception and cognition. However, it remains challenging to do so accurately, as the details of how they orient their visual field toward the visual targets remain largely unclear. We thus examined visual field configurations and the visual field use of large-billed crows (Corvus macrorhynchos Wagler 1827). We used an established ophthalmoscopic reflex technique to identify the visual field configuration, including the binocular width and optical axes, as well as the degree of eye movement. A newly established motion capture system was then used to track the head movements of freely moving crows to examine how they oriented their reconstructed visual fields toward attention-getting objects. When visual targets were moving, the crows frequently used their binocular visual fields, particularly around the projection of the beak-tip. When the visual targets stopped moving, crows frequently used non-binocular visual fields, particularly around the regions where their optical axes were found. On such occasions, the crows slightly preferred the right eye. Overall, the visual field use of crows is clearly predictable. Thus, while the untracked eye movements could introduce some level of uncertainty (typically within 15 deg), we demonstrated the feasibility of inferring a crow's attentional focus by 3D tracking of their heads. Our system represents a promising initial step towards establishing gaze tracking methods for studying corvid behavior and cognition.

A Comparison of Head Movement Classification Methods.

To understand human behavior, it is essential to study it in the context of natural movement in immersive, three-dimensional environments. Virtual reality (VR), with head-mounted displays, offers an unprecedented compromise between ecological validity and experimental control. However, such technological advancements mean that new data streams will become more widely available, and therefore, a need arises to standardize methodologies by which these streams are analyzed. One such data stream is that of head position and rotation tracking, now made easily available from head-mounted systems. The current study presents five candidate algorithms of varying complexity for classifying head movements. Each algorithm is compared against human rater classifications and graded based on the overall agreement as well as biases in metrics such as movement onset/offset time and movement amplitude. Finally, we conclude this article by offering recommendations for the best practices and considerations for VR researchers looking to incorporate head movement analysis in their future studies.

Large eye-head gaze shifts measured with a wearable eye tracker and an industrial camera.

We built a novel setup to record large gaze shifts (up to 140[Formula: see text]). The setup consists of a wearable eye tracker and a high-speed camera with fiducial marker technology to track the head. We tested our setup by replicating findings from the classic eye-head gaze shift literature. We conclude that our new inexpensive setup is good enough to investigate the dynamics of large eye-head gaze shifts. This novel setup could be used for future research on large eye-head gaze shifts, but also for research on gaze during e.g., human interaction. We further discuss reference frames and terminology in head-free eye tracking. Despite a transition from head-fixed eye tracking to head-free gaze tracking, researchers still use head-fixed eye movement terminology when discussing world-fixed gaze phenomena. We propose to use more specific terminology for world-fixed phenomena, including gaze fixation, gaze pursuit, and gaze saccade.

Noise estimation for head-mounted 3D binocular eye tracking using Pupil Core eye-tracking goggles.

Head-mounted, video-based eye tracking is becoming increasingly common and has promise in a range of applications. Here, we provide a practical and systematic assessment of the sources of measurement uncertainty for one such device - the Pupil Core - in three eye-tracking domains: (1) the 2D scene camera image; (2) the physical rotation of the eye relative to the scene camera 3D space; and (3) the external projection of the estimated gaze point location onto the target plane or in relation to world coordinates. We also assess eye camera motion during active tasks relative to the eye and the scene camera, an important consideration as the rigid arrangement of eye and scene camera is essential for proper alignment of the detected gaze. We find that eye camera motion, improper gaze point depth estimation, and erroneous eye models can all lead to added noise that must be considered in the experimental design. Further, while calibration accuracy and precision estimates can help assess data quality in the scene camera image, they may not be reflective of errors and variability in gaze point estimation. These findings support the importance of eye model constancy for comparisons across experimental conditions and suggest additional assessments of data reliability may be warranted for experiments that require the gaze point or measure eye movements relative to the external world.

Sound externalization in dynamic binaural listening: A comparative behavioral and EEG study.

Binaural reproduction aims at recreating a realistic sound scene at the ears of the listener using headphones. Unfortunately, externalization for frontal and rear sources is often poor (virtual sources are perceived inside the head, instead of outside the head). Nevertheless, previous studies have shown that large head-tracked movements could substantially improve externalization and that this improvement persisted once the subject had stopped moving his/her head. The present study investigates the relation between externalization and evoked response potentials (ERPs) by performing behavioral and EEG measurements in the same experimental conditions. Different degrees of externalization were achieved by preceding measurements with 1) head-tracked movements, 2) untracked head movements, and 3) no head movement. Results showed that performing a head movement, whether the head tracking was active or not, increased the amplitude of ERP components after 100 ms, which suggests that preceding head movements alters the auditory processing. Moreover, untracked head movements gave a stronger amplitude on the N1 component, which might be a marker of a consistency break in regards to the real world. While externalization scores were higher after head-tracked movements in the behavioral experiment, no marker of externalization could be found in the EEG results.

Importance of head movements in gaze tracking during table tennis forehand stroke.

The purpose of this study was to clarify the properties of gaze and head movements during forehand stroke in table tennis. Collegiate table tennis players (n = 12) conducted forehand strokes toward a ball launched by a skilled experimenter. A total of ten trials were conducted for the experimental task. Horizontal and vertical movements of the ball, gaze, head and eye were analyzed from the image recorded by an eye tracking device. The results showed that participants did not always keep their gaze and head position on the ball throughout the entire ball path. Our results indicate that table tennis players tend to gaze at the ball in the initial ball-tracking phase. Furthermore, there was a significant negative correlation between eye and head position especially in the vertical direction. This result suggests that horizontal VOR is suppressed more than vertical VOR in ball-tracking during table tennis forehand stroke. Finally, multiple regression analysis showed that the effect of head position to gaze position was significantly higher than that of eye position. This result indicates that gaze position during forehand stroke could be associated with head position rather than eye position. Taken together, head movements may play an important role in maintaining the ball in a constant egocentric direction in table tennis forehand stroke.

Head movement direction in football - a field study on visual scanning activity during the UEFA-U17 and -U21 European Championship 2019.

Visual exploration (scanning) of one's environment is a key aspect in team sports. Based on Gibson's (1979) ecological approach of visual perception, this study aims to advance the understanding of scanning by focusing on the direction of head movements in football and its implications for subsequent on-ball actions. The video-based data analysis consisted of nine selected matches and 162 players of the Union of European Football Associations (UEFA) U17 and U21 European Championship 2019. The results indicate that the direction of the last scan prior to receiving the ball is related to the foot used for the first ball contact. This relationship was further analysed in view of the game context (direction of play and opponent pressure) and with information about the player's dominant foot. The findings reveal a relationship between the direction of the last scan before receiving the ball and the direction the game is proceeded in. Further, when a player performs the last scan to the side of their dominant foot, the probability increases that their dominant foot is used for the subsequent first ball contact. Depending on the direction of the last scan, opponent pressure had various effects on the foot used for the first contact.

Head movement and its relation to hearing.

Head position at any point in time plays a fundamental role in shaping the auditory information that reaches a listener, information that continuously changes as the head moves and reorients to different listening situations. The connection between hearing science and the kinesthetics of head movement has gained interest due to technological advances that have increased the feasibility of providing behavioral and biological feedback to assistive listening devices that can interpret movement patterns that reflect listening intent. Increasing evidence also shows that the negative impact of hearing deficits on mobility, gait, and balance may be mitigated by prosthetic hearing device intervention. Better understanding of the relationships between head movement, full body kinetics, and hearing health, should lead to improved signal processing strategies across a range of assistive and augmented hearing devices. The purpose of this review is to introduce the wider hearing community to the kinesiology of head movement and to place it in the context of hearing and communication with the goal of expanding the field of ecologically-specific listener behavior.

Serial dependencies in visual stability during self-motion.

Every time we move our head, the brain must decide whether the displacement of the visual scene is the result of external or self-produced motion. Gaze shifts generate the biggest and most frequent disturbance of vision. Visual stability during gaze shifts is necessary for both, dissociating self-produced from external motion and retaining bodily balance. Here, we asked participants to perform an eye-head gaze shift to a target that was briefly presented in a head-mounted display. We manipulated the velocity of the scene displacement across trials such that the background moved either too fast or too slow in relation to the head movement speed. Participants were required to report whether they perceived the gaze-contingent visual motion as faster or slower than what they would expect from their head movement velocity. We found that the point of visual stability was attracted to the velocity presented in the previous trial. Our data reveal that serial dependencies in visual stability calibrate the mapping between motor-related signals coding head movement velocity and visual motion velocity. This process is likely to aid in visual stability as the accuracy of this mapping is crucial to maintain visual stability during self-motion.NEW & NOTEWORTHY We report that visual stability during self-motion is maintained by serial dependencies between the current and the previous gaze-contingent visual velocity that was experienced during a head movement. The gaze-contingent scene displacement velocity that appears normal to us thus depends on what we have registered in the recent history of gaze shifts. Serial dependencies provide an efficient means to maintain visual stability during self-motion.

ICP during head movement: significance of the venous system.

BACKGROUND: It is thought that the internal jugular veins (IJV) are the primary route for cranial venous outflow in supine position and the vertebral venous plexus when upright. Previous studies have noted a greater increase in intracranial pressure (ICP) when subjects turn their head in one direction compared to the other, but no clear cause had been investigated. We hypothesised that in the supine position, head turning and consequently obstructing the IJV draining the dominant transverse sinus (TVS) would lead to a greater rise in ICP compared to turning to the non-dominant side. METHODS: A prospective study in a large-volume neurosurgical centre. Patients undergoing continuous ICP monitoring as part of their standard clinical management were recruited. Immediate ICP was measured in different head positions (neutral, rotated to the right and left) when supine, seated, and standing. TVS dominance was established by consultant radiologist report on venous imaging. RESULTS: Twenty patients were included in the study, with a median age of 44 years. Venous system measurements revealed 85% right-sided vs 15% left-sided dominance. Immediate ICP rose more when head turning from neutral to the dominant TVS (21.93mmHg ± 4.39) vs non-dominant side (16.66mmHg ± 2.71) (p= <0.0001). There was no significant relationship in the sitting (6.08mmHg ± 3.86 vs 4.79mmHg ± 3.81, p = 0.13) or standing positions (8.74mmHg ± 4.30 vs 6.76mmHg ± 4.14, p =0.07). CONCLUSION: This study has provided further evidence that the transverse venous sinus to internal jugular system pathway is the likely primary venous drainage when supine; and quantified its effect when head turning on ICP. It may guide patient-specific nursing care and advice.

Enhancing 360 Video Streaming through Salient Content in Head-Mounted Displays.

Predicting where users will look inside head-mounted displays (HMDs) and fetching only the relevant content is an effective approach for streaming bulky 360 videos over bandwidth-constrained networks. Despite previous efforts, anticipating users' fast and sudden head movements is still difficult because there is a lack of clear understanding of the unique visual attention in 360 videos that dictates the users' head movement in HMDs. This in turn reduces the effectiveness of streaming systems and degrades the users' Quality of Experience. To address this issue, we propose to extract salient cues unique in the 360 video content to capture the attentive behavior of HMD users. Empowered by the newly discovered saliency features, we devise a head-movement prediction algorithm to accurately predict users' head orientations in the near future. A 360 video streaming framework that takes full advantage of the head movement predictor is proposed to enhance the quality of delivered 360 videos. Practical trace-driven results show that the proposed saliency-based 360 video streaming system reduces the stall duration by 65% and the stall count by 46%, while saving 31% more bandwidth than state-of-the-art approaches.

The Impact of the Angular Head Movement's Velocity during Diagnostic Maneuvers on Proper Benign Positional Paroxysmal Vertigo Diagnosis and Therapy.

Based on the current state of the BPPV field, there are no guidelines that specify an angular head movement's velocity (AHMV) during diagnostic maneuvers of BPPV. The aim of this study was to evaluate the impact of AHMV during diagnostic maneuvers on proper BPPV diagnosis and therapy. The analysis covered the results obtained in 91 patients with a positive result of the Dix-Hallpike (D-H) maneuver or the roll test. The patients were divided into four groups based on values of AHMV (high 100-200°/s and low 40-70°/s) and the BPPV type (posterior: PC-BPPV or horizontal: HC-BPPV). The parameters of the obtained nystagmuses were analyzed and compared to AHMV. There was a significant negative correlation between AHMV and latency of nystagmus in all study groups. Furthermore, there was a significant positive correlation between AHMV and both maximum slow phase velocity and average frequency of nystagmus in the PC-BPPV groups, whereas it was not observed in the HC-BPPV patients. Complete relief of symptoms was reported after 2 weeks and was better in patients diagnosed with maneuvers performed with high AHMV. High AHMV during the D-H maneuver allows the nystagmus to be more visible, increasing the sensitivity of diagnostic tests and is crucial for a proper diagnosis and therapy.

A multimodal facial cues based engagement detection system in e-learning context using deep learning approach.

Due to the COVID-19 crisis, the education sector has been shifted to a virtual environment. Monitoring the engagement level and providing regular feedback during e-classes is one of the major concerns, as this facility lacks in the e-learning environment due to no physical observation of the teacher. According to present study, an engagement detection system to ensure that the students get immediate feedback during e-Learning. Our proposed engagement system analyses the student's behaviour throughout the e-Learning session. The proposed novel approach evaluates three modalities based on the student's behaviour, such as facial expression, eye blink count, and head movement, from the live video streams to predict student engagement in e-learning. The proposed system is implemented based on deep-learning approaches such as VGG-19 and ResNet-50 for facial emotion recognition and the facial landmark approach for eye-blinking and head movement detection. The results from different modalities (for which the algorithms are proposed) are combined to determine the EI (engagement index). Based on EI value, an engaged or disengaged state is predicted. The present study suggests that the proposed facial cues-based multimodal system accurately determines student engagement in real time. The experimental research achieved an accuracy of 92.58% and showed that the proposed engagement detection approach significantly outperforms the existing approaches.

Angular velocity around the longitudinal axis in combination with head movements of springboard divers during twisted somersaults.

The ability of springboard divers to perform and control difficult elements with multiple twisted somersaults before entering the water is of great interest for coaches and researchers. In order to produce twists within somersaults, divers use both 'contact' and 'aerial' techniques. After completing body axes rotations, head movements seem to be important, as they enable visual information in the air. The current study aims at investigating angular velocities around the longitudinal axis in combination with head movements of 13 springboard divers during twisted somersaults. Divers performed forward and backward somersaults with different numbers of half twists. The results revealed maximum longitudinal axis angular velocities between 500°/s and 1300°/s. Moreover, results showed that the use of contact technique was greater in twisted somersaults with backward approaches, and thus higher angular velocities could be achieved. While finishing the twists, head movements in the opposite direction to the longitudinal axis rotation occurred, which allow divers to orient themselves. Twist speeds influenced athletes' head movements to have greater angles and greater rotational velocities. Therefore, it is concluded that fast head movements are necessary in difficult twisted dives to allow orientation in the short phase between finishing the twist and entering the water surface.

How robust are wearable eye trackers to slow and fast head and body movements?

How well can modern wearable eye trackers cope with head and body movement? To investigate this question, we asked four participants to stand still, walk, skip, and jump while fixating a static physical target in space. We did this for six different eye trackers. All the eye trackers were capable of recording gaze during the most dynamic episodes (skipping and jumping). The accuracy became worse as movement got wilder. During skipping and jumping, the biggest error was 5.8∘. However, most errors were smaller than 3∘. We discuss the implications of decreased accuracy in the context of different research scenarios.

Predicting Autism from Head Movement Patterns during Naturalistic Social Interactions.

Autism spectrum disorder (ASD) is a neurodevelopmental condition characterized in part by difficulties in verbal and nonverbal social communication. Evidence indicates that autistic people, compared to neurotypical peers, exhibit differences in head movements, a key form of nonverbal communication. Despite the crucial role of head movements in social communication, research on this nonverbal cue is relatively scarce compared to other forms of nonverbal communication, such as facial expressions and gestures. There is a need for scalable, reliable, and accurate instruments for measuring head movements directly within the context of social interactions. In this study, we used computer vision and machine learning to examine the head movement patterns of neurotypical and autistic individuals during naturalistic, face-to-face conversations, at both the individual (monadic) and interpersonal (dyadic) levels. Our model predicts diagnostic status using dyadic head movement data with an accuracy of 80%, highlighting the value of head movement as a marker of social communication. The monadic data pipeline had lower accuracy (69.2%) compared to the dyadic approach, emphasizing the importance of studying back-and-forth social communication cues within a true social context. The proposed classifier is not intended for diagnostic purposes, and future research should replicate our findings in larger, more representative samples.