The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments.

In the mixed reality (MR) environment, the task of target motion perception is usually undertaken by vision. This approach suffers from poor discrimination and high cognitive load when the tasks are complex. This cannot meet the needs of the air traffic control field for rapid capture and precise positioning of the dynamic targets in the air. Based on this problem, we conducted a multimodal optimization study on target motion perception judgment by controlling the hand tactile sensor to achieve the use of tactile sensation to assist vision in MR environment. This allows it to adapt to the requirements of future development-led interactive tasks under the mixed reality holographic aviation tower. Motion perception tasks are usually divided into urgency sensing for multiple targets and precise position tracking for single targets according to the number of targets and task division. Therefore, in this paper, we designed experiments to investigate the correlation between tactile intensity-velocity correspondence and target urgency, and the correlation between the PRS (position, rhythm, sequence) tactile indication scheme and position tracking. We also evaluated it through comprehensive experiment. We obtained the following conclusions: (1) high, higher, medium, lower, and low tactile intensities would bias human visual cognitive induction to fast, faster, medium, slower, and slow motion targets. Additionally, this correspondence can significantly improve the efficiency of the participants' judgment of target urgency; (2) under the PRS tactile indication scheme, position-based rhythm and sequence cues can improve the judgment effect of human tracking target dynamic position, and the effect of adding rhythm cues is better. However, when adding rhythm and sequence cues at the same time, it can cause clutter; (3) tactile assisted vision has a good improvement effect on the comprehensive perception of dynamic target movement. The above findings are useful for the study of target motion perception in MR environments and provide a theoretical basis for subsequent research on the cognitive mechanism and quantitative of tactile indication in MR environment.

A Study on the Intuitive Design of Target Search Tasks under Time and Information Pressure.

In modern warfare, operators of radar equipment are confronted with a large amount of information in a short period of time that they must process to make decisions. Such conditions often lead to human error, resulting in the loss of the best operational opportunities and putting themselves at a disadvantage. To address this issue, in this paper, we presents three intuitive designs for radar display interface icons, namely image schema, stereotypes, and expert intuition. Based on event-related potential techniques and eye-movement techniques, a modified sample delay matching task experimental paradigm is used to investigate the advantages and mechanisms of three intuitionistic designs with varying time pressures and numbers of tasks. The experimental results showed: (1) When representing the attributes of a target, image schema are most suitable for expressing the motion attributes of the target, such as speed and height, whereas stereotypes are most suitable for expressing fixed attributes, such as target threat. (2) Tasks with high time pressure are more difficult, leading to higher error rates; the reaction time of a single task should be no less than 4000 ms. (3) When multiple attributes of the target need to be observed at the same time, the same type of expression should be used. (4) Rational use of color to represent the target attributes can effectively reduce the cognitive load of people searching for the target.

3D Space Layout Design of Holographic Command Cabin Information Display in Mixed Reality Environment Based on HoloLens 2.

After the command and control information of the command and control cabin is displayed in the form of mixed reality, the large amount of real-time information and static information contained in it will form a dynamic situation that changes all the time. This brings a great burden to the system operator's cognition, decision-making and operation. In order to solve this problem, this paper studies the three-dimensional spatial layout of holographic command cabin information display in a mixed reality environment. A total of 15 people participated in the experiment, of which 10 were the subjects of the experiment and 5 were the staff of the auxiliary experiment. Ten subjects used the HoloLens 2 generation to conduct visual characteristics and cognitive load experiments and collected and analyzed the subjects' task completion time, error rate, eye movement and EEG and subjective evaluation data. Through the analysis of experimental data, the laws of visual and cognitive features of three-dimensional space in a mixed reality environment can be obtained. This paper systematically explores the effects of three key attributes: depth distance, information layer number and target relative position depth distance of information distribution in a 3D space, on visual search performance and on cognitive load. The experimental results showed that the optimal depth distance range for information display in the mixed reality environment is: the best depth distance for operation interactions (0.6 m~1.0 m), the best depth distance for accurate identification (2.4 m~2.8 m) and the overall situational awareness best-in-class depth distance (3.4 m~3.6 m). Under a certain angle of view, the number of information layers in the space is as small as possible, and the number of information layers should not exceed five at most. The relative position depth distance between the information layers in space ranges from 0.2 m to 0.35 m. Based on this theory, information layout in a 3D space can achieve a faster and more accurate visual search in a mixed reality environment and effectively reduce the cognitive load.

Prediction of Human-Computer Interaction Intention Based on Eye Movement and Electroencephalograph Characteristics.

In order to solve the problem of unsmooth and inefficient human-computer interaction process in the information age, a method for human-computer interaction intention prediction based on electroencephalograph (EEG) signals and eye movement signals is proposed. This approach is different from previous methods where researchers predict using data from human-computer interaction and a single physiological signal. This method uses the eye movements and EEG signals that clearly characterized the interaction intention as the prediction basis. In addition, this approach is not only tested with multiple human-computer interaction intentions, but also takes into account the operator in different cognitive states. The experimental results show that this method has some advantages over the methods proposed by other researchers. In Experiment 1, using the eye movement signal fixation point abscissa Position X (PX), fixation point ordinate Position Y (PY), and saccade amplitude (SA) to judge the interaction intention, the accuracy reached 92%, In experiment 2, only relying on the pupil diameter, pupil size (PS) and fixed time, fixed time (FD) of eye movement signals can not achieve higher accuracy of the operator's cognitive state, so EEG signals are added. The cognitive state was identified separately by combining the screened EEG parameters Rα/ß with the eye movement signal pupil diameter and fixation time, with an accuracy of 91.67%. The experimental combination of eye movement and EEG signal features can be used to predict the operator's interaction intention and cognitive state.

Physical load reduces synchrony effects on agency and ownership in the virtual hand illusion.

We used the virtual hand illusion paradigm to investigate the effect of physical load on perceived agency and body ownership. Participants pulled a resistance band that required exerting a force of 1 N, 10 N, or 20 N while operating a virtual hand that moved in synchronous or out of sync with their own hand. Explicit agency and ownership ratings were obtained, in addition to intentional binding and skin conductance as implicit measures of agency and ownership. Physical load increased perceived subjective load but showed no main effect, while synchrony effects were found on all agency and ownership measures. Interestingly, load did interact with synchrony in implicit agency and explicit ownership, by reducing and eliminating synchrony effects as movement synchrony was reduced with higher physical load. Furthermore, consistent with previous claims, implicit agency increased with perceived effort associated with higher physical load.

Perceptual influence of auditory pitch on motion speed.

There is a cross-modal mapping between auditory pitch and many visual properties, but the relationship between auditory pitch and motion speed is unexplored. In this article, the ball and baffle are used as the research objects, and an object collision experiment is used to explore the perceptual influence of auditory pitch on motion speed. Since cross-modal mapping can influence perceptual experience, this article also explores the influence of auditory pitch on action measures. In Experiment 1, 12 participants attempted to release a baffle to block a falling ball on the basis of speed judgment, and after each trial, they were asked to rate the speed of the ball. The speed score and baffle release time were recorded and used for analysis of variance. Since making explicit judgments about speed can alter the processing of visual paths, another group of participants in Experiment 2 completed the experiment without making explicit judgments about speed. Our results show that there is a cross-modal mapping between auditory pitch and motion speed, and high or low tones cause perception shift to faster or slower speeds.

Cognitive load dissociates explicit and implicit measures of body ownership and agency.

It is often claimed that the human self consists of perceived body ownership and agency, which are commonly assessed through explicit ownership and agency judgments and implicit measures, like proprioceptive drift, skin conductance responses, and intentional binding effects. Bottom-up multisensory integration and top-down modulation were predicted to be important for ownership and agency. In previous studies, cognitive load was revealed to affect the sense of agency in a top-down fashion, but its effect on ownership has not been fully investigated, not even its possibly different effect on explicit and implicit measures. Here we used cognitive load (small vs. large sets in a working-memory task) to disentangle explicit and implicit measures of ownership and agency in a task inducing the virtual hand illusion (VHI; stronger perceived ownership and agency over a virtual hand if it moves in synchrony with one's real hand). Results showed similar patterns for ownership and agency - both ownership and agency were affected by cognitive load, and importantly in the explicit measures, higher load increased the effect of synchrony (i.e., the VHI), but in implicit measures, higher load reduced indications of both ownership and agency. Hence, the load manipulation was selective with regard to the explicit versus implicit nature of the measure but not with respect to the measure's content. This provides strong evidence that explicit and implicit measures of both ownership and agency rely on at least partly separable informational sources, while the difference between ownership and agency as such does not seem to play a major role.

Explicit and implicit measures of body ownership and agency: affected by the same manipulations and yet independent.

People are assumed to represent themselves in terms of body ownership and agency. Studies using the rubber- or virtual-hand illusion have assessed ownership and agency by means of explicit ownership and agency ratings and implicit measures, like proprioceptive drift in the case of ownership. These measures often show similar effects but also some discrepancies, suggesting that they rely on data sources that overlap, but not completely. To systematically assess commonalities and discrepancies, we adopted an immersed virtual hand illusion (VHI) design, in which three independent factors were manipulated: the synchrony between the movement of real and virtual effector, the type of effector, which was a virtual hand or triangle, and the spatial congruency between the real and virtual effector. Commonalities and discrepancies in the effects of these factors were assessed by crossing explicit and implicit measures for ownership and agency. While standard ratings were used as explicit measures, implicit ownership was assessed by means of proprioceptive drift and implicit agency by means of intentional binding. Results showed similar effect patterns for the two agency measures, which, however, were not correlated, different effect patterns for the two ownership measures, and a strong correlation between the two explicit measures. Taken altogether, our findings suggest that explicit and implicit measures of ownership and agency partly rely on shared informational sources, but seem to differ with respect to other sources that are integrated or with respect to the processed dimension (shape vs. time). The findings also suggest that some findings obtained with RHI designs might reflect more the unnatural situation that that design puts individuals into rather than generalizable mechanisms of computing perceived ownership and agency.