Creating augmented reality-based experiences for aviation weather training: Challenges, opportunities, and design implications for 3D authoring.

This paper examines opportunities and challenges of integrating augmented reality (AR) into education and investigates requirements to enable instructors to author AR educational experiences. Although AR technology is recognised for its potential in educational enhancement, it poses challenges for instructors creating AR-based experiences due to their limited digital skills and the complexity of 3D authoring tools. Semi-structured interviews with 17 aviation instructors identified current pedagogical approaches, gaps, and potential applications of AR in aviation weather education. Additionally, results highlighted the benefits of AR and obstacles to its integration into education, followed by outlining design priorities and user needs for educational AR authoring. For AR authoring toolkit development, this study recommended incorporating interactive AR lesson modules, early development of user requirements, and prebuilt AR modules. Findings will guide the development of a 3D authoring toolkit for non-technologist instructors, enabling wider AR use in aviation weather education and other educational fields.

Research interviews with aviation instructors were conducted to derive design implications of AR authoring toolkits for non-technologist instructors. Key findings highlighted gaps in aviation weather education, potential AR applications, and barriers to AR in education. Design recommendations emphasised incorporating interactive AR lesson modules, initial user requirements, and prebuilt AR modules.

Virtual Reality Adaptive Training for Personalized Stress Inoculation.

OBJECTIVE: To evaluate a personalized adaptive training program designed for stress prevention using graduated stress exposure. BACKGROUND: Astronauts in the high-risk space mission environment are prone to performance-impairing stress responses, making preemptive stress inoculation essential for their training. METHODS: This work developed an adaptive virtual reality-based system that adjusts environmental stressors based on real-time stress indicators to optimize training stress levels. Sixty-five healthy subjects underwent task training in one of three groups: skill-only (no stressors), fixed-graduated (prescheduled stressor changes), and adaptive. Psychological (subjective stress, task engagement, distress, worry, anxiety, and workload) and physiological (heart rate, heart rate variability, blood pressure, and electrodermal activity) responses were measured. RESULTS: The adaptive condition showed a significant decrease in heart rate and a decreasing trend in heart rate variability ratio, with no changes in the other training conditions. Distress showed a decreasing trend for the graduated and adaptive conditions. Task engagement showed a significant increase for adaptive and a significant decrease for the graduated condition. All training conditions showed a significant decrease in worry and anxiety and a significant increase in the other heart rate variability metrics. CONCLUSION: Although all training conditions mitigated some stress, the preponderance of trial effects for the adaptive condition supports that it is more successful at decreasing stress. APPLICATION: The integration of real-time personalized stress exposure within a VR-based training program not only prepares individuals for high-stress situations by preemptively mitigating stress but also customizes stressor levels to the crew member's current state, potentially enhancing resilience to future stressors.

Effects of a Passive Back-Support Exosuit on Postural Control and Cognitive Performance During a Fatigue-Inducing Posture Maintenance Task.

OBJECTIVE: To evaluate the effectiveness of passive back-support exosuit on postural control and cognitive performance during a fatigue-inducing posture maintenance task. BACKGROUND: Wearable support systems (exoskeletons/exosuits) reduce physical demands but may also influence postural control and cognitive performance by reducing muscular fatigue. METHOD: Eighteen participants visited on two different days to test an exosuit system and performed dual-task cognitive assessments based on human information processing (information acquisition, information integration, and action implementation) while maintaining a 35° trunk flexion posture for 16 minutes. Center-of-pressure (CoP), cognitive performance, and perceived workload were recorded, while erector spinae muscle activity was captured to quantify muscle fatigue. RESULTS: The exosuit was effective in reducing erector spinae muscle fatigue during the static posture maintenance task (61% less in Δmedian frequency: -9.5 Hz (EXO-Off) versus -3.7 Hz (EXO-On)). The fatigue-inducing task increased CoP velocity as a function of time (29% greater: 9.3 mm/sec (pre) versus 12.0 mm/sec (post)), and exosuit use decreased CoP velocity (23% less: 12.1 mm/sec (EXO-Off) versus 9.4 mm/sec (EXO-On)). The exosuit was also effective at mitigating cognitive degradation, as evidenced by a higher hit-to-signal ratio (8% greater: 81.3 (EXO-Off) versus 87.9 (EXO-On)) in the information integration task and reducing perceived workload in all stages of human information processing. CONCLUSION: Exosuit provided benefits of postural control and information integration processing during a 16-min static posture maintenance task. APPLICATION: Torso exoskeletons/suits can have positive implications for occupations with concurrent physical and cognitive demands.

An evaluation to determine if reading the mind in the eyes scores can be improved through training.

The Reading the Mind in the Eyes Test (RMET) has received attention due to its correlation with collective intelligence. If the RMET is a marker of collective intelligence, training to improve RMET could result in better teamwork, whether for human-human or human-AI (artificial intelligence) in composition. While training on related skills has proven effective in the literature, RMET training has not been studied. This research evaluates the development of RMET training, testing the impact of two training conditions (Naturalistic Training and Repeated RMET Practice) compared to a control. There were no significant differences in RMET scores due to training, but speed of response was positively correlated to RMET score for high-scoring participants. Both management professionals and AI creators looking to cultivate team skill through the application of the RMET may need to reconsider their tool selection.

Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System.

This research assessed how the performance and team skills of three-person teams working with an Intelligent Team Tutoring System (ITTS) on a virtual military surveillance task were affected by feedback privacy, participant role, task experience, prior team experience, and teammate familiarity. Previous work in Intelligent Tutoring Systems (ITSs) has focused on outcomes for task skill training for individual learners. As research extends into intelligent tutoring for teams, both task skills and team skills are necessary for good team performance. This work includes a brief review of previous research on ITTSs, feedback, teams, and teamwork, including the recounting of two categories of a framework of teamwork performance, Communication and Cognition, which are relevant to the present study. This research examines the effects of an intelligent agent, as well as features of the team, its members, and the task being undertaken, on team communication (measured by relevant key-presses) and team situation awareness (as measured by scores on a quiz). Thirty-seven teams of three participants, each at their own computer running a multiplayer surveillance simulation, were given just-in-time private (individually delivered) or public (team-delivered) performance feedback during four 5-min trials. In the fourth trial, two of the three participants switched roles. Feedback type, teamwork experience, and teammate familiarity had no statistically significant effect on communication or team situation awareness. However, higher levels of role experience and task experience showed significant and medium-sized effects on communication performance. Results, based on performance data and structured interview responses, also revealed areas of improvement in future feedback design and a potential benchmark for feedback frequency in an action-oriented serious game-based ITTS. Among the conclusions are six design objectives for future ITTSs, establishing a foundation for future research on designing effective ITTSs that train interpersonal skills to nascent teams.

The Interaction Between Physical and Psychosocial Stressors.

Do physical and psychosocial stressors interact to increase stress in ways not explainable by the stressors alone? A preliminary study compared participants' stress response while subjected to a physical stressor (reduced or full physical load) and a predetermined social stressor (confronted by calm or aggressive behavior). Salivary cortisol samples measured endocrine stress. Heart rate variability (HRV) and electrodermal activity (EDA) measured autonomic stress. Perceived stress was measured via discomfort and stress state surveys. Participants with a heavier load reported increased distress and discomfort. Encountering an aggressive individual increased endocrine stress, distress levels, and perceived discomfort. Higher autonomic stress and discomfort were found in participants with heavier physical load and aggressive individuals. The results suggest a relationship where physical load increases the stressfulness of aggressive behavior in ways not explainable by the effects of the stressors alone. Future research is needed to confirm this investigation's findings.

Shoulder Muscular Fatigue From Static Posture Concurrently Reduces Cognitive Attentional Resources.

OBJECTIVE: The goal of this work is to determine whether muscular fatigue concurrently reduces cognitive attentional resources in technical tasks for healthy adults. BACKGROUND: Muscular fatigue is common in the workplace but often dissociated with cognitive performance. A corpus of literature demonstrates a link between muscular fatigue and cognitive function, but few investigations demonstrate that the instigation of the former degrades the latter in a way that may affect technical task completion. For example, laparoscopic surgery increases muscular fatigue, which may risk attentional capacity reduction and undermine surgical outcomes. METHOD: A total of 26 healthy participants completed a dual-task cognitive assessment of attentional resources while concurrently statically fatiguing their shoulder musculature until volitional failure, in a similar loading pattern observed in laparoscopic procedures. Continuous and discrete monitoring task performance was recorded to reflect attentional resources. RESULTS: Electromyography of the anterior deltoid and descending trapezius, as well as self-assessment surveys indicated fatigue occurrence; continuous tracking error, tracking velocity, and response time significantly increased with muscular fatigue. CONCLUSION: Muscular fatigue concurrently degrades cognitive attentional resources. APPLICATION: Complex tasks that rely on muscular and cognitive performance should consider interventions to reduce muscular fatigue to also preserve cognitive performance.

Affect-Aware Adaptive Tutoring Based on Human-Automation Etiquette Strategies.

OBJECTIVE: We investigated adapting the interaction style of intelligent tutoring system (ITS) feedback based on human-automation etiquette strategies. BACKGROUND: Most ITSs adapt the content difficulty level, adapt the feedback timing, or provide extra content when they detect cognitive or affective decrements. Our previous work demonstrated that changing the interaction style via different feedback etiquette strategies has differential effects on students' motivation, confidence, satisfaction, and performance. The best etiquette strategy was also determined by user frustration. METHOD: Based on these findings, a rule set was developed that systemically selected the proper etiquette strategy to address one of four learning factors (motivation, confidence, satisfaction, and performance) under two different levels of user frustration. We explored whether etiquette strategy selection based on this rule set (systematic) or random changes in etiquette strategy for a given level of frustration affected the four learning factors. Participants solved mathematics problems under different frustration conditions with feedback that adapted dynamic changes in etiquette strategies either systematically or randomly. RESULTS: The results demonstrated that feedback with etiquette strategies chosen systematically via the rule set could selectively target and improve motivation, confidence, satisfaction, and performance more than changing etiquette strategies randomly. The systematic adaptation was effective no matter the level of frustration for the participant. CONCLUSION: If computer tutors can vary the interaction style to effectively mitigate negative emotions, then ITS designers would have one more mechanism in which to design affect-aware adaptations that provide the proper responses in situations where human emotions affect the ability to learn.

Evaluation of the Display of Cognitive State Feedback to Drive Adaptive Task Sharing.

This paper presents an adaptive system intended to address workload imbalances between pilots in future flight decks. Team performance can be maximized when task demands are balanced within crew capabilities and resources. Good communication skills enable teams to adapt to changes in workload, and include the balancing of workload between team members This work addresses human factors priorities in the aviation domain with the goal to develop concepts that balance operator workload, support future operator roles and responsibilities, and support new task requirements, while allowing operators to focus on the most safety critical tasks. A traditional closed-loop adaptive system includes the decision logic to turn automated adaptations on and off. This work takes a novel approach of replacing the decision logic, normally performed by the automation, with human decisions. The Crew Workload Manager (CWLM) was developed to objectively display the workload between pilots and recommend task sharing; it is then the pilots who "close the loop" by deciding how to best mitigate unbalanced workload. The workload was manipulated by the Shared Aviation Task Battery (SAT-B), which was developed to provide opportunities for pilots to mitigate imbalances in workload between crew members. Participants were put in situations of high and low workload (i.e., workload was manipulated as opposed to being measured), the workload was then displayed to pilots, and pilots were allowed to decide how to mitigate the situation. An evaluation was performed that utilized the SAT-B to manipulate workload and create workload imbalances. Overall, the CWLM reduced the time spent in unbalanced workload and improved the crew coordination in task sharing while not negatively impacting concurrent task performance. Balancing workload has the potential to improve crew resource management and task performance over time, and reduce errors and fatigue. Paired with a real-time workload measurement system, the CWLM could help teams manage their own task load distribution.

Analysis of Food Hub Commerce and Participation Using Agent-Based Modeling: Integrating Financial and Social Drivers.

OBJECTIVE: Factors influencing long-term viability of an intermediated regional food supply network (food hub) were modeled using agent-based modeling techniques informed by interview data gathered from food hub participants. BACKGROUND: Previous analyses of food hub dynamics focused primarily on financial drivers rather than social factors and have not used mathematical models. METHOD: Based on qualitative and quantitative data gathered from 22 customers and 11 vendors at a midwestern food hub, an agent-based model (ABM) was created with distinct consumer personas characterizing the range of consumer priorities. A comparison study determined if the ABM behaved differently than a model based on traditional economic assumptions. Further simulation studies assessed the effect of changes in parameters, such as producer reliability and the consumer profiles, on long-term food hub sustainability. RESULTS: The persona-based ABM model produced different and more resilient results than the more traditional way of modeling consumers. Reduced producer reliability significantly reduced trade; in some instances, a modest reduction in reliability threatened the sustainability of the system. Finally, a modest increase in price-driven consumers at the outset of the simulation quickly resulted in those consumers becoming a majority of the overall customer base. CONCLUSION: Results suggest that social factors, such as desire to support the community, can be more important than financial factors. APPLICATION: An ABM of food hub dynamics, based on human factors data gathered from the field, can be a useful tool for policy decisions. Similar approaches can be used for modeling customer dynamics with other sustainable organizations.

Perceptual grouping effects on cursor movement expectations.

OBJECTIVE: Two studies were conducted to develop an understanding of factors that drive user expectations when navigating between discrete elements on a display via a limited degree-of-freedom cursor control device. BACKGROUND: For the Orion Crew Exploration Vehicle spacecraft, a free-floating cursor with a graphical user interface (GUI) would require an unachievable level of accuracy due to expected acceleration and vibration conditions during dynamic phases of flight. Therefore, Orion program proposed using a "caged" cursor to "jump" from one controllable element (node) on the GUI to another. However, nodes are not likely to be arranged on a rectilinear grid, and so movements between nodes are not obvious. METHOD: Proximity between nodes, direction of nodes relative to each other, and context features may all contribute to user cursor movement expectations. In an initial study, we examined user expectations based on the nodes themselves. In a second study, we examined the effect of context features on user expectations. RESULTS: The studies established that perceptual grouping effects influence expectations to varying degrees. Based on these results, a simple rule set was developed to support users in building a straightforward mental model that closely matches their natural expectations for cursor movement. CONCLUSION: The results will help designers of display formats take advantage of the natural context-driven cursor movement expectations of users to reduce navigation errors, increase usability, and decrease access time. APPLICATION: The rules set and guidelines tie theory to practice and can be applied in environments where vibration or acceleration are significant, including spacecraft, aircraft, and automobiles.

Toward a characterization of adaptive systems: a framework for researchers and system designers.

OBJECTIVE: This article presents a systematic framework characterizing adaptive systems. BACKGROUND: Adaptive systems are those that can appropriately modify their behavior to fit the current context. This concept is appealing because it offers the possibility of creating computer assistants that behave like good human assistants who can provide what is needed without being asked. However, the majority of adaptive systems have been experimental rather than practical because of the technical challenges in accurately perceiving and interpreting users' current cognitive state; integrating cognitive state, environment, and task information; and using it to predict users' current needs. The authors anticipate that recent developments in neurological and physiological sensors to identify users' cognitive state will increase interest in adaptive systems research and practice over the next few years. METHOD: To inform future efforts in adaptive systems, this work provides an organizing framework for characterizing adaptive systems, identifying considerations and implications, and suggesting future research issues. RESULTS: A two-part framework is presented that (a) categorizes ways in which adaptive systems can modify their behavior and (b) characterizes trigger mechanisms through which adaptive systems can sense the current situation and decide how to adapt. CONCLUSION: The framework provided in this article provides a tool for organizing and informing past, present, and future research and development efforts in adaptive systems.