Composition considerations for fluid teams: a review.

The need exists to better understand how to comprise fluid teams-teams that are assembled on short notice, from members with little to no familiarity, who come together to carry out a time-limited task, and then disband. Due to the ever-increasing complexity of the modern workplace, the demand for these types of fluid teams is growing in task domains such as the military, aviation, healthcare, and industry. The aim of this paper is to review the team composition literature to shed light on composition considerations for forming fluid teams.

Supporting fluid teams: a research agenda.

Fluid teams are teams that are rapidly assembled from across disciplines or areas of expertise to address a near-term problem. They are typically composed of individuals who have no prior familiarity with one another, who as a team must begin work immediately, and who disband at the completion of the task. Prior research has noted the challenges posed by this unique type of team context. To date, fluid teams have been understudied, yet their relevance and application in the modern workplace is expanding. This Perspective article presents a concise overview of critical research gaps and opportunities to support selection, training, and workplace design for fluid teams.

Performance, Hemodynamics, and Stress in a Two-Day Vigilance Task: Practical and Theoretical Implications.

OBJECTIVE: To explore vigilance task performance, cerebral blood flow velocity (CBFV), workload, and stress in a within-subjects, two-session experiment. BACKGROUND: Vigilance, or sustained attention, tasks are often characterized by a decline in operator performance and CBFV with time on task, and high workload and stress. Though performance is known to improve with practice, past research has not included measures of CBFV, stress, and workload in a within-subjects multi-session design, which may also provide insight into ongoing theoretical debate. METHOD: Participants performed a vigilance task on two separate occasions. Performance, CBFV, workload, and self-reported stress were measured. RESULTS: Within each session, results were consistent with the vigilance profile found in prior research. Across sessions, performance improved but the time on task decrement remained. Mean CBFV and workload ratings did not differ between sessions, but participants reported significantly less distress, worry, and engagement after session two compared to one. CONCLUSION: Though practice may not disrupt the standard vigilance profile, it may serve to improve overall performance and reduce stress. However, repeated exposure may have negative implications for engagement and mind-wandering. APPLICATION: It is important to better understand the relationship between experience, performance, physiological response, and self-reported stress and workload in vigilance because real-world environments often require operators to do the same task over many occasions. While performance improvement and reduced distress is an encouraging result, the decline in engagement requires further research. Results across sessions fail to provide support to the mind-wandering theory of vigilance.

Optimizing aid activation in adaptive and non-adaptive aiding systems: A framework for design and validation.

Development of adaptive aids to support human performance in complex systems is a cornerstone of human factors. Research in this area has led to a diversity of ideas regarding potential activation methods. However, little guidance has been provided on how to select among aid activation methods, and this lack of guidance could hinder adaptive aid development and deployment. Within the current paper, we review available methods of aid activation and describe a process for developing and validating adaptive aiding systems. We focus on supporting system designers who wish to select the ideal aid activation method for an intended application. The process that we recommend is an empirical approach to evaluate the feasibility, costs, and benefits of various potential methods of aid activation. This methodological framework will support practitioners making critical decisions about the design of aiding systems.

Robot Authority in Human-Robot Teaming: Effects of Human-Likeness and Physical Embodiment on Compliance.

The anticipated social capabilities of robots may allow them to serve in authority roles as part of human-machine teams. To date, it is unclear if, and to what extent, human team members will comply with requests from their robotic teammates, and how such compliance compares to requests from human teammates. This research examined how the human-likeness and physical embodiment of a robot affect compliance to a robot's request to perseverate utilizing a novel task paradigm. Across a set of two studies, participants performed a visual search task while receiving ambiguous performance feedback. Compliance was evaluated when the participant requested to stop the task and the coach urged the participant to keep practicing multiple times. In the first study, the coach was either physically co-located with the participant or located remotely via a live-video. Coach type varied in human-likeness and included either a real human (confederate), a Nao robot, or a modified Roomba robot. The second study expanded on the first by including a Baxter robot as a coach and replicated the findings in a different sample population with a strict chain of command culture. Results from both studies showed that participants comply with the requests of a robot for up to 11 min. Compliance is less than to a human and embodiment and human-likeness on had weak effects on compliance.

Overload and automation-dependence in a multi-UAS simulation: Task demand and individual difference factors.

Future unmanned aerial systems (UAS) operations will require control of multiple vehicles. Operators are vulnerable to cognitive overload, despite support from system automation. This study tested whether attentional resource theory predicts impacts of cognitive demands on performance measures, including automation-dependence and stress. It also investigated individual differences in response to demands. One-hundred and 1 university student participants performed a multi-UAS simulation mission incorporating 2 surveillance tasks. Cognitive demands and level of automation (LOA) of key tasks were manipulated between-subjects. Results were partially consistent with predictions. Higher task demands impaired performance and elevated distress and workload, as expected. Higher LOA produced greater dependence on automation, but failed to mitigate workload. It was expected that, as the automation was quite reliable, participants would attempt to conserve resources by depending more on automation under high demand. In fact, the opposite tendency was observed. Individuals high in conscientiousness were especially likely to override the automation under high demand, apparently taking charge personally. Neuroticism and distress were also associated with performance, but results did not fit a resource theory interpretation. Thus, understanding impacts of overload in the multi-UAS context requires understanding operator strategy as well as resource insufficiency. Findings have implications for system design, and operator selection and training. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Beyond frequency counts: Novel conceptual recurrence analysis metrics to index semantic coordination in team communications.

Semantic alignment is a key process underlying interpersonal and team communication. However, semantic similarity is difficult to quantify, and statistical approaches designed to measure it often rely on methods that make the identification of the relative importance of key words difficult. This study outlines how conceptual recurrence analysis (CRA) can address these issues and can be used to detect conceptual structure in interpersonal communication. We developed several novel CRA metrics to analyze communication data reported previously by Mancuso, Finomore, Rahill, Blair, and Funke (Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 405-409, 2014), gathered from teams who worked cooperatively on a logic puzzle under different cognitive biasing contexts. CRA, like other measures of semantic coordination, relies on parameters whose values affect estimates of semantic alignment. We evaluated how the dimensionality of semantic spaces affects metrics quantifying the conceptual similarity of communicative exchanges, and whether metrics calculated from top-down, a priori semantic spaces or bottom-up semantic spaces empirically derived from each data set were more sensitive to biasing context. We found that the novel CRA measures were sensitive to manipulations of cognitive bias, and that higher-dimensional, bottom-up semantic spaces generally yielded more sensitivity to the experimental manipulations, though when the communication was evaluated with respect to specific key concepts, lower-dimensional, top-down spaces performed nearly as well. We conclude that CRA is sensitive to experimental manipulations in ways consistent with prior findings and that it presents a customizable framework for testing predictions about interpersonal communication patterns and other linguistic exchanges.

Evaluation of the Team Workload Questionnaire (TWLQ) in a Team-Choice Task.

OBJECTIVE: The present study was designed to evaluate the team workload questionnaire (TWLQ) in a task that was distinct from the task used to create it. BACKGROUND: The TWLQ was created from workload ratings generated by members of athletic sports teams. Given that such teams represent only a portion of the diversity of operational teams, we aimed to assess the generalizability of the TWLQ. METHOD: The present study applied the TWLQ in a collaborative choice task (hiring decision) to determine whether the factor structure reported in the initial publication of the scale would generalize from the execution tasks it was developed from to a disparate team task focused on consensus building. RESULTS: Confirmatory factor analysis indicated that the present data (N = 144) were a poor fit for the three-factor structure of the TWLQ. Subsequent exploratory factor analysis revealed a much more interrelated model of team workload with no clear division between the three conceptual factors described in the original validation of the TWLQ. CONCLUSION: The factor structure of the TWLQ did not generalize to the present team-choice task. APPLICATION: Given that the duties of operational teams vary, it is critical that future research examine how the conceptual structure of team workload may be altered by task type.

Vigilance and Automation Dependence in Operation of Multiple Unmanned Aerial Systems (UAS): A Simulation Study.

OBJECTIVE: This simulation study investigated factors influencing sustained performance and fatigue during operation of multiple Unmanned Aerial Systems (UAS). The study tested effects of time-on-task and automation reliability on accuracy in surveillance tasks and dependence on automation. It also investigated the role of trait and state individual difference factors. BACKGROUND: Warm's resource model of vigilance has been highly influential in human factors, but further tests of its applicability to complex, real-world tasks requiring sustained attention are necessary. Multi-UAS operation differs from standard vigilance paradigms in that the operator must switch attention between multiple subtasks, with support from automation. METHOD: 131 participants performed surveillance tasks requiring signal discrimination and symbol counting with a multi-UAS simulation configured to impose low cognitive demands, for 2 hr. Automation reliability was manipulated between-groups. Five Factor Model personality traits were measured prior to performance. Subjective states were assessed with the Dundee Stress State Questionnaire. RESULTS: Performance accuracy on the more demanding surveillance task showed a vigilance decrement, especially when automation reliability was low. Dependence on automation on this task declined over time. State but not trait factors predicted performance. High distress was associated with poorer performance in more demanding task conditions. CONCLUSIONS: Vigilance decrement may be an operational issue for multi-UAS surveillance missions. Warm's resource theory may require modification to incorporate changes in information processing and task strategy associated with multitasking in low-workload, fatiguing environments. APPLICATION: Interface design and operator evaluation for multi-UAS operations should address issues including motivation, stress, and sustaining attention to automation.

Vigilance Tasks: Unpleasant, Mentally Demanding, and Stressful Even When Time Flies.

OBJECTIVE: To determine whether perceived time progression (PTP) moderates participants' negative reactions to vigilance tasks. BACKGROUND: Vigilance tasks are rated by participants to be unenjoyable and as having high levels of workload and stress. Based on the adage, "You are having fun when time flies," we tested the possibility that accelerating PTP might reduce these negative experiences. METHOD: Two studies were performed, involving a long 30-min and a short 12-min vigil. We manipulated participants' PTP by creating a mismatch between their expectations about how long they would perform the task and the actual time that they were engaged. RESULTS: PTP was significantly faster for participants who were led to expect that the vigilance task would last longer than it did relative to those led to expect that task duration would be shorter than it actually was and for controls for whom task duration was equal to the expected duration. However, accelerating PTP had no effect in either experiment on undesirable reactions to the vigilance tasks. Participants uniformly rated both tasks as unenjoyable, as having a high level of workload, and as stressful. Apparently, vigilance isn't fun even when time flies. CONCLUSION: Our findings greatly underscore the depth to which negative subjective reactions are embedded in the nature of vigilance tasks and therefore that these tasks can have potentially serious costs to participants in terms of health, safety, and productivity. APPLICATION: These costs must be considered at the operational level.

The Neuroergonomics of Vigilance.

OBJECTIVE: The aim of this study was to examine the effects of uncertainty about where in the field of view critical signals for detection appear during a vigilance task (spatial uncertainty) on cerebral blood flow velocity (CBFV) and oculomotor fatigue. BACKGROUND: Neuroergonomics is a dimension of human factors founded by Raja Parasuraman that studies brain functions underlying performance at work. Neuroergonomic studies have shown that observers in vigilance tasks lose information-processing resources over time and experience oculomotor fatigue as indexed by a temporal decline in CBFV and elevation in eye closure as reflected in the PERCLOS metric. Because spatial uncertainty increases an observer's need for visual scanning relative to a spatial certainty condition, it was anticipated that spatial uncertainty would result in a greater temporal decline in CBFV and increased eye closure in a vigilance session. METHOD: Observers performed a simulated unmanned aerial vehicle (UAV) control task wherein collision flight paths were the events to be detected. UAV images could appear at random in any one of five locations on the controller's display (spatial uncertainty) or only in a fixed location (spatial certainty). RESULTS: Signal detection was poorer in the spatial-uncertain relative to the certain condition, and predictions regarding CBFV and eye closure were confirmed. CONCLUSION: Vigilance tasks involving spatial uncertainty are more neurophysiologically taxing than those in which spatial uncertainty is not a factor. APPLICATION: The neuroergonomic approach helps in understanding the effects of psychophysical factors in vigilance and to signify when performance aiding is needed.

The Independence and Interdependence of Coacting Observers in Regard to Performance Efficiency, Workload, and Stress in a Vigilance Task.

OBJECTIVE: We investigated performance, workload, and stress in groups of paired observers who performed a vigilance task in a coactive (independent) manner. BACKGROUND: Previous studies have demonstrated that groups of coactive observers detect more signals in a vigilance task than observers working alone. Therefore, the use of such groups might be effective in enhancing signal detection in operational situations. However, concern over appearing less competent than one's cohort might induce elevated levels of workload and stress in coactive group members and thereby undermine group performance benefits. Accordingly, we performed the initial experiment comparing workload and stress in observers who performed a vigilance task coactively with those of observers who performed the vigilance task alone. METHOD: Observers monitored a video display for collision flight paths in a simulated unmanned aerial vehicle control task. Self-reports of workload and stress were secured via the NASA-Task Load Index and the Dundee Stress State Questionnaire, respectively. RESULTS: Groups of coactive observers detected significantly more signals than did single observers. Coacting observers did not differ significantly from those operating by themselves in terms of workload but did in regard to stress; posttask distress was significantly lower for coacting than for single observers. CONCLUSION: Performing a visual vigilance task in a coactive manner with another observer does not elevate workload above that of observers working alone and serves to attenuate the stress associated with vigilance task performance. APPLICATION: The use of coacting observers could be an effective vehicle for enhancing performance efficiency in operational vigilance.

Effects of Stereoscopic Depth on Vigilance Performance and Cerebral Hemodynamics.

OBJECTIVE: We tested the possibility that monitoring a display wherein critical signals for detection were defined by a stereoscopic three-dimensional (3-D) image might be more resistant to the vigilance decrement, and to temporal declines in cerebral blood flow velocity (CBFV), than monitoring a display featuring a customary two-dimensional (2-D) image. BACKGROUND: Hancock has asserted that vigilance studies typically employ stimuli for detection that do not exemplify those that occur in the natural world. As a result, human performance is suboptimal. From this perspective, tasks that better approximate perception in natural environments should enhance performance efficiency. To test that possibility, we made use of stereopsis, an important means by which observers interact with their everyday surroundings. METHOD: Observers monitored a circular display in which a vertical line was embedded. Critical signals for detection in a 2-D condition were instances in which the line was rotated clockwise from vertical. In a 3-D condition, critical signals were cases in which the line appeared to move outward toward the observer. RESULTS: The overall level of signal detection and the stability of detection over time were greater when observers monitored for 3-D changes in target depth compared to 2-D changes in target orientation. However, the 3-D display did not retard the temporal decline in CBFV. CONCLUSION: These results provide the initial demonstration that 3-D displays can enhance performance in vigilance tasks. APPLICATION: The use of 3-D displays may be productive in augmenting system reliability when operator vigilance is vital.

The sustained attention to response task (SART) does not promote mindlessness during vigilance performance.

OBJECTIVE: In this study, we evaluated the validity of the Sustained Attention to Response Task (SART) as a means for promoting mindlessness in vigilance performance. BACKGROUND: Vigilance tasks typically require observers to respond to critical signals and to withhold responding to neutral events. The SART features the opposite response requirements, which supposedly leads it to promote a mindless, non-thoughtful approach to the vigilance task To test that notion, we compared the SART to the traditional vigilance format (TVF) in terms of diagnostic accuracy assessed through decision theory measures of positive and negative predictive power (PPP and NPP), perceived mental workload indexed by the Multiple Resource Questionnaire, and oculomotor activity reflected in the Nearest Neighbor Index and fixation dwell times. METHOD: Observers in TVF and SART conditions monitored a video display for collision flight paths in a simulated air traffic control task. RESULTS: Diagnostic accuracy in terms of NPP was high in both format conditions. While PPP was poorer in the SART than in the TVF, that result could be accounted for by a loss of motor control rather than a lack of mindfulness. Identical high levels of workload were generated by the TVF and SART tasks, and observers in both conditions showed similar dynamic scanning of the visual scene. CONCLUSION: The data indicate that the SART is not an engine of mindlessness. APPLICATION: The results challenge the widespread use of the SART to support a model in which mindlessness is considered to be the principal root of detection failures in vigilance.

Measuring workload in collaborative contexts: trait versus state perspectives.

OBJECTIVE: In the present study, we explored the state versus trait aspects of measures of task and team workload in a disaster simulation. BACKGROUND: There is often a need to assess workload in both individual and collaborative settings. Researchers in this field often use the NASATask Load Index (NASA-TLX) as a global measure of workload by aggregating the NASA-TLX's component items. Using this practice, one may overlook the distinction between traits and states. METHOD: Fifteen dyadic teams (11 inexperienced, 4 experienced) completed five sessions of a tsunami disaster simulator. After every session, individuals completed a modified version of the NASA-TLX that included team workload measures.We then examined the workload items by using a between-subjects and within-subjects perspective. RESULTS: Between-subjects and within-subjects correlations among the items indicated the workload items are more independent within subjects (as states) than between subjects (as traits). Correlations between the workload items and simulation performance were also different at the trait and state levels. CONCLUSION: Workload may behave differently at trait (between-subjects) and state (within-subjects) levels. APPLICATION: Researchers interested in workload measurement as a state should take a within-subjects perspective in their analyses.

Physio-behavioral coupling in a cooperative team task: contributors and relations.

Research indicates that coactors performing cooperative tasks often exhibit spontaneous and unintended similarities in their physiological and behavioral responses--a phenomenon referred to here as physio-behavioral coupling (PBC). The purpose of this research was to identify contributors to PBC; examine relationships between PBC, team performance, and perceived team attributes (e.g., cohesion, trust); and compare a set of time-series measures(cross-correlation [CC], cross-recurrence quantification analysis [CRQA], and cross-fuzzy entropy [CFEn]) in their characterization of PBC across comparisons. To accomplish this, PBC was examined in human postural sway (PS) and cardiac interbeat intervals (IBIs) from dyadic teams performing a fast-paced puzzle task (Quadra--a variant of the video game Tetris). Results indicated that observed levels of PBC were not a chance occurrence, but instead driven by features of the team-task environment, and that PBC was likely influenced by similar individual task demands and interpersonal coordination dynamics that were not "unique" to a particular team. Correlation analysis revealed that PBC exhibited negative relationships with team performance and team attributes, which were interpreted to reflect complementary coordination (as opposed to mimicry) during task performance, potentially due to differentiated team roles. Finally, qualitative comparison of time-series measures used to characterize PBC indicated that CRQA percent recurrence and CFEn (both nonlinear measures) settled on mostly analogous characterizations, whereas linear CC did not. The disparity observed between the linear and nonlinear measures highlights underlying computational and interpretational differences between the two families of statistics and supports the use of multiple metrics for characterizing PBC.

Event-related cerebral hemodynamics reveal target-specific resource allocation for both "go" and "no-go" response-based vigilance tasks.

Transcranial Doppler sonography was used to measure cerebral blood flow velocity (CBFV) in the right and left cerebral hemispheres during the performance of a 50-min visual vigilance session. Observers monitored a simulated flight of unmanned aerial vehicles for cases in which one of the vehicles was flying in an inappropriate direction relative to its cohorts. Two types of vigilance tasks were employed: a traditional task in which observers made button press ("go") responses to critical signals, and a modification of the traditional task called the Sustained Attention to Response Task (SART) in which "go" responses acknowledged nonsignal events and response withholding ("no-go") signified signal detection. Signal detections and global CBFV scores declined over time. In addition, fine-grained event-related analyses revealed that the detection of signals was accompanied by an elevation of CBFV that was not present with missed signals. As was the case with the global scores, the magnitude of the transient CBFV increments associated with signal detection also declined over time, and these findings were independent of task type. The results support the view of CBFV as an index of the cognitive evaluation of stimulus significance, and a resource model of vigilance in which the need for continuous attention produces a depletion of information-processing assets that are not replenished as the task progresses. Further, temporal declines in the magnitude of event-related CBFV in response to critical signals only is evidence that the decrement function in vigilance is due to attentional processing and not specific task elements such as the required response format.

Conceptualization and measurement of team workload: a critical need.

OBJECTIVE: The purpose of this article is to present and expand on current theories and measurement techniques for assessing team workload. BACKGROUND: To date, little research has been conducted on the workload experienced by teams. A validated theory describing team workload, which includes an account of its relation to individual workload, has not been articulated. METHOD: The authors review several theoretical approaches to team workload.Within the team research literature, attempts to evaluate team workload have typically relied on measures of individual workload. This assumes that such measures retain their validity at the team level of measurement, but empirical research suggests that this method may lack sensitivity to the drivers of team workload. RESULTS: On the basis of these reviews, the authors advance suggestions concerning a comprehensive theory of team workload and methods for assessing it in team settings. The approaches reviewed include subjective, performance, physiological, and strategy shift measures. Theoretical and statistical difficulties associated with aggregating individual-level workload responses to a team-level measure are discussed. CONCLUSION: Conception and measurement of team workload have not significantly matured alongside developments in individual workload. APPLICATION: Team workload remains a complex research area without simple measurement solutions, but as a research domain it remains open for contributions from interested and enterprising researchers.

Use of the RoboFlag synthetic task environment to investigate workload and stress responses in UAV operation.

Use of unmanned aerial vehicles (UAVs) is an increasingly important element of military missions. However, controlling UAVs may impose high stress and workload on the operator. This study evaluated the use of the RoboFlag simulated environment as a means for profiling multiple dimensions of stress and workload response to a task requiring control of multiple vehicles (robots). It tested the effects of two workload manipulations, environmental uncertainty (i.e., UAV's visual view area) and maneuverability, in 64 participants. The findings confirmed that the task produced substantial workload and elevated distress. Dissociations between the stress and performance effects of the manipulations confirmed the utility of a multivariate approach to assessment. Contrary to expectations, distress and some aspects of workload were highest in the low-uncertainty condition, suggesting that overload of information may be an issue for UAV interface designers. The strengths and limitations of RoboFlag as a methodology for investigating stress and workload responses are discussed.