Measuring Real-Time Team Cognition During Team Training.

OBJECTIVE: A method for detecting real-time changes in team cognition in the form of significant communication reorganizations is described. We demonstrate the method in the context of scenario-based simulation training. BACKGROUND: We present the dynamical view that individual- and team-level aspects of team cognition are temporally intertwined in a team's real-time response to challenging events. We suggest that this real-time response represents a fundamental team cognitive skill regarding the rapidity and appropriateness of the response, and methods and metrics are needed to track this skill. METHOD: Communication data from medical teams (Study 1) and submarine crews (Study 2) were analyzed for significant communication reorganization in response to training events. Mutual information between team members informed post hoc filtering to identify which team members contributed to reorganization. RESULTS: Significant communication reorganizations corresponding to challenging training events were detected for all teams. Less experienced teams tended to show delayed and sometimes ineffective responses that more experienced teams did not. Mutual information and post hoc filtering identified the individual-level inputs driving reorganization and potential mechanisms (e.g., leadership emergence, role restructuring) underlying reorganization. CONCLUSION: The ability of teams to rapidly and effectively reorganize coordination patterns as the situation demands is a team cognitive skill that can be measured and tracked. APPLICATION: Potential applications include team monitoring and assessment that would allow for visualization of a team's real-time response and provide individualized feedback based on team member's contributions to the team response.

Using conversational agents to explain medication instructions to older adults.

In an effort to guide the development of a computer agent (CA)-based adviser system that presents patient-centered language to older adults (e.g., medication instructions in portal environments or smartphone apps), we evaluated 360 older and younger adults' responses to medication information delivered by a set of CAs. We assessed patient memory for medication information, their affective responses to the information, their perception of the CA's teaching effectiveness and expressiveness, and their perceived level of similarity with each CA. Each participant saw CAs varying in appearance and levels of realism (Photo-realistic vs Cartoon vs Emoji, as control condition). To investigate the impact of affective cues on patients, we varied CA message framing, with effects described either as gains of taking or losses of not taking the medication. Our results corroborate the idea that CAs can produce a significant effect on older adults' learning in part by engendering social responses.