Advancing Knowledge on Situation Comprehension in Dynamic Traffic Situations by Studying Eye Movements to Empty Spatial Locations.

OBJECTIVE: This study used the looking-at-nothing phenomenon to explore situation awareness (SA) and the effects of working memory (WM) load in driving situations. BACKGROUND: While driving, people develop a mental representation of the environment. Since errors in retrieving information from this representation can have fatal consequences, it is essential for road safety to investigate this process. During retrieval, people tend to fixate spatial positions of visually encoded information, even if it is no longer available at that location. Previous research has shown that this "looking-at-nothing" behavior can be used to trace retrieval processes. METHOD: In a video-based laboratory experiment with 2 (WM) x 3 (SA level) within-subjects design, participants (N = 33) viewed a reduced screen and evaluated auditory statements relating to different SA levels on previously seen dynamic traffic scenarios while eye movements were recorded. RESULTS: When retrieving information, subjects more frequently fixated emptied spatial locations associated with the information relevant for the probed SA level. The retrieval of anticipations (SA level 3) in contrast to the other SA level information resulted in more frequent gaze transitions that corresponded to the spatial dynamics of future driving behavior. CONCLUSION: The results support the idea that people build a visual-spatial mental image of a driving situation. Different gaze patterns when retrieving level-specific information indicate divergent retrieval processes. APPLICATION: Potential applications include developing new methodologies to assess the mental representation and SA of drivers objectively.

Ambivalence in decision making: An eye tracking study.

An intuition of ambivalence in cognition is particularly strong for complex decisions, for which the merits and demerits of different options are roughly equal but hard to compare. We examined information search in an experimental paradigm which tasked participants with an ambivalent question, while monitoring attentional dynamics concerning the information relevant to each option in different Areas of Interest (AOIs). We developed two dynamical models for describing eye tracking curves, for each response separately. The models incorporated a drift mechanism towards the various options, as in standard drift diffusion theory. In addition, they included a mechanism for intrinsic oscillation, which competed with the drift process and undermined eventual stabilization of the dynamics. The two models varied in the range of drift processes postulated. Higher support was observed for the simpler model, which only included drifts from an uncertainty state to either of two certainty states. In addition, model parameters could be weakly related to the eventual decision, complementing our knowledge of the way eye tracking structure relates to decision (notably the gaze cascade effect).

When the eyes have it and when not: How multiple sources of activation combine to guide eye movements during multiattribute decision making.

Memory plays a major but underexplored role in judgment and decision making (JDM). Studying eye movements-especially how people look at empty spatial locations when retrieving from memory information previously associated with those locations-provides useful information about how memory influences JDM. This so-called looking-at-nothing behavior is thought to reflect memory-driven allocation of attention. However, eye movements are also guided toward salient visual stimuli, such as test items presented on a screen. It is unclear how these multiple sources of activation combine to guide looking-at-nothing in JDM. We investigated this question in two experiments in which participants solved multiattribute categorization tasks using an exemplar-based decision strategy. In the first experiment, we tested how the occurrence and the strength of looking-at-nothing vary with the presentation format and the amount of training participants received. Looking-at-nothing occurred during categorizations when test-item information was presented auditorily and visually, but for the latter only after visual information was removed from the screen. It occurred both when training items were learned by heart and when they were presented 10 times on the screen. A second experiment revealed that an explicit instruction to imagine retrieval-relevant information during categorizations increased looking-at-nothing but did not change the decision-making process. The results shed light on the interaction between eye movements and attention to information in memory during JDM that can be explained in light of a shared priority map in memory. A detailed understanding of this interaction forms the basis for using eye movements to study memory processes in JDM. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Information stored in memory affects abductive reasoning.

Abductive reasoning describes the process of deriving an explanation from given observations. The theory of abductive reasoning (TAR; Johnson and Krems, Cognitive Science 25:903-939, 2001) assumes that when information is presented sequentially, new information is integrated into a mental representation, a situation model, the central data structure on which all reasoning processes are based. Because working memory capacity is limited, the question arises how reasoning might change with the amount of information that has to be processed in memory. Thus, we conducted an experiment (N = 34) in which we manipulated whether previous observation information and previously found explanations had to be retrieved from memory or were still visually present. Our results provide evidence that people experience differences in task difficulty when more information has to be retrieved from memory. This is also evident in changes in the mental representation as reflected by eye tracking measures. However, no differences are found between groups in the reasoning outcome. These findings suggest that individuals construct their situation model from both information in memory as well as external memory stores. The complexity of the model depends on the task: when memory demands are high, only relevant information is included. With this compensation strategy, people are able to achieve similar reasoning outcomes even when faced with tasks that are more difficult. This implies that people are able to adapt their strategy to the task in order to keep their reasoning successful.

Tracing current explanations in memory: A process analysis based on eye-tracking.

Sequential abductive reasoning is the process of finding the best explanation for a set of observations. Explanations can be multicausal and require the retrieval of previously found ones from memory. The theory of abductive reasoning (TAR) allows detailed predictions on what information is stored and retrieved from memory during reasoning. In the research to date, however, these predictions have never been directly tested. In this study, we tested process assumptions such as the construction of a mental representation from TAR using memory indexing, an eye-tracking method that makes it possible to trace the retrieval of explanations currently held in working memory. Gaze analysis revealed that participants encode the presented evidence (i.e., observations) together with possible explanations into memory. When new observations are presented, the previously presented evidence and explanations are retrieved. Observations that are not explained immediately are encoded as abstractly explained. Abstract explanations enter a refinement process in which they become concrete before they enter the situation model. With the memory indexing method, we were able to assess the process of information retrieval in abductive reasoning, which was previously believed to be unobservable. We discuss the results in the light of TAR and other current theories on the diagnostic reasoning process.

Memory shapes judgments: Tracing how memory biases judgments by inducing the retrieval of exemplars.

When making judgments (e.g., about the quality of job candidates) decision makers should ignore salient, but unrepresentative information (e.g., the person's name). However, research suggests that salient information influences judgments, possibly because memories of past encounters with similar information are integrated into the judgment. We studied eye movements to trace the link between the retrieval of past instances and their influence on judgments. Participants were more likely to look at screen locations where exemplars matching items on a name attribute had appeared, suggesting the retrieval of exemplars. Eye movements to exemplar locations predicted judgments, explaining why names influenced judgments. The results provide insights into how exemplars are integrated into the judgment process when assessing memory retrieval online.