Auditory neural correlates and neuroergonomics of driving assistance in a simulated virtual environment.

Objective.Driver assistance systems play an increasingly important role in modern vehicles. In the current level of technology, the driver must continuously supervise the driving and intervene whenever necessary when using driving assistance systems. The driver's attentiveness plays an important role in this human-machine interaction. Our aim was to design a simplistic technical framework for studying neural correlates of driving situations in a functional magnetic resonance imaging (fMRI) setting. In this work we assessed the feasibility of our proposed platform.Methods.We proposed a virtual environment (VE) simulation of driver assistance as a framework to investigate brain states related to partially automated driving. We focused on the processing of auditory signals during different driving scenarios as they have been shown to be advantageous as warning stimuli in driving situations. This provided the necessary groundwork to study brain auditory attentional networks under varying environmental demands in an fMRI setting. To this end, we conducted a study with 20 healthy participants to assess the feasibility of the VE simulation.Results.We demonstrated that the proposed VE can elicit driving related brain activation patterns. Relevant driving events evoked, in particular, responses in the bilateral auditory, sensory-motor, visual and insular cortices, which are related to perceptual and behavioral processes during driving assistance. Conceivably, attentional mechanisms increased somatosensory integration and reduced interoception, which are relevant for requesting interactions during partially automated driving.Significance.In modern vehicles, driver assistance technologies are playing an increasingly prevalent role. It is important to study the interaction between these systems and drivers' attentional responses to aid in future optimizations of the assistance systems. The proposed VE provides a foundational first step in this endeavor. Such simulated VEs provide a safe setting for experimentation with driving behaviors in a semi-naturalistic environment.

Knowing what's coming: Anticipatory audio cues can mitigate motion sickness.

Being able to anticipate upcoming motion is known to potentially mitigate sickness resulting from provocative motion. We investigated whether auditory cues could increase anticipation and subsequently reduce motion sickness. Participants (N = 20) were exposed on a sled on a rail track to two 15-min conditions. Both were identical in terms of motion, being composed of the same repeated 9 m fore-aft displacements, with a semi-random timing of pauses and direction. The auditory cues were either 1) informative on the timing and direction of the upcoming motion, or 2) non-informative. Illness ratings were recorded at 1-min intervals using a 11-point scale. After exposure, average illness ratings were significantly lower for the condition that contained informative auditory cues, as compared to the condition without informative cues. This knowledge, i.e. that auditory signals can improve anticipation to motion, could be of importance in reducing carsickness in domains such as that of autonomous vehicles.

Knowing What's Coming: Unpredictable Motion Causes More Motion Sickness.

OBJECTIVE: This study explores the role of anticipation in motion sickness. We compared three conditions varying in motion predictability and assessed the effect of anticipation on subsequent illness ratings using a within-subjects design. BACKGROUND: Anticipation is thought to play a role in motion sickness by reducing the discrepancy between sensed and expected sensory information. However, both the exact role and potential magnitude of anticipation on motion sickness are unknown. METHOD: Participants (N = 17) were exposed to three 15-min conditions consisting of repeated fore-aft motion on a sled on a 40-m rail (1) at constant intervals and consistent motion direction, (2) at constant intervals but varied motion direction, and (3) at varied intervals but consistent motion direction. Conditions were otherwise identical in motion intensity and displacement, as they were composed of the same repetitions of identical blocks of motion. Illness ratings were recorded at 1-min intervals using an 11-point motion sickness scale. RESULTS: Average illness ratings after exposure were significantly lower for the predictable condition, compared with both the directionally unpredictable condition and the temporally unpredictable condition. CONCLUSION: Unpredictable motion is significantly more provocative compared with predictable motion. Findings suggest motion sickness results from a discrepancy between sensed and expected motion, rather than from unpreparedness to motion. APPLICATION: This study underlines the importance of an individual's anticipation to motion in motion sickness. Furthermore, this knowledge could be used in domains such as that of autonomous vehicles to reduce carsickness.

The role of self-regulation in the context of driver distraction: A simulator study.

OBJECTIVE: There is considerable evidence for the negative effects of driver distraction on road safety. In many experimental studies, drivers have been primarily viewed as passive receivers of distraction. Thus, there is a lack of research on the mediating role of their self-regulatory behavior. The aim of the current study was to compare drivers' performance when engaged in a system-paced secondary task with a self-paced version of this task and how both differed from baseline driving performance without distraction. METHODS: Thirty-nine participants drove in a simulator while performing a secondary visual-manual task. One group of drivers had to work on this task in predefined situations under time pressure, whereas the other group was free to decide when to work on the secondary task (self-regulation group). Drivers' performance (e.g., lateral and longitudinal control, brake reaction times) was also compared with a baseline condition without any secondary task. RESULTS: For the system-paced secondary task, distraction was associated with high decrements in driving performance (especially in keeping the lateral position). No effects were found for the number of collisions, probably because of the lower driving speeds while distracted (compensatory behavior). For the self-regulation group, only small impairments in driving performance were found. Drivers engaged less in the secondary task during foreseeable demanding or critical driving situations. CONCLUSIONS: Overall, drivers in the self-regulation group were able to anticipate the demands of different traffic situations and to adapt their engagement in the secondary task, so that only small impairments in driving performance occurred. Because in real traffic drivers are mostly free to decide when to engage in secondary tasks, it can be concluded that self-regulation should be considered in driver distraction research to ensure ecological validity.

EEG alpha spindle measures as indicators of driver fatigue under real traffic conditions.

OBJECTIVE: The purpose of this study is to show the effectiveness of EEG alpha spindles, defined by short narrowband bursts in the alpha band, as an objective measure for assessing driver fatigue under real driving conditions. METHODS: An algorithm for the identification of alpha spindles is described. The performance of the algorithm is tested based on simulated data. The method is applied to real data recorded under real traffic conditions and compared with the performance of traditional EEG fatigue measures, i.e. alpha-band power. As a highly valid fatigue reference, the last 20 min of driving from participants who aborted the drive due to heavy fatigue were used in contrast to the initial 20 min of driving. RESULTS: Statistical analysis revealed significant increases from the first to the last driving section of several alpha spindle parameters and among all traditional EEG frequency bands, only of alpha-band power; with larger effect sizes for the alpha spindle based measures. An increased level of fatigue over the same time periods for drop-outs, as compared to participants who did not abort the drive, was observed only by means of alpha spindle parameters. CONCLUSIONS: EEG alpha spindle parameters increase both fatigue detection sensitivity and specificity as compared to EEG alpha-band power. SIGNIFICANCE: It is demonstrated that alpha spindles are superior to EEG band power measures for assessing driver fatigue under real traffic conditions.

Drivers' misjudgement of vigilance state during prolonged monotonous daytime driving.

To investigate the effects of monotonous daytime driving on vigilance state and particularly the ability to judge this state, a real road driving study was conducted. To objectively assess vigilance state, performance (auditory reaction time) and physiological measures (EEG: alpha spindle rate, P3 amplitude; ECG: heart rate) were recorded continuously. Drivers judged sleepiness, attention to the driving task and monotony retrospectively every 20 min. Results showed that prolonged daytime driving under monotonous conditions leads to a continuous reduction in vigilance. Towards the end of the drive, drivers reported a subjectively improved vigilance state, which was contrary to the continued decrease in vigilance as indicated by all performance and physiological measures. These findings indicate a lack of self-assessment abilities after approximately 3h of continuous monotonous daytime driving.