Danger, high voltage! Using EEG and EOG measurements for cognitive overload detection in a simulated industrial context.

Industrial settings will be characterized by far-reaching production automation brought about by advancements in robotics and artificial intelligence. As a consequence, human assembly workers will need to adapt quickly to new and more complex assembly procedures, which are most likely to increase cognitive workload, or potentially induce overload. Measurement and optimization protocols need to be developed in order to be able to monitor workers' cognitive load. Previous studies have used electroencephalographic (EEG, measuring brain activity) and electrooculographic (EOG, measuring eye movements) signals, using basic computer-based static tasks and without creating an experience of overload. In this study, EEG and EOG data was collected of 46 participants performing an ecologically valid assembly task while inducing three levels of cognitive load (low, high and overload). The lower individual alpha frequency (IAF) was identified as a promising marker for discriminating between different levels of cognitive load and overload.

Development and validation of a behavioural video coding scheme for detecting mental workload in manual assembly.

Manual assembly in the future Industry 4.0 workplace will put high demands on operators' cognitive processing. The development of mental workload (MWL) measures therefore looms large. Physiological gauges such as electroencephalography (EEG) show promising possibilities, but still lack sufficient reliability when applied in the field. This study presents an alternative measure with a substantial ecological validity. First, we developed a behavioural video coding scheme identifying 11 assembly behaviours potentially revealing MWL being too high. Subsequently, we explored its validity by analysing videos of 24 participants performing a high and a low complexity assembly. Results showed that five of the behaviours identified, such as freezing and the amount of part rotations, significantly differed in occurrence and/or duration between the two conditions. The study hereby proposes a novel and naturalistic method that could help practitioners to map and redesign critical assembly phases, and researchers to enrich validation of MWL-measures through measurement triangulation. Practitioner summary: Current physiological mental workload (MWL) measures still lack sufficient reliability when applied in the field. Therefore, we identified several observable assembly behaviours that could reveal MWL being too high. The results propose a method to map MWL by observing specific assembly behaviours such as freezing and rotating parts. Abbreviations: MWL: mental workload; EEG: electroencephalography; fNIRS: functional near infrared spectroscopy; AOI: area of interest; SMI: SensoMotoric Instruments, ETG: Eye-Tracking Glasses; FPS: frames per second; BORIS: Behavioral Observation Research Interactive Software; IRR: inter-rater reliability; SWAT: Subjective Workload Assessment Technique; NASA-TLX: National Aeronautics and Space Administration Task Load Index; EL: emotional load; DSSQ: Dundee Stress State Questionnaire; PHL: physical load; SBO: Strategisch Basis Onderzoek.