Dynamics in typewriting performance reflect mental fatigue during real-life office work.

Mental fatigue has repeatedly been associated with decline in task performance in controlled situations, such as the lab, and in less controlled settings, such as the working environment. Given that a large number of factors can influence the course of mental fatigue, it is challenging to objectively and unobtrusively monitor mental fatigue on the work floor. We aimed to provide a proof of principle of a method to monitor mental fatigue in an uncontrolled office environment, and to study how typewriting dynamics change over different time-scales (i.e., time-on-task, time-of-day, day-of-week). To investigate this, typewriting performance of university employees was recorded for 6 consecutive weeks, allowing not only to examine performance speed, but also providing a natural setting to study error correction. We show that markers derived from typewriting are susceptible to changes in behavior related to mental fatigue. In the morning, workers first maintain typing speed during prolonged task performance, which resulted in an increased number of typing errors they had to correct. During the day, they seemed to readjust this strategy, reflected in a decline in both typing speed and accuracy. Additionally, we found that on Mondays and Fridays, workers adopted a strategy that favored typing speed, while on the other days of the week typing accuracy was higher. Although workers are allowed to take breaks, mental fatigue builds up during the day. Day-to-day patterns show no increase in mental fatigue over days, indicating that office workers are able to recover from work-related demands after a working day.

Age Modulates the Effects of Mental Fatigue on Typewriting.

In the present study, we examined whether age influences the effects of mental fatigue on task performance, and if we could validate the use of measures based on typing behavior as an index of the effects of mental fatigue on different aspects of cognition. Young (N = 24, 18-30 years) and middle-aged (N = 24, 50-67 years) participants performed a typewriting task and a mouse targeting task for 120 min. At the beginning and at the end of the experiment the level of subjective fatigue was assessed. During task performance measures based on typing behavior and EEG were recorded. Results showed that subjective fatigue increased over the experiment in both the young and the middle-aged group. Typing speed decreased with time-on-task (ToT) in both age groups, reflected in larger general interkey intervals and in an increase in typing time. In addition, typing accuracy decreased with ToT in the young group, however, not in the middle-aged group, reflected by an increase in typing errors. Moreover, the young group used the backspace key more often with ToT due to delayed error-correction, reflected in larger backspace sequences, resulting in larger interkey intervals and increased typing time. This effect was absent in the middle-aged group. In the young group, the P3 brain potential amplitude decreased over the experiment, which was related to an increase in typing time, longer general interkey intervals, and an increase in typing errors, suggesting that decreased task engagement was related to less efficient typewriting, at least in the young group. These results indicate that measures based on typing behavior could give information about the process of mental fatigue, and in addition suggest that age influences the effect of mental fatigue on typewriting. More specifically, younger adults more often adopt a strategy that emphasizes speed, while middle-aged adults act more error-aversive than younger adults.

Corrigendum: Investigating Emotional Top Down Modulation of Ambiguous Faces by Single Pulse TMS on Early Visual Cortices.

[This corrects the article on p. 305 in vol. 10, PMID: 27445674.].

Brain Potentials Highlight Stronger Implicit Food Memory for Taste than Health and Context Associations.

Increasingly consumption of healthy foods is advised to improve population health. Reasons people give for choosing one food over another suggest that non-sensory features like health aspects are appreciated as of lower importance than taste. However, many food choices are made in the absence of the actual perception of a food's sensory properties, and therefore highly rely on previous experiences of similar consumptions stored in memory. In this study we assessed the differential strength of food associations implicitly stored in memory, using an associative priming paradigm. Participants (N = 30) were exposed to a forced-choice picture-categorization task, in which the food or non-food target images were primed with either non-sensory or sensory related words. We observed a smaller N400 amplitude at the parietal electrodes when categorizing food as compared to non-food images. While this effect was enhanced by the presentation of a food-related word prime during food trials, the primes had no effect in the non-food trials. More specifically, we found that sensory associations are stronger implicitly represented in memory as compared to non-sensory associations. Thus, this study highlights the neuronal mechanisms underlying previous observations that sensory associations are important features of food memory, and therefore a primary motive in food choice.

Trial history effects in stroop task performance are independent of top-down control.

In this study we sought to elucidate what mechanisms underlie the effects of trial history on information processing. We explicitly focused on the contribution of conflict control and S-R binding to sequential trial effects. Performance and brain activity were measured during two hours of continuous Stroop task performance. Mental fatigue, known to influence top-down processing, was used to elucidate separate effects via top-down and bottom-up mechanisms. Here we confirm that performance in the Stroop task is indeed strongly modulated by stimulus history. Performance was affected by the kind of advance information available; dependent on this information adjustments were made, resulting in differential effects of cognitive conflict, and S-R binding on subsequent performance. The influence of mental fatigue on information processing was mainly related to general effects on attention.

What you may not see might slow you down anyway: masked images and driving.

Many theories of driver behaviour suggest that unconscious or implicit emotions play a functional role in the shaping and control of behaviour. This has not been experimentally tested however. Therefore, in this study the effects of emotive masked images on driver behaviour were examined. While driving a simulator, participants were repeatedly exposed to negative or neutral emotionally laden target images that were sandwich masked by emotionally neutral images. These images were encountered across two different trials each of which consisted of 3-4 minutes of driving on a rural road. The results indicate an effect of the negative target images primarily in reducing the extent of familiarisation occurring between the first and second experimental drives. This is evident in a reduced decrease in heart rate and a reduced increase in high band heart rate variability and actual travelling speed from the first to second drives if the negative target image was presented in the second drive. In addition to these findings there was no clear effect of the target image on subjective ratings of effort or feelings of risk. There was however an effect of gender, with the majority of the effects found in the study being limited to the larger female dataset. These findings suggest that unconscious or implicit emotional stimuli may well influence driver behaviour without explicit awareness.

Music alters visual perception.

BACKGROUND: Visual perception is not a passive process: in order to efficiently process visual input, the brain actively uses previous knowledge (e.g., memory) and expectations about what the world should look like. However, perception is not only influenced by previous knowledge. Especially the perception of emotional stimuli is influenced by the emotional state of the observer. In other words, how we perceive the world does not only depend on what we know of the world, but also by how we feel. In this study, we further investigated the relation between mood and perception. METHODS AND FINDINGS: We let observers do a difficult stimulus detection task, in which they had to detect schematic happy and sad faces embedded in noise. Mood was manipulated by means of music. We found that observers were more accurate in detecting faces congruent with their mood, corroborating earlier research. However, in trials in which no actual face was presented, observers made a significant number of false alarms. The content of these false alarms, or illusory percepts, was strongly influenced by the observers' mood. CONCLUSIONS: As illusory percepts are believed to reflect the content of internal representations that are employed by the brain during top-down processing of visual input, we conclude that top-down modulation of visual processing is not purely predictive in nature: mood, in this case manipulated by music, may also directly alter the way we perceive the world.

Act quickly, decide later: long-latency visual processing underlies perceptual decisions but not reflexive behavior.

Humans largely guide their behavior by their visual representation of the world. Recent studies have shown that visual information can trigger behavior within 150 msec, suggesting that visually guided responses to external events, in fact, precede conscious awareness of those events. However, is such a view correct? By using a texture discrimination task, we show that the brain relies on long-latency visual processing in order to guide perceptual decisions. Decreasing stimulus saliency leads to selective changes in long-latency visually evoked potential components reflecting scene segmentation. These latency changes are accompanied by almost equal changes in simple RTs and points of subjective simultaneity. Furthermore, we find a strong correlation between individual RTs and the latencies of scene segmentation related components in the visually evoked potentials, showing that the processes underlying these late brain potentials are critical in triggering a response. However, using the same texture stimuli in an antisaccade task, we found that reflexive, but erroneous, prosaccades, but not antisaccades, can be triggered by earlier visual processes. In other words: The brain can act quickly, but decides late. Differences between our study and earlier findings suggesting that action precedes conscious awareness can be explained by assuming that task demands determine whether a fast and unconscious, or a slower and conscious, representation is used to initiate a visually guided response.

Why do we see what's not there?

Conscious perception is not the result of passively processing sensory input, but to large extent of active inference based on previous knowledge. This process of inference does go astray from time to time, and may lead to illusory perception: sometimes people see things that are not there. In a recent study we have shown that this inference may also be influenced by mood. Here we present some additional data, suggesting that illusory percepts are the result of increased top-down processing, which is normally helpful in detecting real stimuli. Finally, we speculate on a possible function of mood-dependent modulation of this top-down processing in social perception in particular.

Transcranial magnetic stimulation-induced 'visual echoes' are generated in early visual cortex.

Transcranial magnetic stimulation (TMS) of the early visual areas can trigger perception of a flash of light, a so-called phosphene. Here we show that a very brief presentation of a stimulus can modulate features of a subsequent TMS-induced phosphene, to a level that participants mistake phosphenes for real stimuli, inducing 'visual echoes' of a previously seen stimulus. These 'echoes' are modulated by visual context at the moment of magnetic stimulation, showing that they are generated in early visual areas, and that the brain processes these 'echoes' as if they are factually presented stimuli. This shows that TMS can re-activate weak visual representations in early visual areas. Based on the pattern of contextual modulation of visual echoes, we theorize that perception of these echoes is not a passive reactivation of residual activity in early visual cortex, but an active interpretation of the combined activity of TMS-induced neural noise and cortical state.

Long-lasting modulation of feature integration by transcranial magnetic stimulation.

The human brain analyzes a visual object first by basic feature detectors. On the objects way to a conscious percept, these features are integrated in subsequent stages of the visual hierarchy. The time course of this feature integration is largely unknown. To shed light on the temporal dynamics of feature integration, we applied transcranial magnetic stimulation (TMS) to a feature fusion paradigm. In feature fusion, two stimuli which differ in one feature are presented in rapid succession such that they are not perceived individually but as one single stimulus only. The fused percept is an integration of the features of both stimuli. Here, we show that TMS can modulate this integration for a surprisingly long period of time, even though the individual stimuli themselves are not consciously perceived. Hence, our results reveal a long-lasting integration process of unconscious feature traces.

Feedforward and recurrent processing in scene segmentation: electroencephalography and functional magnetic resonance imaging.

In texture segregation, an example of scene segmentation, we can discern two different processes: texture boundary detection and subsequent surface segregation [Lamme, V. A. F., Rodriguez-Rodriguez, V., & Spekreijse, H. Separate processing dynamics for texture elements, boundaries and surfaces in primary visual cortex of the macaque monkey. Cerebral Cortex, 9, 406-413, 1999]. Neural correlates of texture boundary detection have been found in monkey V1 [Sillito, A. M., Grieve, K. L., Jones, H. E., Cudeiro, J., & Davis, J. Visual cortical mechanisms detecting focal orientation discontinuities. Nature, 378, 492-496, 1995; Grosof, D. H., Shapley, R. M., & Hawken, M. J. Macaque-V1 neurons can signal illusory contours. Nature, 365, 550-552, 1993], but whether surface segregation occurs in monkey V1 [Rossi, A. F., Desimone, R., & Ungerleider, L. G. Contextual modulation in primary visual cortex of macaques. Journal of Neuroscience, 21, 1698-1709, 2001; Lamme, V. A. F. The neurophysiology of figure ground segregation in primary visual-cortex. Journal of Neuroscience, 15, 1605-1615, 1995], and whether boundary detection or surface segregation signals can also be measured in human V1, is more controversial [Kastner, S., De Weerd, P., & Ungerleider, L. G. Texture segregation in the human visual cortex: A functional MRI study. Journal of Neurophysiology, 83, 2453-2457, 2000]. Here we present electroencephalography (EEG) and functional magnetic resonance imaging data that have been recorded with a paradigm that makes it possible to differentiate between boundary detection and scene segmentation in humans. In this way, we were able to show with EEG that neural correlates of texture boundary detection are first present in the early visual cortex around 92 msec and then spread toward the parietal and temporal lobes. Correlates of surface segregation first appear in temporal areas (around 112 msec) and from there appear to spread to parietal, and back to occipital areas. After 208 msec, correlates of surface segregation and boundary detection also appear in more frontal areas. Blood oxygenation level-dependent magnetic resonance imaging results show correlates of boundary detection and surface segregation in all early visual areas including V1. We conclude that texture boundaries are detected in a feedforward fashion and are represented at increasing latencies in higher visual areas. Surface segregation, on the other hand, is represented in "reverse hierarchical" fashion and seems to arise from feedback signals toward early visual areas such as V1.

Processing speed in recurrent visual networks correlates with general intelligence.

Studies on the neural basis of general fluid intelligence strongly suggest that a smarter brain processes information faster. Different brain areas, however, are interconnected by both feedforward and feedback projections. Whether both types of connections or only one of the two types are faster in smarter brains remains unclear. Here we show, by measuring visual evoked potentials during a texture discrimination task, that general fluid intelligence shows a strong correlation with processing speed in recurrent visual networks, while there is no correlation with speed of feedforward connections. The hypothesis that a smarter brain runs faster may need to be refined: a smarter brain's feedback connections run faster.

Figure-ground segregation requires two distinct periods of activity in V1: a transcranial magnetic stimulation study.

Discriminating objects from their surroundings by the visual system is known as figure-ground segregation. This process entails two different subprocesses: boundary detection and subsequent surface segregation or 'filling in'. In this study, we used transcranial magnetic stimulation to test the hypothesis that temporally distinct processes in V1 and related early visual areas such as V2 or V3 are causally related to the process of figure-ground segregation. Our results indicate that correct discrimination between two visual stimuli, which relies on figure-ground segregation, requires two separate periods of information processing in the early visual cortex: one around 130-160 ms and the other around 250-280 ms.

Repression of unconscious information by conscious processing: evidence from affective blindsight induced by transcranial magnetic stimulation.

Some patients with a lesion to the primary visual cortex (V1) show "blindsight": the remarkable ability to guess correctly about attributes of stimuli presented to the blind hemifield. Here, we show that blindsight can be induced in normal observers by using transcranial magnetic stimulation of the occipital cortex but exclusively for the affective content of unseen stimuli. Surprisingly, access to the affective content of stimuli disappears upon prolonged task training or when stimulus visibility increases, allegedly increasing the subjects' confidence in their overall performance. This finding suggests that availability of conscious information suppresses access to unconscious information, supporting the idea of consciousness as a repressant of unconscious tendencies.