Should I stay or should I go? The cerebral bases of street-crossing decision.

An observer willing to cross a street must first estimate if the approaching cars offer enough time to safely complete the task. The brain areas supporting this perception, known as Time-To-Contact (TTC) perception, have been mainly studied through noninvasive correlational approaches. We carried out an experiment in which patients were tested during an awake brain surgery electrostimulation mapping to examine the causal implication of various brain areas in the street-crossing decision process. Forty patients were tested in a gap acceptance task before their surgery to establish a baseline performance. The task was individually adapted upon this baseline level and carried out during their surgery. We acquired and normalized to MNI space the coordinates of the functional areas that influenced task performance. A total of 103 stimulation sites were tested, allowing to establish a large map of the areas involved in the street-crossing decision. Multiple sites were found to impact the gap acceptance decision. A direct implication was however found mostly for sites within the right parietal lobe, while indirect implication was found for sites within the language, motor, or attentional networks. The right parietal lobe can be considered as causally influencing the gap acceptance decision. Other positive sites were all accompanied with dysfunction in other cognitive functions, and therefore should probably not be considered as the site of TTC estimation.

Mind over muscle? Time manipulation improves physical performance by slowing down the neuromuscular fatigue accumulation.

While physical performance has long been thought to be limited only by physiological factors, many experiments denote that psychological ones can also influence it. Specifically, the deception paradigm investigates the effect of psychological factors on performance by manipulating a psychological variable unbeknownst to the subjects. For example, during a physical exercise performed to failure, previous results revealed an improvement in performance (i.e., holding time) when the clock shown to the subjects was deceptively slowed down. However, the underlying neurophysiological changes supporting this performance improvement due to deceptive time manipulation remain unknown. Here, we addressed this issue by investigating from a neuromuscular perspective the effect of a deceptive clock manipulation on a single-joint isometric task conducted to failure in 24 healthy participants (11 females). Neuromuscular fatigue was assessed by pre- to post-exercise changes in quadriceps maximal voluntary torque (Tmax ), voluntary activation level (VAL), and potentiated twitch (TTW ). Our main results indicated a significant performance improvement when the clock was slowed down (Biased: 356 ± 118 s vs. Normal: 332 ± 112 s, p = .036) but, surprisingly, without any difference in the associated neuromuscular fatigue (p > .05 and BF < 0.3 for Tmax , VAL, and TTW between both sessions). Computational modeling showed that, when observed, the holding time improvement was explained by a neuromuscular fatigue accumulation based on subjective rather than actual time. These results support a psychological influence on neuromuscular processes and contribute significantly to the literature on the mind-body influence, by challenging our understanding of fatigue.

Processing of translational, radial and rotational optic flow in older adults.

Aging impacts human observer's performance in a wide range of visual tasks and notably in motion discrimination. Despite numerous studies, we still poorly understand how optic flow processing is impacted in healthy older adults. Here, we estimated motion coherence thresholds in two groups of younger (age: 18-30, n = 42) and older (70-90, n = 42) adult participants for the three components of optic flow (translational, radial and rotational patterns). Stimuli were dynamic random-dot kinematograms (RDKs) projected on a large screen. Participants had to report their perceived direction of motion (leftward versus rightward for translational, inward versus outward for radial and clockwise versus anti-clockwise for rotational patterns). Stimuli had an average speed of 7°/s (additional recordings were performed at 14°/s) and were either presented full-field or in peripheral vision. Statistical analyses showed that thresholds in older adults were similar to those measured in younger participants for translational patterns, thresholds for radial patterns were significantly increased in our slowest condition and thresholds for rotational patterns were significantly decreased. Altogether, these findings support the idea that aging does not lead to a general decline in visual perception but rather has specific effects on the processing of each optic flow component.

Hand movements influence the perception of time in a prediction motion task.

Human perception of time is far from accurate and is subject to distortions. Previous research has demonstrated that any manipulation that distorts the perceived velocity of visible moving objects may shift prediction motion (PM) performance during occlusion. However, it is not clear whether motor action has the same influence during occlusion in the PM task. This work evaluated the influence of action on PM performance in two experiments. In both cases, participants performed an interruption paradigm, evaluating if an occluded object had reappeared earlier or later than expected. This task was done simultaneously with a motor action. In Experiment 1, we compared the PM performance according to the timing of the action made while the object was still visible or occluded. In Experiment 2, participants had to perform (or not) a motor action if the target was green (or red). In both experiments, our results showed that the duration of the object's occlusion was underestimated in the specific case of acting during the occlusion period. These results suggest that action and temporal perception share similar neural bases. Future research is needed to confirm this hypothesis.

Event-Based Trajectory Prediction Using Spiking Neural Networks.

In recent years, event-based sensors have been combined with spiking neural networks (SNNs) to create a new generation of bio-inspired artificial vision systems. These systems can process spatio-temporal data in real time, and are highly energy efficient. In this study, we used a new hybrid event-based camera in conjunction with a multi-layer spiking neural network trained with a spike-timing-dependent plasticity learning rule. We showed that neurons learn from repeated and correlated spatio-temporal patterns in an unsupervised way and become selective to motion features, such as direction and speed. This motion selectivity can then be used to predict ball trajectory by adding a simple read-out layer composed of polynomial regressions, and trained in a supervised manner. Hence, we show that a SNN receiving inputs from an event-based sensor can extract relevant spatio-temporal patterns to process and predict ball trajectories.

Time-to-contact perception in the brain.

Time-to-contact (TTC) perception refers to the ability of an observer to estimate the remaining time before an object reaches a point in the environment, and is of crucial importance in daily life. Noninvasive correlational approaches have identified several brain areas sensitive to TTC information. Here we report the results of two studies, including one during an awake brain surgery, that aimed to identify the specific areas causally engaged in the TTC estimation process. In Study 1, we tested 40 patients with brain tumor in a TTC estimation task. The results showed that four of the six patients with impaired performance had tumors in right upper parietal cortex, although this tumoral location represented only six over 40 patients. In Study 2, 15 patients underwent awake brain surgery electrostimulation mapping to examine the implication of various brain areas in the TTC estimation process. We acquired and normalized to MNI space the coordinates of the functional areas that influenced task performance. Our results seem to demonstrate that the early stage of the TTC estimation process involved specific cortical territories in the ventral region of the right intraparietal sulcus. Downstream processing of TTC could also involve the frontal eye field (middle frontal gyrus) related to ocular search. We also found that deactivating language areas in the left hemisphere interfered with the TTC estimation process. These findings demonstrate a fine grained, cortical representation of TTC processing close to the ventral right intraparietal sulcus and complement those described in other human studies.

Availability of attention affects time-to-contact estimation.

To estimate the time-to-contact (TTC) of a moving object, numerous studies have focused on the type of information or gaze strategy used by the observer. However, it remains to be determined whether and how attention could affect TTC estimation. In particular, how does TTC estimation operate when less attention is available? To answer this question, we conducted two experiments in which the participants had to perform an absolute (Experiment 1) or relative (Experiment 2) prediction-motion task, either alone (i.e., in single-task condition) or along with a secondary, visual working-memory task (i.e., in dual-task condition). In both experiments, we found that TTC estimation was superior in dual-task condition relative to single-task condition. This finding suggests that the reduction of available attention actually improves TTC estimation. We discuss possible explanations as well as theoretical implications for this seemingly counter-intuitive finding. Further research is needed to investigate if (in)attention facilitates or only shifts TTC estimation.

The detrimental influence of attention on time-to-contact perception.

To which extent is attention necessary to estimate the time-to-contact (TTC) of a moving object, that is, determining when the object will reach a specific point? While numerous studies have aimed at determining the visual cues and gaze strategy that allow this estimation, little is known about if and how attention is involved or required in this process. To answer this question, we carried out an experiment in which the participants estimated the TTC of a moving ball, either alone (single-task condition) or concurrently with a Rapid Serial Visual Presentation task embedded within the ball (dual-task condition). The results showed that participants had a better estimation when attention was driven away from the TTC task. This suggests that drawing attention away from the TTC estimation limits cognitive interference, intrusion of knowledge, or expectations that significantly modify the visually-based TTC estimation, and argues in favor of a limited attention to correctly estimate the TTC.

Asymmetrical time-to-contact error with two moving objects persists across different vertical separations.

When human observers estimate the time-to-contact (TTC) of more than one object there is an asymmetric pattern of error consistent with prioritizing the lead object at the expense of the trail object. Here, we examined TTC estimation in a prediction motion task where two objects moved along horizontal trajectories (5 or 7.5 °/s) that had different vertical separation, and thus placed specific demands on visuospatial attention. Results showed that participants were able to accurately judge arrival order, irrespective of vertical separation, in all but two conditions where the object trajectories crossed close to the arrival location. Constant error was significantly higher for the object that trailed, as opposed to led, by 250 or 500 ms. Asymmetry in constant error between the lead and trail object was not influenced by vertical separation, and was also evident across a range of arrival times. However, while the lag between the two consecutive TTC estimations was scaled to the actual difference in object arrival times, lag did increase with vertical separation. Taken together, our results confirm that TTC estimation of two moving objects in the prediction motion task suffers from an asymmetrical interference, which is likely related to factors that influence attentional allocation.

Effects of hand configuration on muscle force coordination, co-contraction and concomitant intermuscular coupling during maximal isometric flexion of the fingers.

PURPOSE: The mechanisms governing the control of musculoskeletal redundancy remain to be fully understood. The hand is highly redundant, and shows different functional role of extensors according to its configuration for a same functional task of finger flexion. Through intermuscular coherence analysis combined with hand musculoskeletal modelling during maximal isometric hand contractions, our aim was to better understand the neural mechanisms underlying the control of muscle force coordination and agonist-antagonist co-contraction. METHODS: Thirteen participants performed maximal isometric flexions of the fingers in two configurations: power grip (Power) and finger-pressing on a surface (Press). Hand kinematics and force/moment measurements were used as inputs in a musculoskeletal model of the hand to determine muscular tensions and co-contraction. EMG-EMG coherence analysis was performed between wrist and finger flexors and extensor muscle pairs in alpha, beta and gamma frequency bands. RESULTS: Concomitantly with tailored muscle force coordination and increased co-contraction between Press and Power (mean difference: 48.08%; p < 0.05), our results showed muscle-pair-specific modulation of intermuscular coupling, characterized by pair-specific modulation of EMG-EMG coherence between Power and Press (p < 0.05), and a negative linear association between co-contraction and intermuscular coupling for the ECR/FCR agonist-antagonist muscle pair (r = - 0.65; p < 0.05). CONCLUSIONS: This study brings new evidence that pair-specific modulation of EMG-EMG coherence is related to modulation of muscle force coordination during hand contractions. Our results highlight the functional importance of intermuscular coupling as a mechanism contributing to the control of muscle force synergies and agonist-antagonist co-contraction.

Asymmetric interference in concurrent time-to-contact estimation: Cousin or twin of the psychological refractory period effect?

In a reaction time (RT) task requiring fast responses to two stimuli presented close in time, human observers show a delayed RT to the second stimulus. This phenomenon has been attributed to a psychological refractory period (PRP). A similar asymmetric interference is found when performing multiple concurrent visual time-to-contact (TTC) estimations for moving objects, despite important differences between the tasks. In the present study, we studied the properties of the asymmetric interference found in the TTC task and compared them to the classical PRP effect. In Experiment 1, we varied the time interval between the two objects' arrival times to determine the dependence of the PRP-like effect on the asynchrony between the two TTCs. In Experiment 2, we investigated whether the physical or the perceived arrival order determined the asymmetric interference. Our results confirmed the existence of asymmetric interference in the multiple TTC estimation task, but also indicated important differences from the traditional PRP effect observed in the RT paradigm. The origins of these differences are discussed, as well as the practical implications.

The embodied dynamics of perceptual causality: a slippery slope?

In Michotte's launching displays, while the launcher (object A) seems to move autonomously, the target (object B) seems to be displaced passively. However, the impression of A actively launching B does not persist beyond a certain distance identified as the "radius of action" of A over B. If the target keeps moving beyond the radius of action, it loses its passivity and seems to move autonomously. Here, we manipulated implied friction by drawing (or not) a surface upon which A and B are traveling, and by varying the inclination of this surface in screen- and earth-centered reference frames. Among 72 participants (n = 52 in Experiment 1; n = 20 in Experiment 2), we show that both physical embodiment of the event (looking straight ahead at a screen displaying the event on a vertical plane vs. looking downwards at the event displayed on a horizontal plane) and contextual information (objects moving along a depicted surface or in isolation) affect interpretation of the event and modulate the radius of action of the launcher. Using classical mechanics equations, we show that representational consistency of friction from radius of action responses emphasizes the embodied nature of frictional force in our cognitive architecture.

Temporal estimation with two moving objects: overt and covert pursuit.

The current study examined temporal estimation in a prediction motion task where participants were cued to overtly pursue one of two moving objects, which could either arrive first, i.e., shortest [time to contact (TTC)] or second (i.e., longest TTC) after a period of occlusion. Participants were instructed to estimate TTC of the first-arriving object only, thus making it necessary to overtly pursue the cued object while at the same time covertly pursuing the other (non-cued) object. A control (baseline) condition was also included in which participants had to estimate TTC of a single, overtly pursued object. Results showed that participants were able to estimate the arrival order of the two objects with very high accuracy irrespective of whether they had overtly or covertly pursued the first-arriving object. However, compared to the single-object baseline, participants' temporal estimation of the covert object was impaired when it arrived 500 ms before the overtly pursued object. In terms of eye movements, participants exhibited significantly more switches in gaze location during occlusion from the cued to the non-cued object but only when the latter arrived first. Still, comparison of trials with and without a switch in gaze location when the non-cued object arrived first indicated no advantage for temporal estimation. Taken together, our results indicate that overt pursuit is sufficient but not necessary for accurate temporal estimation. Covert pursuit can enable representation of a moving object's trajectory and thereby accurate temporal estimation providing the object moves close to the overt attentional focus.

Predicting where a ball will land: from thrower's body language to ball's motion.

To predict where a thrown ball will land, an observer may use visual information about its trajectory. However, in addition, the thrower's body language (i.e., body movement and facial expression) may contain useful information that could be used by the observer to understand intention and emotional state. Here, we investigated how observers estimated a ball's landing point thrown by a virtual agent with different amounts of information from body language. In addition, occlusion time was varied to examine how it potentiates the use of body-language information. Results showed that body movement and facial expression carry information about thrower's effort. However, once the ball has left the thrower's hand, advance information on facial expression does contribute to judgments only if consistent with the amplitude of the throw. Moreover, as the occlusion time increases, a stronger influence of the body movement is observed for estimating the landing point. The overriding effect of ball's trajectory availability over body language is discussed.

Arrival-time judgments on multiple-lane streets: The failure to ignore irrelevant traffic.

How do road users decide whether or not they have enough time to cross a multiple-lane street with multiple approaching vehicles? Temporal judgments have been investigated for single cars approaching an intersection; however, close to nothing is known about how street crossing decisions are being made when several vehicles are simultaneously approaching in two adjacent lanes. This task is relatively common in urban environments. We report two simulator experiments in which drivers had to judge whether it would be safe to initiate street crossing in such cases. Matching traffic gaps (i.e., the temporal separation between two consecutive vehicles) were presented either with cars approaching on a single lane or with cars approaching on two adjacent lanes, either from the same side (Experiment 1) or from the opposite sides (Experiment 2). The stimuli were designed such that only the shortest gap was decision-relevant. The results showed that when the two gaps were in sight simultaneously (Experiment 1), street-crossing decisions were also influenced by the decision-irrelevant longer gap. Observers were more willing to cross the street when they had access to information about the irrelevant gap. However, when the two gaps could not be seen simultaneously but only sequentially (Experiment 2), only the shorter and relevant gap influenced the street-crossing decisions. The results are discussed within the framework of perceptual averaging processes, and practical implications for road safety are presented.

Visual discrimination thresholds for time to arrival.

In a seminal article, Todd (Journal of Experimental Psychology: Human Perception and Performance 7:795-810, 1981) reported a difference threshold of about 50 ms to discriminate the times of arrival of two differently sized objects that simultaneously approached head-on at constant but different velocities. Subsequent investigators, however, have often found much higher thresholds. We did one complete replication of Todd's experiment, and then modified his stimuli and experimental regime, which we hypothesized may have been responsible for some of the discrepancies reported in the literature. Unlike Todd and most other researchers, we exclusively used untrained observers. Several of our participants performed almost as well as the trained observers used by Todd and others, but the performance of most of our participants fell short of this standard. Furthermore, thresholds were affected by the experimental regimes, with large differences between objects' sizes and speeds compromising performance. Analyses of the response patterns revealed that the responses were driven mainly by the objects' relative apparent sizes.

The effect of body posture on long-range time-to-contact estimation.

On Earth, gravity accelerates freely moving objects downward, whereas upward-moving objects are being decelerated. Do humans take internalised knowledge of gravity into account when estimating time-to-contact (TTC, the time remaining before the moving object reaches the observer)? To answer this question, we created a motion-prediction task in which participants saw the initial part of an object's trajectory moving on a collision course prior to an occlusion. Observers had to judge when the object would make contact with them. The visual scene was presented with a head-mounted display. Participants lay either supine (looking up) or prone (looking down), suggestive of the ball either rising up or falling down toward them. Results showed that body posture had a significant effect on time-to-contact estimation, but only when occlusion times were long (2.5 s). The effect was also rather small. This lack of immediacy in the posture effect suggests that TTC estimation is initially robust toward the effect of gravity, which comes to bear only as more time is allowed for post-processing of the visual information.

Temporal-range estimation of multiple objects: evidence for an early bottleneck.

When making parallel time-to-contact (TTC) estimates of two approaching objects, the two respective TTC estimates interfere with one another in an asymmetric fashion. The TTC of the later-arriving object is systematically overestimated, while the estimated TTC for the first-arriving object is as accurate as in a condition presenting only a single object. This asymmetric interference points to a processing bottleneck that could be due to early (e.g., during the estimation of the TTC from the optic flow) or late (e.g., during the timing of the response or the motor execution) constraints in the TTC estimation process. We used a Sperling-like prediction-motion task to differentiate between these two possibilities. Participants produced an absolute estimate of the TTC of only one of two objects approaching a target line. The target object to which the response was to be made was indicated by an auditory cue that occurred either at motion-onset or at the instant at which the two objects disappeared from the screen (occlusion-onset). The cue at motion-onset should disengage visual processing of the irrelevant stimulus. The cue at occlusion-onset, in contrast, requires visual processing of both relevant and irrelevant stimulus until occlusion. A single-object condition was introduced as a control condition. Results show symmetric interference in the motion-onset condition. In the occlusion-onset condition however, the results were congruent with asymmetric interference. Thus, the processing bottleneck in TTC estimation is originating at the earlier stages.

Eye movements influence estimation of time-to-contact in prediction motion.

In many situations, it is necessary to predict when a moving object will reach a given target even though the object may be partially or entirely occluded. Typically, one would track the moving object with eye movements, but it remains unclear whether ocular pursuit facilitates accurate estimation of time-to-contact (TTC). The present study examined this issue using a prediction-motion (PM) task in which independent groups estimated TTC in a condition that required fixation on the arrival location as an object approached, or a condition in which participants were instructed to pursue the moving object. The design included 15 TTC ranging from 0.4 to 1.5 s and three object velocities (2.5, 5, 10 deg/s). Both constant error and variable error in TTC estimation increased as a function of actual TTC. However, for the fixation group only, there was a significant effect of object velocity with a relative overestimation of TTC for the slower velocity and underestimation for the faster velocity. Further analysis indicated that the velocity effect exhibited by the fixation group was consistent with participants exhibiting a relatively constant misperception for each level of object velocity. Overall, these findings show that there is an advantage in the PM task to track the moving object with the eyes. We explain the different pattern of TTC estimation error exhibited when fixating and during pursuit with reference to differences in the available retinal and/or extra-retinal input.

Judging the contact-times of multiple objects: Evidence for asymmetric interference.

The accuracy of time-to-contact (TTC) judgments for single approaching objects is well researched, however, close to nothing is known about our ability to make simultaneous TTC judgments for two or more objects. Such complex judgments are required in many everyday situations, for instance when crossing a multi-lane street or when engaged in multi-player ball games. We used a prediction-motion paradigm in which participants simultaneously estimated the absolute TTC of two objects, and compared the performance to a standard single-object condition. Results showed that the order of arrival of the two objects determined the accuracy of the TTC estimates: Estimation of the first-arriving object was unaffected by the added complexity compared to the one-object condition, whereas the TTC of the second-arriving object was systematically overestimated. This result has broad implications for complex everyday situations. We suggest that it is akin to effects observed in experiments on the psychological refractory period (PRP) and that the proactive interference of the first-arriving object indicates a bottleneck or capacity sharing at the central stage.