Assessment of human expertise and movement kinematics in first-person shooter games.

In contrast to traditional professional sports, there are few standardized metrics in professional esports (competitive multiplayer video games) for assessing a player's skill and ability. We assessed the performance of professional-level players in Aim LabTM, a first-person shooter training and assessment game, with two target-shooting tasks. These tasks differed primarily in target size: the task with large targets provided an incentive to be fast but imprecise and the task with large targets provided an incentive to be precise but slow. Each player's motor acuity was measured by characterizing the speed-accuracy trade-off in shot behavior: shot time (elapsed time for a player to shoot at a target) and shot spatial error (distance from center of a target). We also characterized the fine-grained kinematics of players' mouse movements. Our findings demonstrate that: 1) movement kinematics depended on task demands; 2) individual differences in motor acuity were significantly correlated with kinematics; and 3) performance, combined across the two target sizes, was poorly characterized by Fitts Law. Our approach to measuring motor acuity has widespread applications not only in esports assessment and training, but also in basic (motor psychophysics) and clinical (gamified rehabilitation) research.

Exogenous attention facilitates perceptual learning in visual acuity to untrained stimulus locations and features.

Visual perceptual learning (VPL) refers to the improvement in performance on a visual task due to practice. A hallmark of VPL is specificity, as improvements are often confined to the trained retinal locations or stimulus features. We have previously found that exogenous (involuntary, stimulus-driven) and endogenous (voluntary, goal-driven) spatial attention can facilitate the transfer of VPL across locations in orientation discrimination tasks mediated by contrast sensitivity. Here, we investigated whether exogenous spatial attention can facilitate such transfer in acuity tasks that have been associated with higher specificity. We trained observers for 3 days (days 2-4) in a Landolt acuity task (Experiment 1) or a Vernier hyperacuity task (Experiment 2), with either exogenous precues (attention group) or neutral precues (neutral group). Importantly, during pre-tests (day 1) and post-tests (day 5), all observers were tested with neutral precues; thus, groups differed only in their attentional allocation during training. For the Landolt acuity task, we found evidence of location transfer in both the neutral and attention groups, suggesting weak location specificity of VPL. For the Vernier hyperacuity task, we found evidence of location and feature specificity in the neutral group, and learning transfer in the attention group-similar improvement at trained and untrained locations and features. Our results reveal that, when there is specificity in a perceptual acuity task, exogenous spatial attention can overcome that specificity and facilitate learning transfer to both untrained locations and features simultaneously with the same training. Thus, in addition to improving performance, exogenous attention generalizes perceptual learning across locations and features.

In search of exogenous feature-based attention.

Visual attention prioritizes the processing of sensory information at specific spatial locations (spatial attention; SA) or with specific feature values (feature-based attention; FBA). SA is well characterized in terms of behavior, brain activity, and temporal dynamics-for both top-down (endogenous) and bottom-up (exogenous) spatial orienting. FBA has been thoroughly studied in terms of top-down endogenous orienting, but much less is known about the potential of bottom-up exogenous influences of FBA. Here, in four experiments, we adapted a procedure used in two previous studies that reported exogenous FBA effects, with the goal of replicating and expanding on these findings, especially regarding its temporal dynamics. Unlike the two previous studies, we did not find significant effects of exogenous FBA. This was true (1) whether accuracy or RT was prioritized as the main measure, (2) with precues presented peripherally or centrally, (3) with cue-to-stimulus ISIs of varying durations, (4) with four or eight possible target locations, (5) at different meridians, (6) with either brief or long stimulus presentations, (7) and with either fixation contingent or noncontingent stimulus displays. In the last experiment, a postexperiment participant questionnaire indicated that only a small subset of participants, who mistakenly believed the irrelevant color of the precue indicated which stimulus was the target, exhibited benefits for valid exogenous FBA precues. Overall, we conclude that with the protocol used in the studies reporting exogenous FBA, the exogenous stimulus-driven influence of FBA is elusive at best, and that FBA is primarily a top-down, goal-driven process.

Adjacent Features for High-Density EMG Pattern Recognition.

In the infancy of electromyography (EMG) based pattern recognition (PR) limited numbers of electrode channels were anatomically placed over muscles of interest. Modern methods have shown that regularly spaced electrodes around the circumference of a limb are equally effective and have been demonstrated in consumer-ready myoelectric control systems such as Thalmic Labs' Myo armband. In addition to linear arrays, grid arrays have also been applied in this field of research. Although electrode arrays have mainly been adopted to simplify placement, other benefits will be exploited in this work.Presented in this paper is a novel spatial-temporal feature set that separately analyzes the intensity and structure of the measured electrical signals (MES) and evaluates the similarities between adjacent electrodes, hence the name Adjacent Features (AF). Results in this paper show that AF produced classification accuracies about 4%-6% greater than autoregression (AR) coefficients and Hudgins' time-domain (TD) features for classifying 47 hand and wrist gestures, while having a computational simplicity similar to the TD features.

Endogenous spatial attention during perceptual learning facilitates location transfer.

Covert attention and perceptual learning enhance perceptual performance. The relation between these two mechanisms is largely unknown. Previously, we showed that manipulating involuntary, exogenous spatial attention during training improved performance at trained and untrained locations, thus overcoming the typical location specificity. Notably, attention-induced transfer only occurred for high stimulus contrasts, at the upper asymptote of the psychometric function (i.e., via response gain). Here, we investigated whether and how voluntary, endogenous attention, the top-down and goal-based type of covert visual attention, influences perceptual learning. Twenty-six participants trained in an orientation discrimination task at two locations: half of participants received valid endogenous spatial precues (attention group), while the other half received neutral precues (neutral group). Before and after training, all participants were tested with neutral precues at two trained and two untrained locations. Within each session, stimulus contrast varied on a trial basis from very low (2%) to very high (64%). Performance was fit by a Weibull psychometric function separately for each day and location. Performance improved for both groups at the trained location, and unlike training with exogenous attention, at the threshold level (i.e., via contrast gain). The neutral group exhibited location specificity: Thresholds decreased at the trained locations, but not at the untrained locations. In contrast, participants in the attention group showed significant location transfer: Thresholds decreased to the same extent at both trained and untrained locations. These results indicate that, similar to exogenous spatial attention, endogenous spatial attention induces location transfer, but influences contrast gain instead of response gain.

Simple space-domain features for low-resolution sEMG pattern recognition.

In recent years, low-cost, low-power myoelectric control systems such as the Myo armband from Thalmic Labs have become available and unlocked tremendous possibilities for myoelectric controlled applications. However, due to the embedded system constraints, such sEMG control devices typically samples sEMG signals at a lower frequency. It is in doubt whether existing sEMG feature extraction methods are still valid on such low-resolution sEMG data. In addition, the feature extraction algorithms implemented on embedded devices must have low computational complexity in order to meet the real-time requirement. This paper aims to investigate effective features for low-resolution EMG pattern recognition. In particular, a set of novel computational efficient space-domain (SD) features (referred to as simple SD (SSD) features) have been developed to exploit the spatial relationships of sEMG signals recorded from the sensor array on the Myo armband. The proposed SSD feature set was evaluated with a linear discriminant analysis (LDA)-based classifier on a 9-gesture dataset. The experimental results indicate that using the SSD features increased the classification accuracy by 5% compared to using Hudgins' time-domain features.

Spatial attention is necessary for object-based attention: Evidence from temporal-order judgments.

Attentional selection is a dynamic process that relies on multiple types of representations. That object representations contribute to attentional selection has been known for decades; however, most evidence for this contribution has been gleaned from studies that have relied on various forms of spatial cueing (some endogenous and some exogenous). It has thus remained unclear whether object-based attentional selection is a direct result of spatial cuing, or whether it still emerges without any spatial marker. Here we used a novel method-the temporal-order judgment (TOJ)-to examine whether object-based guidance emerges in the absence of spatial cuing. Participants were presented with two rectangles oriented either horizontally or vertically. Following a 150-ms preview time, two target stimuli were presented on the same or on different objects, and participants were asked to report which of the two stimuli had appeared first. The targets consisted of stimuli that formed a percept of a "hole" or a "hill." First, we demonstrated that the "hill" target was indeed processed faster, as evidenced by a positive perceived simultaneity (PSS) measure. We then demonstrated that if two targets appeared with equal probabilities on the same and on different objects, the PSS values, although positive, were not modulated by the objects. In a subsequent set of experiments, we showed that objects can modulate attentional allocation-however, only when they are biased by a spatial (endogenous) cue. In other words, in the absence of a spatial cue or bias, object representations do not guide attentional selection. In addition to providing new constraints for theories of object-based attentional guidance, these experiments introduce a novel paradigm for measuring object-based attentional effects.

Exogenous attention facilitates location transfer of perceptual learning.

Perceptual skills can be improved through practice on a perceptual task, even in adulthood. Visual perceptual learning is known to be mostly specific to the trained retinal location, which is considered as evidence of neural plasticity in retinotopic early visual cortex. Recent findings demonstrate that transfer of learning to untrained locations can occur under some specific training procedures. Here, we evaluated whether exogenous attention facilitates transfer of perceptual learning to untrained locations, both adjacent to the trained locations (Experiment 1) and distant from them (Experiment 2). The results reveal that attention facilitates transfer of perceptual learning to untrained locations in both experiments, and that this transfer occurs both within and across visual hemifields. These findings show that training with exogenous attention is a powerful regime that is able to overcome the major limitation of location specificity.