A Case Study of the Validity of Web-based Visuomotor Rotation Experiments.

Web-based experiments are gaining momentum in motor learning research because of the desire to increase statistical power, decrease overhead for human participant experiments, and utilize a more demographically inclusive sample population. However, there is a vital need to understand the general feasibility and considerations necessary to shift tightly controlled human participant experiments to an online setting. We developed and deployed an online experimental platform modeled after established in-laboratory visuomotor rotation experiments to serve as a case study examining remotely collected data quality for an 80-min experiment. Current online motor learning experiments have thus far not exceeded 60 min, and current online crowdsourced studies have a median duration of approximately 10 min. Thus, the impact of a longer-duration, web-based experiment is unknown. We used our online platform to evaluate perturbation-driven motor adaptation behavior under three rotation sizes (±10°, ±35°, and ±65°) and two sensory uncertainty conditions. We hypothesized that our results would follow predictions by the relevance estimation hypothesis. Remote execution allowed us to double (n = 49) the typical participant population size from similar studies. Subsequently, we performed an in-depth examination of data quality by analyzing single-trial data quality, participant variability, and potential temporal effects across trials. Results replicated in-laboratory findings and provided insight on the effect of induced sensory uncertainty on the relevance estimation hypothesis. Our experiment also highlighted several specific challenges associated with online data collection including potentially smaller effect sizes, higher data variability, and lower recommended experiment duration thresholds. Overall, online paradigms present both opportunities and challenges for future motor learning research.

Human Performance of Novice Schedulers for Complex Spaceflight Operations Timelines.

OBJECTIVE: Investigate the effects of scheduling task complexity on human performance for novice schedulers creating spaceflight timelines. BACKGROUND: Future astronauts will be expected to self-schedule, yet will not be experts in creating timelines that meet the complex constraints inherent to spaceflight operations. METHOD: Conducted a within-subjects experiment to evaluate scheduling task performance in terms of scheduling efficiency, effectiveness, workload, and situation awareness while manipulating scheduling task complexity according to the number of constraints and type of constraints. RESULTS: Each participant (n = 15) completed a set of scheduling problems. Results showed main effects of the number of constraints and type of constraint on efficiency, effectiveness, and workload. Significant interactions were observed in situation awareness and workload for certain types of constraints. Results also suggest that a lower number of constraints may be manageable by novice schedulers when compared to scheduling activities without constraints. CONCLUSION: Results suggest that novice schedulers' performance decreases with a high number of constraints, and future scheduling aids may need to target a specific type of constraint. APPLICATION: Knowledge on the effect of scheduling task complexity will help design scheduling systems that will enable self-scheduling for future astronauts. It will also inform other domains that conduct complex scheduling, such as nursing and manufacturing.