Doing Remote Controlled Studies with Humans: Tales from the COVID Trenches
13th IEEE/ACM International Workshop on Cooperative and Human Aspects of Software Engineering, CHASE 2021
; : 113-116, 2021.
Article
in English
| Scopus | ID: covidwho-1393658
ABSTRACT
How should empirical researchers conduct controlled, remote 'lab' studies in the uncontrolled, noisy conditions of each participant's own home? Volatility in participant home environments, hardware, internet connection, and surrounding distractions takes the 'controlled' out of controlled studies. This paper recounts our in-The-Trenches mitigations for designing and conducting two complex controlled studies under COVID, in which participants, from home, interactively localized faults in an AI system. The studies with our COVID-era mitigations in 5 categories-Privacy/Security, Data Collection, Control, Technology Issues, Payment-ultimately produced crisp results beyond what we thought possible under such uncontrolled circumstances. © 2021 IEEE.
Full text:
Available
Collection:
Databases of international organizations
Database:
Scopus
Type of study:
Experimental Studies
Language:
English
Journal:
ACM International Workshop on Cooperative and Human Aspects of Software Engineering, CHASE 2021
Year:
2021
Document Type:
Article
Similar
MEDLINE
...
LILACS
LIS