ABSTRACT
BACKGROUND: Increasingly, drug and device clinical trials are tracking activity levels and other quality of life indices as endpoints for therapeutic efficacy. Trials have traditionally required intermittent subject visits to the clinic that are artificial, activity-intensive, and infrequent, making trend and event detection between visits difficult. Thus, there is an unmet need for wearable sensors that produce clinical quality and medical grade physiological data from subjects in the home. The current study was designed to validate the BioStamp nPoint® system (MC10 Inc., Lexington, MA, USA), a new technology designed to meet this need. OBJECTIVE: To evaluate the accuracy, performance, and ease of use of an end-to-end system called the BioStamp nPoint. The system consists of an investigator portal for design of trials and data review, conformal, low-profile, wearable biosensors that adhere to the skin, a companion technology for wireless data transfer to a proprietary cloud, and algorithms for analyzing physiological, biometric, and contextual data for clinical research. METHODS: A prospective, nonrandomized clinical trial was conducted on 30 healthy adult volunteers over the course of two continuous days and nights. Supervised and unsupervised study activities enabled performance validation in clinical and remote (simulated "at home") environments. System outputs for heart rate (HR), heart rate variability (HRV) (including root mean square of successive differences [RMSSD] and low frequency/high frequency ratio), activity classification during prescribed activities (lying, sitting, standing, walking, stationary biking, and sleep), step count during walking, posture characterization, and sleep metrics including onset/wake times, sleep duration, and respiration rate (RR) during sleep were evaluated. Outputs were compared to FDA-cleared comparator devices for HR, HRV, and RR and to ground truth investigator observations for activity and posture classifications, step count, and sleep events. RESULTS: Thirty participants (77% male, 23% female; mean age 35.9 ± 10.1 years; mean BMI 28.1 ± 3.6) were enrolled in the study. The BioStamp nPoint system accurately measured HR and HRV (correlations: HR = 0.957, HRV RMSSD = 0.965, HRV ratio = 0.861) when compared to ActiheartTM. The system accurately monitored RR (mean absolute error [MAE] = 1.3 breaths/min) during sleep when compared to a Capnostream35TM end-tidal CO2 monitor. When compared with investigator observations, the system correctly classified activities and posture (agreement = 98.7 and 92.9%, respectively), step count (MAE = 14.7, < 3% of actual steps during a 6-min walk), and sleep events (MAE: sleep onset = 6.8 min, wake = 11.5 min, sleep duration = 13.7 min) with high accuracy. Participants indicated "good" to "excellent" usability (average System Usability Scale score of 81.3) and preferred the BioStamp nPoint system over both the Actiheart (86%) and Capnostream (97%) devices. CONCLUSIONS: The present study validated the BioStamp nPoint system's performance and ease of use compared to FDA-cleared comparator devices in both the clinic and remote (home) environments.
ABSTRACT
Largely due to dissatisfaction with the standard null hypothesis significance testing procedure, researchers have begun to consider alternatives. For example, Killeen (2005a) has argued that researchers should calculate prep that is purported to indicate the probability that, if the experiment in question were replicated, the obtained finding would be in the same direction as the original finding. However, Killeen also seems to indicate that rather than being the probability of replication, prep is actually the probability of obtaining a finding whereby the experimental group mean exceeds the control group mean. Our goal was to determine the relative frequency with which obtained prep statistics are close to true replication probabilities. Regardless of which way prep is defined, our simulations show that it is unlikely to be close to the true value unless both the population effect magnitude and the sample size are uncommonly large. The definitional problem in combination with the inaccuracy under either interpretation, constitutes an important challenge for those who espouse the routine computation of prep statistics.
