RESUMO
BACKGROUND: There are over 165,000 mHealth apps currently available to patients, but few have undergone an external quality review. Furthermore, no standardized review method exists, and little has been done to examine the consistency of the evaluation systems themselves. OBJECTIVE: We sought to determine which measures for evaluating the quality of mHealth apps have the greatest interrater reliability. METHODS: We identified 22 measures for evaluating the quality of apps from the literature. A panel of 6 reviewers reviewed the top 10 depression apps and 10 smoking cessation apps from the Apple iTunes App Store on these measures. Krippendorff's alpha was calculated for each of the measures and reported by app category and in aggregate. RESULTS: The measure for interactiveness and feedback was found to have the greatest overall interrater reliability (alpha=.69). Presence of password protection (alpha=.65), whether the app was uploaded by a health care agency (alpha=.63), the number of consumer ratings (alpha=.59), and several other measures had moderate interrater reliability (alphas>.5). There was the least agreement over whether apps had errors or performance issues (alpha=.15), stated advertising policies (alpha=.16), and were easy to use (alpha=.18). There were substantial differences in the interrater reliabilities of a number of measures when they were applied to depression versus smoking apps. CONCLUSIONS: We found wide variation in the interrater reliability of measures used to evaluate apps, and some measures are more robust across categories of apps than others. The measures with the highest degree of interrater reliability tended to be those that involved the least rater discretion. Clinical quality measures such as effectiveness, ease of use, and performance had relatively poor interrater reliability. Subsequent research is needed to determine consistent means for evaluating the performance of apps. Patients and clinicians should consider conducting their own assessments of apps, in conjunction with evaluating information from reviews.
RESUMO
BACKGROUND: Alcohol use disorders (AUDs) lead to alterations in central nervous system (CNS) architecture along with impaired learning and memory. Previous work from our group and that of others suggests that one mechanism underlying these changes is alteration of cell proliferation, apoptosis, and DNA-repair in neural stem cells (NSCs) produced as a consequence of ethanol-induced effects on the expression of genes related to p53-signaling. This study tests the hypothesis that changes in the expression of p53-signaling genes represent biomarkers of ethanol abuse which can be identified in the peripheral blood of rat drinking models and human AUD subjects and posits that specific changes may be correlated with differences in neuropsychological measures and CNS structure. RESULTS: Remarkably, microarray analysis of 350 genes related to p53-signaling in peripheral blood leukocytes (PBLs) of binge-drinking rats revealed 190 genes that were significantly altered after correcting for multiple testing. Moreover, 40 of these genes overlapped with those that we had previously observed to be changed in ethanol-exposed mouse NSCs. Expression changes in nine of these genes were tested for independent confirmation by a custom QuantiGene Plex (QGP) assay for a subset of p53-signaling genes, where a consistent trend for decreased expression of mitosis-related genes was observed. One mitosis-related gene (Pttg1) was also changed in human lymphoblasts cultured with ethanol. In PBLs of human AUD subjects seven p53-signaling genes were changed compared with non-drinking controls. Correlation and principal components analysis were then used to identify significant relationships between the expression of these seven genes and a set of medical, demographic, neuropsychological and neuroimaging measures that distinguished AUD and control subjects. Two genes (Ercc1 and Mcm5) showed a highly significant correlation with AUD-induced decreases in the volume of the left parietal supramarginal gyrus and neuropsychological measures. CONCLUSIONS: These results demonstrate that alcohol-induced changes in genes related to proliferation, apoptosis, and DNA-repair are observable in the peripheral blood and may serve as a useful biomarker for CNS structural damage and functional performance deficits in human AUD subjects.
