Personal information and public health: Design tensions in sharing and monitoring wellbeing in pregnancy.

Mobile technologies are valuable tools for the self-report of mental health and wellbeing. These systems pose many unique design challenges which have received considerable attention within HCI, including the engagement of users. However, less attention has been paid to the use of personal devices in public health. Integrating self-reported data within the context of clinical care suggests the need to design interfaces to support data management, sense-making, risk-assessment, feedback and patient-provider relationships. This paper reports on a qualitative design study for the clinical interface of a mobile application for the self-report of psychological wellbeing and depression during pregnancy. We examine the design tensions which arise in managing the expectations and informational needs of pregnant women, midwives, clinical psychologists, GPs and other health professionals with respect to a broad spectrum of wellbeing. We discuss strategies for managing these tensions in the design of technologies required to balance personal information with public health.

Video-Based Pairwise Comparison: Enabling the Development of Automated Rating of Motor Dysfunction in Multiple Sclerosis.

OBJECTIVES: To examine the feasibility, reliability, granularity, and convergent validity of a video-based pairwise comparison technique that uses algorithmic support to enable automated rating of motor dysfunction in patients with multiple sclerosis (MS). DESIGN: Feasibility and larger cross-sectional cohort study. SETTING: The outpatient clinic of 2 specialist university medical centers. PARTICIPANTS: Selected sample from a cohort of patients with MS participating in the Assess MS study (N=42). Videos were randomly drawn from each strata of the ataxia severity-degrees as defined in the Expanded Disability Status Scale (EDSS). In Basel: 19 videos of 17 patients (mean age, 43.4±11.6y; 10 women). In Amsterdam: 50 videos of 25 patients (mean age, 50.0±10.0y; 15 women). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: In each center, neurologists (n=13; n=10) viewed pairs of videos of patients performing standardized movements (eg, finger-to-nose test) to assess relative performance. A comparative assessment score was calculated for each video using the TrueSkill algorithm and analyzed for intrarater (test-retest; ratio of agreement) and interrater reliability (intraclass correlation coefficient [ICC] for absolute agreement) and convergent validity (Spearman ρ). Granularity was estimated from the average difference in comparative assessment scores at which 80% of neurologists considered performance to be different. RESULTS: Intrarater reliability was excellent (median ratio of agreement≥0.87). The comparative assessment scores calculated from individual neurologists demonstrated good-excellent ICCs for interrater reliability (0.89; 0.71). The comparative assessment scores correlated (very) highly with their Neurostatus-EDSS equivalent (ρ=0.78, P<.001; ρ=0.91, P<.05), suggesting a more fine-grained rating. CONCLUSIONS: Video-based pairwise comparison of motor dysfunction allows for reliable and fine-grained capturing of clinical judgment about neurologic performance, which can contribute to the development of a consistent quantified metric of motor ability in MS.

Setwise comparison: efficient fine-grained rating of movement videos using algorithmic support - a proof of concept study.

Purpose: Clinical ordinal rating scales of movements, e.g., the Expanded Disability Status Scale, have poor intra- and interrater reliability, are insensitive to subtle differences and result in coarse-grained ratings compared to relative comparative rating methods. We therefore established video-based setwise comparison as a fine-grained, reliable and efficient rating method of motor dysfunction using algorithmic support.Materials and methods: Eight neurologists rated a set of 40 multiple sclerosis patient videos of the Finger-to-Nose-Test using both the newly developed setwise comparison and the established pairwise comparison techniques, which result in a continuous rating scale. Reliability was assessed by the intra-class correlation coefficient. Construct validity was estimated as Pearson's correlation between the continuous scale and severity ratings according to the Neurostatus scale for upper-extremity tremor/dysmetria and the Nine-hole-peg-test. Comparing the time needed for ratings assessed efficiency.Results: Intra-class correlation coefficient was 0.83 for setwise and 0.7 for pairwise comparison. Correlation to the tremor/dysmetria score of the Neurostatus was 0.86 for both rating procedures and correlation to the Nine-hole-peg-test was 0.64 (setwise) and 0.66 (pairwise). The time needed to rate 40 videos was 22.9 ± 6.9 minutes (setwise) and 77.8 ± 14.5 minutes (pairwise).Conclusions: Setwise comparison is an efficient, valid and reliable method for fine-grained rating of motor dysfunction that can be applied to larger datasets. It is substantially more efficient than pairwise comparison.Implications for rehabilitationDisability rating is crucial in clinical neurorehabilitation and in clinical trials.Humans are naturally inconsistent in rating items on ordinal scales leading to poor intra- and interrater reliability, insensitivity to subtle differences and coarse-grained ratings.Video-based setwise comparison is a new rating method enabling fine-grained, reliable and efficient ratings of motor dysfunction using algorithmic support.

A Mobile App for the Self-Report of Psychological Well-Being During Pregnancy (BrightSelf): Qualitative Design Study.

BACKGROUND: Maternal mental health impacts both parental well-being and childhood development. In the United Kingdom, 15% of women are affected by depression during pregnancy or within 1 year of giving birth. Suicide is a leading cause of perinatal maternal mortality, and it is estimated that >50% of perinatal depression cases go undiagnosed. Mobile technologies are potentially valuable tools for the early recognition of depressive symptoms, but complex design challenges must be addressed to enable their use in public health screening. OBJECTIVE: The aim of this study was to explore the issues and challenges surrounding the use of mobile phones for the self-report of psychological well-being during pregnancy. METHODS: This paper presents design research carried out as part of the development of BrightSelf, a mobile app for the self-report of psychological well-being during pregnancy. Design sessions were carried out with 38 participants, including pregnant women, mothers, midwives, and other health professionals. Overall, 19 hours of audio were fully transcribed and used as the basis of thematic analysis. RESULTS: The study highlighted anxieties concerning the pregnancy journey, challenges surrounding current approaches to the appraisal of well-being in perinatal care, and the midwife-patient relationship. Designers should consider the framing of perinatal mental health technologies, the experience of self-report, supporting self-awareness and disclosure, providing value to users through both self-report and supplementary features, and designing for longitudinal engagement. CONCLUSIONS: This study highlights the needs, motivations, and anxieties of women with respect to technology use in pregnancy and implications for the design of mobile health technologies.

Reference videos reduce variability of motor dysfunction assessments in multiple sclerosis.

Motor dysfunction, particularly ataxia, is one of the predominant clinical manifestations in patients with multiple sclerosis (MS). Assessment of motor dysfunction suffers from a high variability. We investigated whether the clinical rating of ataxia can be improved through the use of reference videos, covering the spectrum of severity degrees as defined in the Neurostatus-Expanded Disability Status Scale. Twenty-five neurologists participated. The variability of their assessments was significantly lower when reference videos were used (SD = 0.12; range = 0.40 vs SD = 0.26; range = 0.88 without reference videos; p = 0.013). Reference videos reduced the variability of clinical assessments and may be useful tools to improve the precision and consistency in the clinical assessment of motor functions in MS.

Implementation of depression screening in antenatal clinics through tablet computers: results of a feasibility study.

BACKGROUND: Mobile devices may facilitate depression screening in the waiting area of antenatal clinics. This can present implementation challenges, of which we focused on survey layout and technology deployment. METHODS: We assessed the feasibility of using tablet computers to administer a socio-demographic survey, the Whooley questions and the Edinburgh Postnatal Depression Scale (EPDS) to 530 pregnant women attending National Health Service (NHS) antenatal clinics across England. We randomised participants to one of two layout versions of these surveys: (i) a scrolling layout where each survey was presented on a single screen; or (ii) a paging layout where only one question appeared on the screen at any given time. RESULTS: Overall, 85.10% of eligible pregnant women agreed to take part. Of these, 90.95% completed the study procedures. Approximately 23% of participants answered Yes to at least one Whooley question, and approximately 13% of them scored 10 points of more on the EPDS. We observed no association between survey layout and the responses given to the Whooley questions, the median EPDS scores, the number of participants at increased risk of self-harm, and the number of participants asking for technical assistance. However, we observed a difference in the number of participants at each EPDS scoring interval (p = 0.008), which provide an indication of a woman's risk of depression. A scrolling layout resulted in faster completion times (median = 4 min 46 s) than a paging layout (median = 5 min 33 s) (p = 0.024). However, the clinical significance of this difference (47.5 s) is yet to be determined. CONCLUSIONS: Tablet computers can be used for depression screening in the waiting area of antenatal clinics. This requires the careful consideration of clinical workflows, and technology-related issues such as connectivity and security. An association between survey layout and EPDS scoring intervals needs to be explored further to determine if it corresponds to a survey layout effect. Future research needs to evaluate the effect of this type of antenatal depression screening on clinical outcomes and clinic workflows. TRIAL REGISTRATION: This study was registered in ClinicalTrials.gov under the identifier NCT02516982 on 20 July 2015.

A bespoke mobile application for the longitudinal assessment of depression and mood during pregnancy: protocol of a feasibility study.

INTRODUCTION: Depression is a common mental health disorder during pregnancy, with important consequences for mothers and their children. Despite this, it goes undiagnosed and untreated in many women attending antenatal care. Smartphones could help support the prompt identification of antenatal depression in this setting. In addition, these devices enable the implementation of ecological momentary assessment techniques, which could be used to assess how mood is experienced during pregnancy. With this study, we will assess the feasibility of using a bespoke mobile application (app) running on participants' own handsets for the longitudinal (6 months) monitoring of antenatal mood and screening of depression. METHODS AND ANALYSIS: We will use a randomised controlled study design to compare two types of assessment strategies: retrospective + momentary (consisting of the Edinburgh Postnatal Depression Scale plus five momentary and two contextual questions), and retrospective (consisting of the Edinburgh Postnatal Depression Scale only). We will assess the impact that these strategies have on participant adherence to a prespecified sampling protocol, dropout rates and timeliness of data completion. We will evaluate differences in acceptance of the technology through a short quantitative survey and open-ended questions. We will also assess the potential effect that momentary assessments could have on retrospective data. We will attempt to identify any patterns in app usage through the analysis of log data. ETHICS AND DISSEMINATION: This study has been reviewed and approved by the National Research Ethics Service Committee South East Coast-Surrey on 15 April 2016 as a notice of substantial amendment to the original submission (9 July 2015) under the Research Ethics Committee (REC) reference 15/LO/0977. This study is being sponsored by Imperial College London under the reference number 15IC2687 and has been included in the UK Clinical Research Network Study Portfolio under the Central Portfolio Management System number 19280. The findings of this study will be disseminated through academic peer-reviewed publications, poster presentations and abstracts at academic and professional conferences, discussion with peers, and social media. The findings of this study will also inform the PhD theses of JSMB and KD.

Designing services for frequent attenders to the emergency department: a characterisation of this population to inform service design.

Frequent attendance to the emergency department (ED) is a growing public health concern. Designing services for frequent attenders poses challenges, given the heterogeneous nature of this group. This was a two-part observational study identifying frequent attenders from ED records. The first stage studied trends and developed personas with emphasis on differentiating moderate frequent attenders (attending between 5 and 20 times per year) and extreme frequent attenders (attending more than 20 times). Stage 2 included a case note review of 100 consecutive frequent attenders. Results showed an increase in frequent attendance from 2.59% to 4.12% over 8 years. Moderate frequent attenders accounted for 97%. Of the 100 frequent attenders studied, 45% had medically unexplained symptoms (MUS), associated with younger age (p<0.001) but not with gender (p>0.05). In conclusion, the ED is a useful hub for identifying frequent attenders with MUS, particularly among moderate frequent attenders; service design for this group should consider a 'whole-systems approach' with integration between primary and secondary care, including specialist liaison psychiatry services where appropriate.

Tablet computers for implementing NICE antenatal mental health guidelines: protocol of a feasibility study.

INTRODUCTION: Depression is one of the most common mental health disorders that may affect women during pregnancy. The prompt identification of this disorder, and the provision of treatment, may help to reduce the likelihood of post-partum depression, prevent severe forms of the disease, and reduce its intergenerational impact. Despite women's repeated encounters with health services throughout their antenatal care, depression often goes undiagnosed. This is one area where mobile health could prove useful. We will assess the feasibility of using tablets to incorporate depression screening into antenatal pathways. We will also assess if survey layout could affect the quality of the data collected through these devices. METHODS AND ANALYSIS: We will test the feasibility of using iPad Airs for the administration of the Whooley questions and the Edinburgh Postnatal Depression Scale (EPDS) to pregnant women attending antenatal clinics in England. We will assess the impact of survey layout on the quality of the responses given to these screening scales using a parallel, randomised controlled study design. We will calculate the positive predictive value, the negative predictive value and the false omission rate of the Whooley questions in comparison with the EPDS. We will calculate differences in data equivalence, time needed to complete the surveys, break-off rates, data completeness and requests for help between the 2 experimental groups: using all questions in one screen and navigation by vertical scrolling, or a single question per screen and navigation by multiple pages. ETHICS AND DISSEMINATION: This study has been approved by the National Research Ethics Service Committee South East Coast--Surrey. Our findings will be disseminated through academic peer-reviewed publications, conferences and discussion with peers.

Vision-based body tracking: turning Kinect into a clinical tool.

PURPOSE: Vision-based body tracking technologies, originally developed for the consumer gaming market, are being repurposed to form the core of a range of innovative healthcare applications in the clinical assessment and rehabilitation of movement ability. Vision-based body tracking has substantial potential, but there are technical limitations. METHOD: We use our "stories from the field" to articulate the challenges and offer examples of how these can be overcome. RESULTS: We illustrate that: (i) substantial effort is needed to determine the measures and feedback vision-based body tracking should provide, accounting for the practicalities of the technology (e.g. range) as well as new environments (e.g. home). (ii) Practical considerations are important when planning data capture so that data is analysable, whether finding ways to support a patient or ensuring everyone does the exercise in the same manner. (iii) Home is a place of opportunity for vision-based body tracking, but what we do now in the clinic (e.g. balance tests) or in the home (e.g. play games) will require modifications to achieve capturable, clinically relevant measures. CONCLUSIONS: This article articulates how vision-based body tracking works and when it does not to continue to inspire our clinical colleagues to imagine new applications. Implications for Rehabilitation Vision-based body tracking has quickly been repurposed to form the core of innovative healthcare applications in clinical assessment and rehabilitation, but there are clinical as well as practical challenges to make such systems a reality. Substantial effort needs to go into determining what types of measures and feedback vision-based body tracking should provide. This needs to account for the practicalities of the technology (e.g. range) as well as the opportunities of new environments (e.g. the home). Practical considerations need to be accounted for when planning capture in a particular environment so that data is analysable, whether it be finding a chair substitute, ways to support a patient or ensuring everyone does the exercise in the same manner. The home is a place of opportunity with vision-based body tracking, but it would be naïve to think that we can do what we do now in the clinic (e.g. balance tests) or in the home (e.g. play games), without appropriate modifications to what constitutes a practically capturable, clinically relevant measure.

Comparison of self-administered survey questionnaire responses collected using mobile apps versus other methods.

BACKGROUND: Self-administered survey questionnaires are an important data collection tool in clinical practice, public health research and epidemiology. They are ideal for achieving a wide geographic coverage of the target population, dealing with sensitive topics and are less resource-intensive than other data collection methods. These survey questionnaires can be delivered electronically, which can maximise the scalability and speed of data collection while reducing cost. In recent years, the use of apps running on consumer smart devices (i.e., smartphones and tablets) for this purpose has received considerable attention. However, variation in the mode of delivering a survey questionnaire could affect the quality of the responses collected. OBJECTIVES: To assess the impact that smartphone and tablet apps as a delivery mode have on the quality of survey questionnaire responses compared to any other alternative delivery mode: paper, laptop computer, tablet computer (manufactured before 2007), short message service (SMS) and plastic objects. SEARCH METHODS: We searched MEDLINE, EMBASE, PsycINFO, IEEEXplore, Web of Science, CABI: CAB Abstracts, Current Contents Connect, ACM Digital, ERIC, Sociological Abstracts, Health Management Information Consortium, the Campbell Library and CENTRAL. We also searched registers of current and ongoing clinical trials such as ClinicalTrials.gov and the World Health Organization (WHO) International Clinical Trials Registry Platform. We also searched the grey literature in OpenGrey, Mobile Active and ProQuest Dissertation & Theses. Lastly, we searched Google Scholar and the reference lists of included studies and relevant systematic reviews. We performed all searches up to 12 and 13 April 2015. SELECTION CRITERIA: We included parallel randomised controlled trials (RCTs), crossover trials and paired repeated measures studies that compared the electronic delivery of self-administered survey questionnaires via a smartphone or tablet app with any other delivery mode. We included data obtained from participants completing health-related self-administered survey questionnaire, both validated and non-validated. We also included data offered by both healthy volunteers and by those with any clinical diagnosis. We included studies that reported any of the following outcomes: data equivalence; data accuracy; data completeness; response rates; differences in the time taken to complete a survey questionnaire; differences in respondent's adherence to the original sampling protocol; and acceptability to respondents of the delivery mode. We included studies that were published in 2007 or after, as devices that became available during this time are compatible with the mobile operating system (OS) framework that focuses on apps. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data from the included studies using a standardised form created for this systematic review in REDCap. They then compared their forms to reach consensus. Through an initial systematic mapping on the included studies, we identified two settings in which survey completion took place: controlled and uncontrolled. These settings differed in terms of (i) the location where surveys were completed, (ii) the frequency and intensity of sampling protocols, and (iii) the level of control over potential confounders (e.g., type of technology, level of help offered to respondents). We conducted a narrative synthesis of the evidence because a meta-analysis was not appropriate due to high levels of clinical and methodological diversity. We reported our findings for each outcome according to the setting in which the studies were conducted. MAIN RESULTS: We included 14 studies (15 records) with a total of 2275 participants; although we included only 2272 participants in the final analyses as there were missing data for three participants from one included study.Regarding data equivalence, in both controlled and uncontrolled settings, the included studies found no significant differences in the mean overall scores between apps and other delivery modes, and that all correlation coefficients exceeded the recommended thresholds for data equivalence. Concerning the time taken to complete a survey questionnaire in a controlled setting, one study found that an app was faster than paper, whereas the other study did not find a significant difference between the two delivery modes. In an uncontrolled setting, one study found that an app was faster than SMS. Data completeness and adherence to sampling protocols were only reported in uncontrolled settings. Regarding the former, an app was found to result in more complete records than paper, and in significantly more data entries than an SMS-based survey questionnaire. Regarding adherence to the sampling protocol, apps may be better than paper but no different from SMS. We identified multiple definitions of acceptability to respondents, with inconclusive results: preference; ease of use; willingness to use a delivery mode; satisfaction; effectiveness of the system informativeness; perceived time taken to complete the survey questionnaire; perceived benefit of a delivery mode; perceived usefulness of a delivery mode; perceived ability to complete a survey questionnaire; maximum length of time that participants would be willing to use a delivery mode; and reactivity to the delivery mode and its successful integration into respondents' daily routine. Finally, regardless of the study setting, none of the included studies reported data accuracy or response rates. AUTHORS' CONCLUSIONS: Our results, based on a narrative synthesis of the evidence, suggest that apps might not affect data equivalence as long as the intended clinical application of the survey questionnaire, its intended frequency of administration and the setting in which it was validated remain unchanged. There were no data on data accuracy or response rates, and findings on the time taken to complete a self-administered survey questionnaire were contradictory. Furthermore, although apps might improve data completeness, there is not enough evidence to assess their impact on adherence to sampling protocols. None of the included studies assessed how elements of user interaction design, survey questionnaire design and intervention design might influence mode effects. Those conducting research in public health and epidemiology should not assume that mode effects relevant to other delivery modes apply to apps running on consumer smart devices. Those conducting methodological research might wish to explore the issues highlighted by this systematic review.

The evolution of mobile apps for asthma: an updated systematic assessment of content and tools.

BACKGROUND: Interest in mobile apps that support long-term conditions such as asthma is matched by recognition of the importance of the quality and safety of apps intended for patient use. We assessed how changes over a 2-year period affected the clinical suitability of apps providing self-management information and tools for people with asthma by updating a review first performed in 2011. METHODS: Systematic content assessment of all apps for iOS and Android examining the comprehensiveness of asthma information, consistency with the evidence base for asthma self-management and adherence to best practice principles for trustworthy content, comparing the quality of apps available in 2011 to those released since. RESULTS: Between 2011 and 2013, numbers of asthma apps more than doubled from 93 to 191, despite withdrawal of 25% (n = 23/93) of existing apps. Newer apps were no more likely than those available in 2011 to include comprehensive information, such as the use of action plans, or offer guidance consistent with evidence; 13% (n = 19/147) of all apps, and 39% (n = 9/23) of those intended to manage acute asthma, recommended self-care procedures unsupported by evidence. Despite increases in the numbers of apps targeting specific skills, such as acute asthma management (n = 12 to 23) and inhaler technique (from n = 2 to 12), the proportion consistent with guidelines (17%, n = 4/23) and inhaler instructions (25%, n = 3/12), respectively, was low, and most apps provided only either basic information about asthma (50%, n = 75/147) or simple diary functions (24%, n = 36/147). CONCLUSIONS: In addition to persisting questions about clinical quality and safety, dynamic aspects of app turnover and feature evolution affect the suitability of asthma apps for use in routine care. The findings underline the need for coordinated quality assurance processes that can adapt to changing clinical and information governance-related risks, ensure compliance with the evidence base and reflect local variations in clinical practice. It is unclear if substantial clinical benefits can be realized from a landscape dominated by low quality generic information apps and tools that do not adhere to accepted medical practice.

Usability and Acceptability of ASSESS MS: Assessment of Motor Dysfunction in Multiple Sclerosis Using Depth-Sensing Computer Vision.

BACKGROUND: Sensor-based recordings of human movements are becoming increasingly important for the assessment of motor symptoms in neurological disorders beyond rehabilitative purposes. ASSESS MS is a movement recording and analysis system being developed to automate the classification of motor dysfunction in patients with multiple sclerosis (MS) using depth-sensing computer vision. It aims to provide a more consistent and finer-grained measurement of motor dysfunction than currently possible. OBJECTIVE: To test the usability and acceptability of ASSESS MS with health professionals and patients with MS. METHODS: A prospective, mixed-methods study was carried out at 3 centers. After a 1-hour training session, a convenience sample of 12 health professionals (6 neurologists and 6 nurses) used ASSESS MS to capture recordings of standardized movements performed by 51 volunteer patients. Metrics for effectiveness, efficiency, and acceptability were defined and used to analyze data captured by ASSESS MS, video recordings of each examination, feedback questionnaires, and follow-up interviews. RESULTS: All health professionals were able to complete recordings using ASSESS MS, achieving high levels of standardization on 3 of 4 metrics (movement performance, lateral positioning, and clear camera view but not distance positioning). Results were unaffected by patients' level of physical or cognitive disability. ASSESS MS was perceived as easy to use by both patients and health professionals with high scores on the Likert-scale questions and positive interview commentary. ASSESS MS was highly acceptable to patients on all dimensions considered, including attitudes to future use, interaction (with health professionals), and overall perceptions of ASSESS MS. Health professionals also accepted ASSESS MS, but with greater ambivalence arising from the need to alter patient interaction styles. There was little variation in results across participating centers, and no differences between neurologists and nurses. CONCLUSIONS: In typical clinical settings, ASSESS MS is usable and acceptable to both patients and health professionals, generating data of a quality suitable for clinical analysis. An iterative design process appears to have been successful in accounting for factors that permit ASSESS MS to be used by a range of health professionals in new settings with minimal training. The study shows the potential of shifting ubiquitous sensing technologies from research into the clinic through a design approach that gives appropriate attention to the clinic environment.

Exploring the boundary of a specialist service for adults with intellectual disabilities using a Delphi study: a quantification of stakeholder participation.

BACKGROUND: There are arguments that a specialist service for adults with intellectual disabilities is needed to address the health inequalities that this group experiences. The boundary of such a specialist service however is unclear, and definition is difficult, given the varying experiences of the multiple stakeholder groups. OBJECTIVES: The study reported here quantitatively investigates divergence in stakeholders' views of what constitutes a good specialist service for people with intellectual disabilities. It is the first step of a larger project that aims to investigate the purpose, function and design of such a specialist service. The results are intended to support policy and service development. STUDY DESIGN: A Delphi study was carried out to elicit the requirements of this new specialist service from stakeholder groups. It consisted of three panels (carers, frontline health professionals, researchers and policymakers) and had three rounds. The quantification of stakeholder participation covers the number of unique ideas per panel, the value of these ideas as determined by the other panels and the level of agreement within and between panels. FINDINGS: There is some overlap of ideas about of what should constitute this specialist service, but both carers and frontline health professionals contributed unique ideas. Many of these were valued by the researchers and policymakers. Interestingly, carers generated more ideas regarding how to deliver services than what services to deliver. Regarding whether ideas are considered appropriate, the variation both within and between groups is small. On the other hand, the feasibility of solutions is much more contested, with large variations among carers. CONCLUSIONS: This study provides a quantified representation of the diversity of ideas among stakeholder groups regarding where the boundary of a specialist service for adults with learning disabilities should sit. The results can be used as a starting point for the design process. The study also offers one way to measure the impact of participation for those interested in participation as a mechanism for service improvement.

Quantifying progression of multiple sclerosis via classification of depth videos.

This paper presents new learning-based techniques for measuring disease progression in Multiple Sclerosis (MS) patients. Our system aims to augment conventional neurological examinations by adding quantitative evidence of disease progression. An off-the-shelf depth camera is used to image the patient at the examination, during which he/she is asked to perform carefully selected movements. Our algorithms then automatically analyze the videos, assessing the quality of each movement and classifying them as healthy or non-healthy. Our contribution is three-fold: We i) introduce ensembles of randomized SVM classifiers and compare them with decision forests on the task of depth video classification; ii) demonstrate automatic selection of discriminative landmarks in the depth videos, showing their clinical relevance; iii) validate our classification algorithms quantitatively on a new dataset of 1041 videos of both MS patients and healthy volunteers. We achieve average Dice scores well in excess of the 80% mark, confirming the validity of our approach in practical applications. Our results suggest that this technique could be fruitful for depth-camera supported clinical assessments for a range of conditions.

Analyzing engagement in a web-based intervention platform through visualizing log-data.

BACKGROUND: Engagement has emerged as a significant cross-cutting concern within the development of Web-based interventions. There have been calls to institute a more rigorous approach to the design of Web-based interventions, to increase both the quantity and quality of engagement. One approach would be to use log-data to better understand the process of engagement and patterns of use. However, an important challenge lies in organizing log-data for productive analysis. OBJECTIVE: Our aim was to conduct an initial exploration of the use of visualizations of log-data to enhance understanding of engagement with Web-based interventions. METHODS: We applied exploratory sequential data analysis to highlight sequential aspects of the log data, such as time or module number, to provide insights into engagement. After applying a number of processing steps, a range of visualizations were generated from the log-data. We then examined the usefulness of these visualizations for understanding the engagement of individual users and the engagement of cohorts of users. The visualizations created are illustrated with two datasets drawn from studies using the SilverCloud Platform: (1) a small, detailed dataset with interviews (n=19) and (2) a large dataset (n=326) with 44,838 logged events. RESULTS: We present four exploratory visualizations of user engagement with a Web-based intervention, including Navigation Graph, Stripe Graph, Start-Finish Graph, and Next Action Heat Map. The first represents individual usage and the last three, specific aspects of cohort usage. We provide examples of each with a discussion of salient features. CONCLUSIONS: Log-data analysis through data visualization is an alternative way of exploring user engagement with Web-based interventions, which can yield different insights than more commonly used summative measures. We describe how understanding the process of engagement through visualizations can support the development and evaluation of Web-based interventions. Specifically, we show how visualizations can (1) allow inspection of content or feature usage in a temporal relationship to the overall program at different levels of granularity, (2) detect different patterns of use to consider personalization in the design process, (3) detect usability issues, (4) enable exploratory analysis to support the design of statistical queries to summarize the data, (5) provide new opportunities for real-time evaluation, and (6) examine assumptions about interactivity that underlie many summative measures in this field.

Articulating current service development practices: a qualitative analysis of eleven mental health projects.

BACKGROUND: The utilisation of good design practices in the development of complex health services is essential to improving quality. Healthcare organisations, however, are often seriously out of step with modern design thinking and practice. As a starting point to encourage the uptake of good design practices, it is important to understand the context of their intended use. This study aims to do that by articulating current health service development practices. METHODS: Eleven service development projects carried out in a large mental health service were investigated through in-depth interviews with six operation managers. The critical decision method in conjunction with diagrammatic elicitation was used to capture descriptions of these projects. Stage-gate design models were then formed to visually articulate, classify and characterise different service development practices. RESULTS: Projects were grouped into three categories according to design process patterns: new service introduction and service integration; service improvement; service closure. Three common design stages: problem exploration, idea generation and solution evaluation - were then compared across the design process patterns. Consistent across projects were a top-down, policy-driven approach to exploration, underexploited idea generation and implementation-based evaluation. CONCLUSIONS: This study provides insight into where and how good design practices can contribute to the improvement of current service development practices. Specifically, the following suggestions for future service development practices are made: genuine user needs analysis for exploration; divergent thinking and innovative culture for idea generation; and fail-safe evaluation prior to implementation. Better training for managers through partnership working with design experts and researchers could be beneficial.

Beyond tokenistic participation: using representational artefacts to enable meaningful public participation in health service design.

A number of recent policies promote public participation in health service design. Yet, a growing literature has articulated a gap between policy aims and actual practice resulting in public participation becoming tokenistic. Drawing on theory from participatory design, we argue that choosing appropriate artefacts to act as representations can structure discussions between public participants and health professionals in ways that both groups find meaningful and valid. Through a case study of a service improvement project in outpatient services for older people, we describe three representational artefacts: emotion maps, stories, and tracing paper, and explain how they helped to mediate interactions between public participants and health professionals. We suggest that using such representational artefacts can provide an alternative approach to participation that stands in contrast to the current focus on the professionalisation of public participants. We conclude that including participatory designers in projects, to chose or design appropriate representational artefacts, can help to address the policy-practice gap of including public participants in health service design.

'You can't just hit a button': an ethnographic study of strategies to repurpose data from advanced clinical information systems for clinical process improvement.

BACKGROUND: Current policies encourage healthcare institutions to acquire clinical information systems (CIS) so that captured data can be used for secondary purposes, including clinical process improvement. Such policies do not account for the extra work required to repurpose data for uses other than direct clinical care, making their implementation problematic. This paper aims to analyze the strategies employed by clinical units to use data effectively for both direct clinical care and clinical process improvement. METHODS: Ethnographic methods were employed. A total of 54 contextual interviews with health professionals spanning various disciplines and 18 hours of observation were carried out in 5 intensive care units in England using an advanced CIS. Case studies of how the extra work was achieved in each unit were derived from the data and then compared. RESULTS: We found that extra work is required to repurpose CIS data for clinical process improvement. Health professionals must enter data not required for clinical care and manipulation of this data into a machine-readable form is often necessary. Ambiguity over who should be responsible for this extra work hindered CIS data usage for clinical process improvement. We describe 11 strategies employed by units to accommodate this extra work, distributing it across roles. Seven of these motivated data entry by health professionals and four addressed the machine readability of data. Many of the strategies relied heavily on the skill and leadership of local clinical customizers. CONCLUSIONS: To realize the expected clinical process improvements by the use of CIS data, clinical leaders and policy makers need to recognize and support the redistribution of the extra work that is involved in data repurposing. Adequate time, funding, and appropriate motivation are needed to enable units to acquire and deliver the necessary skills in CIS customization.

Apps for asthma self-management: a systematic assessment of content and tools.

BACKGROUND: Apps have been enthusiastically adopted by the general public. They are increasingly recognized by policy-makers as a potential medium for supporting self-management of long-term conditions. We assessed the degree to which current smartphone and tablet apps for people with asthma offer content and tools of appropriate quality to support asthma self-management. METHODS: We adapted systematic review methodology to the assessment of apps. We identified English-language asthma apps for all ages through a systematic search of official app stores. We systematically assessed app content using criteria derived from international guidelines and systematic review of strategies for asthma self-management. We covered three domains: comprehensiveness of asthma information, consistency of advice with evidence and compliance with health information best practice principles. RESULTS: We identified 103 apps for asthma in English, of which 56 were sources of information about the condition and 47 provided tools for the management of asthma. No apps offered both types of functionality. Only three information apps approached our definition of comprehensiveness of information about asthma. No apps provided advice on lay management of acute asthma that included details of appropriate reliever medication use. In 32 of 72 instances, apps made unequivocal recommendations about strategies for asthma control or prophylaxis that were unsupported by current evidence. Although 90% of apps stated a clear purpose, compliance with other best practice principles for health information was variable. Contact details were located for 55%, funding source for 18% and confidentiality policy for 17%. CONCLUSIONS: No apps for people with asthma combined reliable, comprehensive information about the condition with supportive tools for self-management. Healthcare professionals considering recommending apps to patients as part of asthma self-management should exercise caution, recognizing that some apps like calculators may be unsafe; that no current app will meet the need of every patient; and that ways of working must be adapted if apps are to be introduced, supported and sustained in routine care. Policy-makers need to consider the potential role for assurance mechanisms in relation to apps. There remains much to be done if apps are to find broad use in clinical practice; clinicians cannot recommend tools that are inaccurate, unsafe or lack an evidence base.