Don't be late! Timely identification of cognitive impairment in people with multiple sclerosis: a study protocol.

BACKGROUND: Cognitive impairment occurs in up to 65% of people with multiple sclerosis (PwMS), negatively affecting daily functioning and health-related quality of life. In general, neuropsychological testing is not part of standard MS-care due to insufficient time and trained personnel. Consequently, a baseline assessment of cognitive functioning is often lacking, hampering early identification of cognitive decline and change within a person over time. To assess cognitive functioning in PwMS in a time-efficient manner, a BICAMS-based self-explanatory digital screening tool called the Multiple Screener©, has recently been developed. The aim of the current study is to validate the Multiple Screener© in a representative sample of PwMS in the Netherlands. Additionally, we aim to investigate how cognitive functioning is related to psychological factors, and both work and societal participation. METHODS: In this cross-sectional multicentre study, 750 PwMS (aged 18-67 years) are included. To obtain a representative sample, PwMS are recruited via 12 hospitals across the Netherlands. They undergo assessment with the Minimal Assessment of Cognitive Functioning in MS (MACFIMS; reference-standard) and the Multiple Screener©. Sensitivity, specificity, and predictive values for identifying (mild) cognitive impairment are determined in a subset of 300 participants. In a second step, the identified cut-off values are tested in an independent subset of at least 150 PwMS. Moreover, test-retest reliability for the Multiple Screener© is determined in 30 PwMS. Information on psychological and work-related factors is assessed with questionnaires. DISCUSSION: Validating the Multiple Screener© in PwMS and investigating cognition and its determinants will further facilitate early identification and adequate monitoring of cognitive decline in PwMS.

Personalized monitoring of ambulatory function with a smartphone 2-minute walk test in multiple sclerosis.

BACKGROUND: Remote smartphone-based 2-minute walking tests (s2MWTs) allow frequent and potentially sensitive measurements of ambulatory function. OBJECTIVE: To investigate the s2MWT on assessment of, and responsiveness to change in ambulatory function in MS. METHODS: One hundred two multiple sclerosis (MS) patients and 24 healthy controls (HCs) performed weekly s2MWTs on self-owned smartphones for 12 and 3 months, respectively. The timed 25-foot walk test (T25FW) and Expanded Disability Status Scale (EDSS) were assessed at 3-month intervals. Anchor-based (using T25FW and EDSS) and distribution-based (curve fitting) methods were used to assess responsiveness of the s2MWT. A local linear trend model was used to fit weekly s2MWT scores of individual patients. RESULTS: A total of 4811 and 355 s2MWT scores were obtained in patients (n = 94) and HC (n = 22), respectively. s2MWT demonstrated large variability (65.6 m) compared to the average score (129.5 m), and was inadequately responsive to anchor-based change in clinical outcomes. Curve fitting separated the trend from noise in high temporal resolution individual-level data, and statistically reliable changes were detected in 45% of patients. CONCLUSIONS: In group-level analyses, clinically relevant change was insufficiently detected due to large variability with sporadic measurements. Individual-level curve fitting reduced the variability in s2MWT, enabling the detection of statistically reliable change in ambulatory function.

Towards individualized monitoring of cognition in multiple sclerosis in the digital era: A one-year cohort study.

BACKGROUND: Cognitive impairment is frequent in multiple sclerosis (MS), but reliable, sensitive and individualized monitoring in clinical practice is still limited. Smartphone-adapted tests may enhance the assessment of function as tests can be performed more frequently and within the daily living environment. The objectives were to prove reproducibility of a smartphone-based Symbol Digit Modalities Test (sSDMT), its responsiveness to relevant change in clinical cognitive outcomes, and develop an individual-based monitoring method for cognition. METHODS: In a one-year cohort study with 102 patients with MS, weekly sSDMTs were performed and analyzed on reproducibility parameters: the standard error of measurement (SEM) and smallest detectable change (SDC). Responsiveness of the sSDMT to relevant change in the 3-monthly clinically assessed SDMT (i.e. 4-point change) was quantified with the area under the receiver operating characteristic curve (AUC). Curve fitting of the weekly sSDMT scores of individual patients was performed with a local linear trend model to estimate and visualize the de-noised cognitive state and 95% confidence interval (CI). The optimal assessment frequency was determined by analyzing the CI bandwidth as a function of sSDMT assessment frequency. RESULTS: Weekly sSDMT showed improved reproducibility estimates (SEM=2.94, SDC=8.15) compared to the clinical SDMT. AUC-values did not exceed 0.70 in classifying relevant change in cSDMT. However, utilizing weekly sSDMT measurements, estimated state curves and the 95% CI were plotted showing detailed changes within individuals over time. With a test frequency of once per 12 days, 4-point changes in sSDMT can be detected. CONCLUSION: A local linear trend model applied on sSDMT scores of individual patients increases the signal-to-noise ratio substantially, which improves the detection of statistically reliable changes. Therefore, this fine-grained individual-based monitoring approach can be used to complement current clinical assessment to enhance clinical care in MS. TRIAL REGISTRATION: Netherlands Trial Register NL7070; https://www.trialregister.nl/trial/7070.

A Two-Minute Walking Test With a Smartphone App for Persons With Multiple Sclerosis: Validation Study.

BACKGROUND: Walking disturbances are a common dysfunction in persons with multiple sclerosis (MS). The 2-Minute Walking Test (2MWT) is widely used to quantify walking speed. We implemented a smartphone-based 2MWT (s2MWT) in MS sherpa, an app for persons with MS. When performing the s2MWT, users of the app are instructed to walk as fast as safely possible for 2 minutes in the open air, while the app records their movement and calculates the distance walked. OBJECTIVE: The aim of this study is to investigate the concurrent validity and test-retest reliability of the MS sherpa s2MWT. METHODS: We performed a validation study on 25 persons with relapsing-remitting MS and 79 healthy control (HC) participants. In the HC group, 21 participants were matched to the persons with MS based on age, gender, and education and these followed the same assessment schedule as the persons with MS (the HC-matched group), whereas 58 participants had a less intense assessment schedule to determine reference values (the HC-normative group). Intraclass correlation coefficients (ICCs) were determined between the distance measured by the s2MWT and the distance measured using distance markers on the pavement during these s2MWT assessments. ICCs were also determined for test-retest reliability and derived from 10 smartphone tests per study participant, with 3 days in between each test. We interviewed 7 study participants with MS regarding their experiences with the s2MWT. RESULTS: In total, 755 s2MWTs were completed. The adherence rate for the persons with MS and the participants in the HC-matched group was 92.4% (425/460). The calculated distance walked on the s2MWT was, on average, 8.43 m or 5% (SD 18.9 m or 11%) higher than the distance measured using distance markers (n=43). An ICC of 0.817 was found for the concurrent validity of the s2MWT in the combined analysis of persons with MS and HC participants. Average ICCs of 9 test-retest reliability analyses of the s2MWT for persons with MS and the participants in the HC-matched group were 0.648 (SD 0.150) and 0.600 (SD 0.090), respectively, whereas the average ICC of 2 test-retest reliability analyses of the s2MWT for the participants in the HC-normative group was 0.700 (SD 0.029). The interviewed study participants found the s2MWT easy to perform, but they also expressed that the test results can be confronting and that a pressure to reach a certain distance can be experienced. CONCLUSIONS: The high correlation between s2MWT distance and the conventional 2MWT distance indicates a good concurrent validity. Similarly, high correlations underpin a good test-retest reliability of the s2MWT. We conclude that the s2MWT can be used to measure the distance that the persons with MS walk in 2 minutes outdoors near their home, from which both clinical studies and clinical practice can benefit.

Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study.

BACKGROUND: The decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS. OBJECTIVE: The aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT). METHODS: We performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the "HC matched" group) and 58 subjects had a less intense assessment schedule to determine reference values (the "HC normative" group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT. RESULTS: The SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS. CONCLUSIONS: The high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

Toward Digital Self-monitoring of Multiple Sclerosis: Investigating First Experiences, Needs, and Wishes of People with MS.

BACKGROUND: Digital self-monitoring, such as through smartphone applications (apps) or activity trackers, could be applied to monitor the health of people with multiple sclerosis (MS). This self-monitoring could facilitate personalized therapies and self-management of MS. The acceptance of digital self-monitoring tools by patients depends on them being able and willing to use these tools in their daily lives. METHODS: In-depth interviews were conducted with seven adults with MS before and after participation in a study in which they used an activity tracker and an MS-specific smartphone app for 4 weeks. We inquired about experiences with the tools in daily life and needs and wishes regarding further development and implementation of digital self-monitoring for people with MS. RESULTS: The smartphone app and the activity tracker increased respondents' awareness of their physical status and stimulated them to act on the data. Challenges, such as confrontation with their MS and difficulties with data interpretation, were discussed. The respondents desired 1) adaptation of digital self-monitoring tools to a patient's personal situation, 2) guidance to increase the value of the data, and 3) integration of digital self-monitoring into treatment plans. CONCLUSIONS: These findings show that patients can provide detailed descriptions of their daily life experiences with new technologies. Mapping these experiences could help in better aligning the development and implementation of digital self-monitoring tools, in this case smartphones and activity trackers, with the needs and wishes of people with MS.