Correction: Data Sharing Goals for Nonprofit Funders of Clinical Trials.

[This corrects the article DOI: 10.2196/23011.].

Data Sharing Goals for Nonprofit Funders of Clinical Trials.

Sharing clinical trial data can provide value to research participants and communities by accelerating the development of new knowledge and therapies as investigators merge data sets to conduct new analyses, reproduce published findings to raise standards for original research, and learn from the work of others to generate new research questions. Nonprofit funders, including disease advocacy and patient-focused organizations, play a pivotal role in the promotion and implementation of data sharing policies. Funders are uniquely positioned to promote and support a culture of data sharing by serving as trusted liaisons between potential research participants and investigators who wish to access these participants' networks for clinical trial recruitment. In short, nonprofit funders can drive policies and influence research culture. The purpose of this paper is to detail a set of aspirational goals and forward thinking, collaborative data sharing solutions for nonprofit funders to fold into existing funding policies. The goals of this paper convey the complexity of the opportunities and challenges facing nonprofit funders and the appropriate prioritization of data sharing within their organizations and may serve as a starting point for a data sharing toolkit for nonprofit funders of clinical trials to provide the clarity of mission and mechanisms to enforce the data sharing practices their communities already expect are happening.

Effective Data Sharing as a Conduit for Advancing Medical Product Development.

INTRODUCTION: Patient-level data sharing has the potential to significantly impact the lives of patients by optimizing and improving the medical product development process. In the product development setting, successful data sharing is defined as data sharing that is actionable and facilitates decision making during the development and review of medical products. This often occurs through the creation of new product development tools or methodologies, such as novel clinical trial design and enrichment strategies, predictive pre-clinical and clinical models, clinical trial simulation tools, biomarkers, and clinical outcomes assessments, and more. METHODS: To be successful, extensive partnerships must be established between all relevant stakeholders, including industry, academia, research institutes and societies, patient-advocacy groups, and governmental agencies, and a neutral third-party convening organization that can provide a pre-competitive space for data sharing to occur. CONCLUSIONS: Data sharing focused on identified regulatory deliverables that improve the medical product development process encounters significant challenges that are not seen with data sharing aimed at advancing clinical decision making and requires the commitment of all stakeholders. Regulatory data sharing challenges and solutions, as well as multiple examples of previous successful data sharing initiatives are presented and discussed in the context of medical product development.

Standardized Data Structures in Rare Diseases: CDISC User Guides for Duchenne Muscular Dystrophy and Huntington's Disease.

Interest in drug development for rare diseases has expanded dramatically since the Orphan Drug Act was passed in 1983, with 40% of new drug approvals in 2019 targeting orphan indications. However, limited quantitative understanding of natural history and disease progression hinders progress and increases the risks associated with rare disease drug development. Use of international data standards can assist in data harmonization and enable data exchange, integration into larger datasets, and a quantitative understanding of disease natural history. The US Food and Drug Administration (FDA) requires the use of Clinical Data Interchange Consortium (CDISC) Standards in new drug submissions to help the agency efficiently and effectively receive, process, review, and archive submissions, as well as to help integrate data to answer research questions. Such databases have been at the core of biomarker qualification efforts and fit-for-purpose models endorsed by the regulators. We describe the development of CDISC therapeutic area user guides for Duchenne muscular dystrophy and Huntington's disease through Critical Path Institute consortia. These guides describe formalized data structures and controlled terminology to map and integrate data from different sources. This will result in increased standardization of data collection and allow integration and comparison of data from multiple studies. Integration of multiple data sets enables a quantitative understanding of disease progression, which can help overcome common challenges in clinical trial design in these and other rare diseases. Ultimately, clinical data standardization will lead to a faster path to regulatory approval of urgently needed new therapies for patients.

Advancing Therapeutic Development for Pulmonary Morbidities Associated with Preterm Birth.

Chronic pulmonary and respiratory conditions associated with preterm birth are incompletely characterized, complicating long-term treatment and development of more effective therapies. Stakeholders face challenges in the development of validated, clinically meaningful endpoints that adequately measure morbidities and predict or represent health outcomes for preterm neonates. We propose in this paper a research agenda, informed by the input of experts from a 2018 workshop we convened on this topic, to advance endpoint and treatment development. We discuss the necessity of further evaluation of existing endpoints and the improved characterization of disease endotypes. We also discuss key steps to the development of optimized short- and long-term endpoints that can be linked to meaningful health outcomes. Finally, we discuss the importance of limiting variability in data collection and the application of new clinical trial endpoints as well as the critical nature of multi-stakeholder collaboration to advancing therapeutic development for this vulnerable patient population.

Evaluation of multiple sclerosis disability outcome measures using pooled clinical trial data.

OBJECTIVE: We report analyses of a pooled database by the Multiple Sclerosis Outcome Assessments Consortium to evaluate 4 proposed components of a multidimensional test battery. METHODS: Standardized data on 12,776 participants, comprising demographics, multiple sclerosis disease characteristics, Expanded Disability Status Scale (EDSS) score, performance measures, and Short Form-36 Physical Component Summary (SF-36 PCS), were pooled from control and treatment arms of 14 clinical trials. Analyses of Timed 25-Foot Walk (T25FW), 9-Hole Peg Test (9HPT), Low Contrast Letter Acuity (LCLA), and Symbol Digit Modalities Test (SDMT) included measurement properties; construct, convergent, and known group validity; and longitudinal performance of the measures individually and when combined into a multidimensional test battery relative to the EDSS and SF-36 to determine sensitivity and clinical meaningfulness. RESULTS: The performance measures had excellent test-retest reliability and showed expected differences between subgroups based on disease duration and EDSS level. Progression rates in detecting time to 3-month confirmed worsening were lower for T25FW and 9HPT compared to EDSS, while progression rates for LCLA and SDMT were similar to EDSS. When the 4 measures were analyzed as a multidimensional measure rather than as individual measures, progression on any one performance measure was more sensitive than the EDSS. Worsening on the performance measures analyzed individually or as a multidimensional test battery was associated with clinically meaningful SF-36 PCS score worsening, supporting clinical meaningfulness of designated performance test score worsening. CONCLUSION: These results support the use of the 4 proposed performance measures, individually or combined into a multidimensional test battery as study outcome measures.

Symbol Digit Modalities Test: A valid clinical trial endpoint for measuring cognition in multiple sclerosis.

BACKGROUND: The need for more robust outcomes in multiple sclerosis (MS) clinical trials has been a main priority of the field for decades. Dissatisfaction with existing measures has led to several consensus meetings and initiatives over the past few decades in hopes of defining and gaining acceptance of measures that are valid, reliable, sensitive to change and progression, and most importantly, relevant to those living with MS. The Multiple Sclerosis Outcome Assessments Consortium (MSOAC) was formed for this purpose. OBJECTIVE: The objective of this paper is to describe the results of the MSOAC plan to obtain qualification for a cognitive performance measure that meets these requirements. METHODS: Using data from 14 MS disease-modifying registration trials, we completed a comprehensive examination of the psychometric qualities of the Symbol Digit Modalities Test (SDMT) and the Paced Auditory Serial Addition Test (PASAT) with the goal of compiling evidence to support the utilization of one of these measures in future clinical trials. RESULTS AND CONCLUSION: Consistent with the published literature, the SDMT proved superior to the PASAT. The SDMT should be considered the measure of choice for MS trials in assessing cognitive processing speed.

The MSOAC approach to developing performance outcomes to measure and monitor multiple sclerosis disability.

BACKGROUND: The Multiple Sclerosis Outcome Assessments Consortium (MSOAC) was formed by the National MS Society to develop improved measures of multiple sclerosis (MS)-related disability. OBJECTIVES: (1) To assess the current literature and available data on functional performance outcome measures (PerfOs) and (2) to determine suitability of using PerfOs to quantify MS disability in MS clinical trials. METHODS: (1) Identify disability dimensions common in MS; (2) conduct a comprehensive literature review of measures for those dimensions; (3) develop an MS Clinical Data Interchange Standards Consortium (CDISC) data standard; (4) create a database of standardized, pooled clinical trial data; (5) analyze the pooled data to assess psychometric properties of candidate measures; and (6) work with regulatory agencies to use the measures as primary or secondary outcomes in MS clinical trials. CONCLUSION: Considerable data exist supporting measures of the functional domains ambulation, manual dexterity, vision, and cognition. A CDISC standard for MS ( http://www.cdisc.org/therapeutic#MS ) was published, allowing pooling of clinical trial data. MSOAC member organizations contributed clinical data from 16 trials, including 14,370 subjects. Data from placebo-arm subjects are available to qualified researchers. This integrated, standardized dataset is being analyzed to support qualification of disability endpoints by regulatory agencies.

Application of a Dynamic Map for Learning, Communicating, Navigating, and Improving Therapeutic Development.

Drug discovery and development is commonly schematized as a "pipeline," and, although appreciated by drug developers to be a useful oversimplification, this cartology may perpetuate inaccurate notions of straightforwardness and is of minimal utility for process engineering to improve efficiency. To create a more granular schema, a group of drug developers, researchers, patient advocates, and regulators developed a crowdsourced atlas of the steps involved in translating basic discoveries into health interventions, annotated with the steps that are particularly prone to difficulty or failure. This Drug Discovery, Development, and Deployment Map (4DM), provides a network view of the process, which will be useful for communication and education to those new to the field, orientation and navigation of individual projects, and prioritization of technology development and re-engineering endeavors to improve efficiency and effectiveness. The 4DM is freely available for utilization, modification, and further development by stakeholders across the translational ecosystem.

The Nine-Hole Peg Test as a manual dexterity performance measure for multiple sclerosis.

Impaired manual dexterity is a frequently reported disability in people with multiple sclerosis (MS) and is increasingly prevalent with worsening disease. While various tests and patient-reported outcome measures are available, the Nine-Hole Peg Test (NHPT) is considered as a gold standard measure of manual dexterity and most frequently used in MS research and clinical practice. The MS Outcome Assessments Consortium (MSOAC) includes representatives from advocacy organizations, Food and Drug Administration (FDA), European Medicines Agency (EMA), National Institute of Neurological Disorders and Stroke (NINDS), academic institutions, and industry partners along with persons living with MS. Among the MSOAC goals are acceptance and qualification by regulators of performance outcomes that are highly reliable and valid, practical, cost-effective, and meaningful to persons with MS. A critical step for these neuroperformance metrics is elucidation of clinically relevant benchmarks, well-defined degrees of disability, and gradients of change that are deemed clinically meaningful. This article addresses the NHPT, the proposed MSOAC measure for upper extremity function. We find that the NHPT is reliable within and between test sessions, discriminates between healthy subjects and MS patients with different levels of upper limb impairment, and shows high convergent validity with other manual dexterity as well as more comprehensive upper limb measures. Ecological validity is established by its relation to perceived upper limb use in daily life and perceived difficulty in performing activities of daily living. The NHPT is responsive to deterioration in longitudinal studies, and research suggests that a 20% change in test score is commonly used to define clinically meaningful worsening, a definition that needs further validation in all stages of the disease.

Validity of the timed 25-foot walk as an ambulatory performance outcome measure for multiple sclerosis.

The Multiple Sclerosis Outcome Assessments Consortium (MSOAC) includes representatives from advocacy organizations, Food and Drug Administration (FDA), European Medicines Agency (EMA), National Institute of Neurological Disorders and Stroke (NINDS), academic institutions, and industry partners along with persons living with multiple sclerosis (MS). One of the MSOAC goals is acceptance and qualification by regulators of performance outcomes that are highly reliable and valid, practical, cost-effective, and meaningful in MS. This article addresses the history, application, and psychometric properties of one such MSOAC metric of ambulation or walking namely, the timed 25-foot walk (T25FW). The T25FW has strong reliability over both brief and long periods of time in MS across a large range of disability levels. The outcome of walking speed from the T25FW has obvious real-world relevance and has correlated strongly with other measures of walking and lower extremity function. The T25FW is responsive for capturing intervention effects in pharmacological and rehabilitation trials and has an established value for capturing clinically meaningful change in ambulation. Directions for future research involve validating clinically meaningful improvements on the T25FW as well as determining whether 20% change is clinically meaningful across the disability spectrum. Researchers might further consider synchronizing accelerometers and motion sensors with the T25FW for capturing walking speed in everyday life and the patient's real environment.

Validity of the Symbol Digit Modalities Test as a cognition performance outcome measure for multiple sclerosis.

Cognitive and motor performance measures are commonly employed in multiple sclerosis (MS) research, particularly when the purpose is to determine the efficacy of treatment. The increasing focus of new therapies on slowing progression or reversing neurological disability makes the utilization of sensitive, reproducible, and valid measures essential. Processing speed is a basic elemental cognitive function that likely influences downstream processes such as memory. The Multiple Sclerosis Outcome Assessments Consortium (MSOAC) includes representatives from advocacy organizations, Food and Drug Administration (FDA), European Medicines Agency (EMA), National Institute of Neurological Disorders and Stroke (NINDS), academic institutions, and industry partners along with persons living with MS. Among the MSOAC goals is acceptance and qualification by regulators of performance outcomes that are highly reliable and valid, practical, cost-effective, and meaningful to persons with MS. A critical step for these neuroperformance metrics is elucidation of clinically relevant benchmarks, well-defined degrees of disability, and gradients of change that are deemed clinically meaningful. This topical review provides an overview of research on one particular cognitive measure, the Symbol Digit Modalities Test (SDMT), recognized as being particularly sensitive to slowed processing of information that is commonly seen in MS. The research in MS clearly supports the reliability and validity of this test and recently has supported a responder definition of SDMT change approximating 4 points or 10% in magnitude.

Validity of low-contrast letter acuity as a visual performance outcome measure for multiple sclerosis.

Low-contrast letter acuity (LCLA) has emerged as the leading outcome measure to assess visual disability in multiple sclerosis (MS) research. As visual dysfunction is one of the most common manifestations of MS, sensitive visual outcome measures are important in examining the effect of treatment. Low-contrast acuity captures visual loss not seen in high-contrast visual acuity (HCVA) measurements. These issues are addressed by the MS Outcome Assessments Consortium (MSOAC), including representatives from advocacy organizations, Food and Drug Administration (FDA), European Medicines Agency (EMA), National Institute of Neurological Disorders and Stroke (NINDS), academic institutions, and industry partners along with persons living with MS. MSOAC goals are acceptance and qualification by regulators of performance outcomes that are highly reliable and valid, practical, cost-effective, and meaningful to persons with MS. A critical step is elucidation of clinically relevant benchmarks, well-defined degrees of disability, and gradients of change that are clinically meaningful. This review shows that MS and disease-free controls have similar median HCVA, while MS patients have significantly lower LCLA. Deficits in LCLA and vision-specific quality of life are found many years after an episode of acute optic neuritis, even when HCVA has recovered. Studies reveal correlations between LCLA and the Expanded Disability Status Score (EDSS), Multiple Sclerosis Functional Composite (MSFC), retinal nerve fiber layer (RNFL) and ganglion cell layer plus inner plexiform layer (GCL + IPL) thickness on optical coherence tomography (OCT), brain magnetic resonance imaging (MRI), visual evoked potential (VEP), electroretinogram (ERG), pupillary function, and King-Devick testing. This review also concludes that a 7-point change in LCLA is clinically meaningful. The overall goal of this review is to describe and characterize the LCLA metric for research and clinical use among persons with MS.

Multiple Sclerosis Outcome Assessments Consortium: Genesis and initial project plan.

The need for improved clinical outcome measures in multiple sclerosis trials has been recognized for two decades, but only recently has the Food and Drug Administration (FDA) created a pathway for qualification of new clinician-reported outcome (ClinRO) assessments. Additionally, drug development in multiple sclerosis (MS) has been extraordinarily active, with numerous disease-modifying drugs now on the market. This shifting therapeutic landscape, along with the unmet need for drugs to treat the progressive forms of MS and the changing expectations of clinicians, patients, and payers, have led to the call for more sensitive and meaningful disability progression measures. In response to these drivers, the Multiple Sclerosis Outcome Assessments Consortium (MSOAC) was launched. A public-private partnership, MSOAC aims to accelerate the development of new therapies for MS by generating new tools for measuring outcomes in clinical trials. At the first annual MSOAC/FDA meeting, a regulatory path was outlined for qualifying a new tool for assessing efficacy in registration trials of MS. The European Medicines Agency (EMA) and FDA will provide parallel consultation and review. The consensus approach with engagement by all of the stakeholders, prominently including patients with MS, should also increase acceptance of the measure by clinicians and patients.