RESUMO
PURPOSE: While patient engagement is becoming more customary in developing health products, its monitoring and evaluation to understand processes and enhance impact are challenging. This article describes a patient engagement monitoring and evaluation (PEME) framework, co-created and tailored to the context of community advisory boards (CABs) for rare diseases in Europe. It can be used to stimulate learning and evaluate impacts of engagement activities. METHODS: A participatory approach was used in which data collection and analysis were iterative. The process was based on the principles of interactive learning and action and guided by the PEME framework. Data were collected via document analysis, reflection sessions, a questionnaire, and a workshop. RESULTS: The tailored framework consists of a theory of change model with metrics explaining how CABs can reach their objectives. Of 61 identified metrics, 17 metrics for monitoring the patient engagement process and short-term outcomes were selected, and a "menu" for evaluating long-term impacts was created. Example metrics include "Industry representatives' understanding of patients' unmet needs;" "Feeling of trust between stakeholders;" and "Feeling of preparedness." "Alignment of research programs with patients' needs" was the highest-ranked metric for long-term impact. CONCLUSIONS: Findings suggest that process and short-term outcome metrics could be standardized across CABs, whereas long-term impact metrics may need to be tailored to the collaboration from a proposed menu. Accordingly, we recommend that others adapt and refine the PEME framework as appropriate. The next steps include implementing and testing the evaluation framework to stimulate learning and share impacts.
RESUMO
BACKGROUND: People with cystic fibrosis (pwCF) are central in the development of patient-led assessment tools. Qualitative analysis of a frequently used CF-specific patient-reported outcome measure (PROM) sought patient recommendations for development of a new quality of life (QoL) tool. METHODS: We performed an inventory of PROMs, symptom-report and QoL tools used in clinical trials within the European Cystic Fibrosis Society Clinical Trial Network (ECFS-CTN) and in routine clinical practice among Cystic Fibrosis Europe and ECFS members. A qualitative study using cognitive interviews with pwCF and their caregivers reviewed the Cystic Fibrosis Questionnaire (CFQ), the French initial form of the Cystic Fibrosis Questionnaire-Revised (CFQ-R). RESULTS: Survey results from 33 countries revealed over 70 tools used in routine clinical practice, utilized by clinical specialists (n=124), pwCF/parents/carers (n=49) and other allied health professionals (n=60). The CFQ-R was the main PROM used in clinical trials. The qualitative study enrolled 99 pwCF, 6 to 11 years (n=31); 12 to 18 years (n=38); >18 years (n=30) and 26 parents. Inductive thematic analysis based on the CFQ, revealed 19 key themes. Themes common across all cohorts included burden of treatment, impact of disease on day-to-day life, relationships/family, stress/mood, and nutrition. Themes unique to individual groups included, treatment when not symptomatic for the paediatric group; education/studies and planning for the future for adolescents, impact of anxiety and depression on day-to-day life for adults, and for parents, questions addressing anxiety and their role as carers. CONCLUSIONS: Patient-centeredness is paramount in development of an up-to-date PROM in the era of novel therapies.
