International experiences in the development and implementation of guideline-based quality indicators: a qualitative study.

OBJECTIVES: Evidence-based clinical guidelines play an important role in healthcare and can be a valuable source for quality indicators (QIs). However, the link between guidelines and QI is often neglected and methodological standards for the development of guideline-based QI are still lacking. The aim of this qualitative study was to get insights into experiences of international authors with developing and implementing guideline-based QI. SETTING: We conducted semistructured interviews via phone or skype (September 2017-February 2018) with guideline authors developing guideline-based QI. PARTICIPANTS: 15 interview participants from eight organisations in six European and North American countries. METHODS: Organisations were selected using purposive sampling with a maximum variation of healthcare settings. From each organisation a clinician and a methodologist were asked to participate. An interview guide was developed based on the QI development steps according to the 'Reporting standards for guideline-based performance measures' by the Guidelines International Network. Interviews were analysed using qualitative content analysis with deductive and inductive categories. RESULTS: Interviewees deemed a programmatic approach, involvement of representative stakeholders with clinical and methodological knowledge and the connection to existing quality improvement strategies important factors for developing QI parallel to or after guideline development. Methodological training of the developing team and a shared understanding of the QI purpose were further seen conducive. Patient participation and direct patient relevance were inconsistently considered important, whereas a strong evidence base was seen essential. To assess measurement characteristics interviewees favoured piloting, but often missed implementation. Lack of measurability is still experienced a serious limitation, especially for qualitative aspects and individualised care. CONCLUSION: Our results suggest that developing guideline-based QI can succeed either parallel to or following the guideline process with careful planning and instruction. Strategic partnerships seem key for implementation. Patient participation and relevance, measurement of qualitative aspects and piloting are areas for further development. TRIAL REGISTRATION NUMBER: German Clinical Trials Registry (DRKS00013006).

[(How) Are quality indicators for measuring and appraising the quality of healthcare derived from evidence-based clinical practice guidelines? A review]. / (Wie) Erfolgt die Ableitung von Qualitätsindikatoren zur Messung und Bewertung der Versorgungsqualität im Rahmen von S3-Leitlinien? Eine Übersichtsarbeit.

BACKGROUND: Evidence-based and formally consensus-based clinical practice guidelines (CPGs) offer potential for the development of quality indicators (QIs). Although QIs are recommended as part of some CPGs, there is no accepted gold standard for the specific development process of guideline-based QIs. The purpose of this review, which is embedded in a mixed-methods research project, was to analyze the current state of methodological approaches for QI development in German CPGs to derive insights for the development of a national evidence-guided and consensus-based standard for guideline-based development of QIs. METHODS: In order to identify valid CPGs containing recommendations for QIs, a search was carried out (July 31, 2016) via the guideline database of the German Association of the Scientific Medical Societies (AWMF). Based on a stratified random sample per guideline program (guidelines published by medical societies, National Program for Disease Management Guidelines (DMG), and the German Guideline Program in Oncology [GGPO]), 11 CPGs were selected. With regard to QIs, the specific development methodology, indications on their psychometric properties and how the quality of care should be examined by recommended QIs were extracted and compared by using the guideline documents. RESULTS: In 35 of the 109 (16/85 medical societies, 4/8 DMG, 15/16 GGPO) (32 %) valid CPGs, a total of 372 QIs were recommended. Based on 11 randomly selected guidelines (5 published by medical societies, 1 DMG, 5 GGPO; a total of 109 QIs), the QI development methodology was inconsistent in all five medical societies guidelines (including QI presentation, usage and selection of guideline recommendations for QI derivation) compared to DMG and GGPO. Based on all 109 QIs, 2 (2 %) were presented as a quantitative measure with a reference range, and quality objectives were formulated for 17 (16 %). There was no guideline explicitly reporting about the results of a pilot study or data-based analysis of the psychometric properties of the recommended QIs. The GGPO guideline documents were the only ones providing information on the assessment of the quality of care based on recommended QIs. DISCUSSION: The usage of the QI manuals of the DMG and GGPO leads to a largely standardized development of guideline-based QIs. In the CPGs of the medical societies - if at all - QIs are developed inconsistently and mostly unsystematically. Due to largely missing reference ranges and quality objectives, the identified QIs cannot yet be used to transparently identify potential quality deficits in health care. This requires results of pilot studies and further development of guideline-based QI. CONCLUSIONS: A standard for QI development is needed for German guideline authors to seize the opportunity and develop clinically relevant, widely accepted and evidence-based QIs in the guideline development process. In addition, it must be ensured that appropriate structures are used or set up in order to be able to apply the recommended QIs in the German healthcare system.

Guideline-based quality indicators-a systematic comparison of German and international clinical practice guidelines: protocol for a systematic review.

BACKGROUND: Quality indicators (QIs) are used in assessing the quality of healthcare. Evidence-based clinical practice guidelines (CPGs) are relevant sources for generating QIs. In this context, QIs are important tools to assess the implementation of guideline recommendations. However, the methodological approaches to guideline-based QI development vary considerably. In Germany, the guideline classification scheme of the AWMF (German Association of the Scientific Medical Societies) differentiates between S1-, S2k-, S2e-, and S3-CPGs depending on the methodological approach. Thus, S3-CPGs are consensus- and evidence-based CPGs and have the highest methodological standard in Germany. An analysis of the status quo of reported QIs in S3-CPGs found 35 current S3-CPGs, which report 372 different QIs. Currently, there is no gold standard for the development of guideline-based QIs. To our knowledge, no studies have investigated to what extent guideline-based QIs from different CPGs that are related to the same topic are consistent. The objective of this study is to compare guideline-based QIs and their underlying methodological approaches of German S3-CPGs with those of topic-related international CPGs. METHODS: Based on the previous identified German S3-CPGs (n = 35), which report quality indicators, we will conduct systematic searches in the guidelines databases of G-I-N (Guidelines International Network) and NGC (National Guideline Clearinghouse) to identify international CPGs matching the topics of the S3-CPGs. If necessary, we will search additionally the websites of the particular CPG providers for separate documents with regard to QIs. We will include evidence-based CPGs which report QIs. Reported QIs as well as methods of development and the rationale for QIs will be extracted and compared with those of the S3-CPGs. DISCUSSION: This study will be part of the project "Systematic analysis of the translation of guideline recommendations into quality indicators and development of an evidence- and consensus-based standard," supported by the German Research Association (DFG). The results of this analysis will feed into a subsequent qualitative study, which will consist of structured interviews with developers of international CPGs. Further, the results will be considered in a consensus study on standards of the translation of guideline recommendations into quality indicators in Germany.

Do overweight workers profit by workplace health promotion, more than their normal-weight peers? Evaluation of a worksite intervention.

BACKGROUND: Worksite health promotion programs have been identified as strongly effective in decreasing body weight and increasing awareness and change in health behavior. Aim of this study is to determine the effects of a multi-component intervention in workplace health promotion. METHODS: In a controlled study trail, 1,573 workers of a logistics company had the chance to participate in a one year worksite health promotion program. Main elements of the multi-component intervention were physical activity training in combination with nutrition counseling. Employees completed a questionnaire at baseline and then again after twelve month. Main outcome variables were changes in body weight and health behaviors. Secondary outcomes were subjective health indicators. RESULTS: Our results showed preliminary improvements in physical activity and eating behavior among normal weight and overweight/obesity weight groups. No significant weight reduction could be found, only a minimal reduction of BMI. The reduction was larger in the overweight group. Workers considered overweight or obese showed significantly greater body weight loss and changes in eating behavior than workers with a normal weight status. Workers with obesity/overweight scored their general health status significantly lower than their colleagues with normal weight status. No significant improvements were found for overall perception of health status between baseline and follow-up in the BMI-groups. CONCLUSION: This 12-month intervention-control study suggests that a well-implemented multi-component workplace health promotion program may support substantial change in health behavior (e.g. nutrition and physical activity). It is indicated that overweight employees may especially profit from such worksite health promotion. An investigation of long-term effects of this multi-component intervention is strongly recommended.