Evaluation of Prognostic and Predictive Models in the Oncology Clinic.

Predictive and prognostic models hold great potential to support clinical decision making in oncology and could ultimately facilitate a paradigm shift to a more personalised form of treatment. While a large number of models relevant to the field of oncology have been developed, few have been translated into clinical use and assessment of clinical utility is not currently considered a routine part of model development. In this narrative review of the clinical evaluation of prediction models in oncology, we propose a high-level process diagram for the life cycle of a clinical model, encompassing model commissioning, clinical implementation and ongoing quality assurance, which aims to bridge the gap between model development and clinical implementation.

Participatory co-design and normalisation process theory with staff and patients to implement digital ways of working into routine care: the example of electronic patient-reported outcomes in UK renal services.

BACKGROUND: Successful implementation of digital health systems requires contextually sensitive solutions. Working directly with system users and drawing on implementation science frameworks are both recommended. We sought to combine Normalisation Process Theory (NPT) with participatory co-design methods, to work with healthcare stakeholders to generate implementation support recommendations for a new electronic patient reported outcome measure (ePRO) in renal services. ePROs collect data on patient-reported symptom burden and illness experience overtime, requiring sustained engagement and integration into existing systems. METHODS: We identified co-design methods that could be mapped to NPT constructs to generate relevant qualitative data. Patients and staff from three renal units in England participated in empathy and process mapping activities to understand 'coherence' (why the ePRO should be completed) and 'cognitive participation' (who would be involved in collecting the ePRO). Observation of routine unit activity was completed to understand 'collective action' (how the collection of ePRO could integrate with service routines). RESULTS: The mapping activities and observation enabled the research team to become more aware of the key needs of both staff and patients. Working within sites enabled us to consider local resources and barriers. This produced 'core and custom' recommendations specifying core needs that could be met with customised local solutions. We identified two over-arching themes which need to be considered when introducing new digital systems (1) That data collection is physical (electronic systems need to fit into physical spaces and routines), and (2) That data collection is intentional (system users must be convinced of the value of collecting the data). CONCLUSIONS: We demonstrate that NPT constructs can be operationalised through participatory co-design to work with stakeholders and within settings to collaboratively produce implementation support recommendations. This enables production of contextually sensitive implementation recommendations, informed by qualitative evidence, theory, and stakeholder input. Further longitudinal evaluation is necessary to determine how successful the recommendations are in practice.

Guideline-related barriers to optimal prescription of oral anticoagulants in primary care.

Guidelines provide recommendations for antithrombotic treatment to prevent stroke in people with atrial fibrillation, but oral anticoagulant prescriptions in Dutch primary care are often discordant with these recommendations. Suboptimal guideline features (i.e. format and content) have been suggested as a potential explanatory factor for this type of discordance. Therefore, we systematically appraised features of the Dutch general practitioners' (NHG) atrial fibrillation guideline to identify guidelinerelated barriers that may hamper its use in practice. We appraised the guideline's methodological rigour and transparency using the Appraisal of Guidelines, Research and Evaluation (AGREE) II tool. Additionally, we used the Guideline Implementability Appraisal (GLIA) tool to assess the key recommendations on oral anticoagulant prescription. The editorial independence of the guideline group scored highly (88%); scores for other aspects of the guideline's methodological quality were acceptable, ranging from 53% for stakeholder involvement to 67% for clarity of presentation. At the recommendation level, the main implementation obstacles were lack of explicit statements on the quality of underlying evidence, lack of clarity around the strength of recommendations, and the use of ambiguous terms which may hamper operationalisation in electronic systems. Based on our findings we suggest extending stakeholder involvement in the guideline development process, standardising the layout and language of key recommendations, providing monitoring criteria, and preparing electronic implementation parallel with guideline development. We expect this to contribute to optimising the NHG atrial fibrillation guideline, facilitating its implementation in practice, and ultimately to improving antithrombotic treatment and stroke prevention in people with atrial fibrillation.

The use of indicators to improve the quality of intensive care: theoretical aspects and experiences from the Dutch intensive care registry.

In the concept of total quality management that was originally developed in industry, the use of quality indicators is essential. The implementation of quality indicators in the intensive care unit to improve the quality of care is a complex process. This process can be described in seven subsequent steps of an indicator-based quality improvement (IBQI) cycle. With this IBQI cycle, a continuous quality improvement can be achieved with the use of indicator data in a benchmark setting. After the development of evidence-based indicators, a sense of urgency has to be created, registration should start, raw data must be analysed, feedback must be given, and interpretation and conclusions must be made, followed by a quality improvement plan. The last step is the implementation of changes that needs a sense of urgency, and this completes the IBQI cycle. Barriers and facilitators are found in each step. They should be identified and addressed in a multifaceted quality improvement strategy.

Control charts in healthcare quality improvement. A systematic review on adherence to methodological criteria.

OBJECTIVES: Use of Shewhart control charts in quality improvement (QI) initiatives is increasing. These charts are typically used in one or more phases of the Plan Do Study Act (PDSA) cycle to monitor summaries of process and outcome data, abstracted from clinical information systems, over time. We summarize methodological criteria of Shewhart control charts and investigate adherence of published QI studies to these criteria. METHODS: We searched Medline, Embase and CINAHL for studies using Shewhart control charts in QI processes in direct patient care. We extracted methodological criteria for Shewhart control charts, and for the use of these charts in PDSA cycles, from textbooks and methodological literature. RESULTS: We included 34 studies, presenting 64 control charts of which 40 control charts plotted two phases of the PDSA cycle. The criterion to use 10-35 data points in a control chart was least adhered to (48.4% non-adherence). Other criteria were: transformation of the data in case of a skewed distribution (43.7% non adherence), when comparing data from two phases of the PDSA cycle the Plan phase (the first phase) needs to be stable (40.0% non-adherence), using a maximum of four different rules to detect special cause variation (14.1% non-adherence), and setting control limits at three standard deviations from the mean (all control charts adhered). CONCLUSION: There is room for improvement with regard to the methodological construction of Shewhart control charts used in QI processes. Higher adherence to all methodological criteria will decrease the risk of incorrect conclusions about the process being monitored.