The value of experts by experience in social domain supervision in the Netherlands: results from a 'mystery guests' project.

BACKGROUND: User involvement and participation in the supervision of the quality of care is an important topic for many healthcare inspectorates. It offers regulators an additional view on quality, increases the legitimacy and accountability of the inspectorate, empowers users and enhancing the public's trust in the inspectorate. To assess the accessibility of the local governmental social domain services the Joint Inspectorate Social Domain in the Netherlands worked together with people with intellectual disabilities performing as 'mystery guests' in an innovative project. This paper describes the findings of the evaluation of this project. METHODS: People with intellectual disabilities living at home on their own may need some help with daily activities such as administrative tasks, raising children, household tasks, managing debts or finding work. In the Netherlands they have to arrange this help at their municipality. The goal of this project was to find out how easily people with intellectual disabilities could get help from their municipality. The participants were equal partners with the JISD inspectors from the beginning: in constructing an inspection framework, in acting as mystery guest with a fictive support request, reported back the results by storytelling. RESULTS: The evaluation of the project showed that the JISD succeeded in their key aspect of the project: the goal to involve people with intellectual disabilities in a leading role from the beginning until the end. Their perspectives and preferences were the starting point of supervision. Pain points in accessibility became clear straight away and gave important insights for both inspectors as municipality professionals. Municipalities started to improve their services and evaluated the improvements with the clients. Furthermore, the impact on the participants themselves was also huge: they felt being taken seriously, valued and empowered. CONCLUSION: Involving people with intellectual disabilities as participants in all phases of supervision processes contributes to more relevant and useful outcomes, creates mutual understanding of perspectives, as affirmed by both municipalities and inspectors, and creates empowerment of the participants. Furthermore, it fits perfectly within the United Nation Convention on the rights of persons with disabilities and the current development of 'value driven regulation'.

Centralisation of acute obstetric care in the Netherlands: a qualitative study to explore the experiences of stakeholders with adaptations in organisation of care.

BACKGROUND: In the past decade, acute obstetric care (AOC) has become centralised in many high-income countries. In this qualitative study, we explored how stakeholders in maternity care perceived and experienced adaptations in the organisation of maternity care in areas in the Netherlands where AOC was centralised. METHODS: A heterogenic group of fifteen maternity care stakeholders, including patients, were purposively selected for semi-structured interviews. An inductive thematic analysis was used. RESULTS: Three main themes were identified: (1) lack of involvement. (2) the process of making adaptations in the organisation of maternity care. (3) maintaining quality of care. Stakeholders in this study were highly motivated to maintain a high quality of maternity care and therefore made adaptations at several organisational levels. However, they felt a lack of involvement during the planning of centralisation of AOC and highlighted the importance of a collaborative process when making adaptations after centralisation of AOC. CONCLUSIONS: Regions with AOC centralisation plans should invest time and money in change management, encourage early involvement of all maternity care stakeholders and acknowledge centralisation of AOC as a professional life event with associated emotions, including a feeling of unsafety.

What methods are used to promote patient and family involvement in healthcare regulation? A multiple case study across four countries.

BACKGROUND: In the regulation of healthcare, the subject of patient and family involvement figures increasingly prominently on the agenda. However, the literature on involving patients and families in regulation is still in its infancy. A systematic analysis of how patient and family involvement in regulation is accomplished across different health systems is lacking. We provide such an overview by mapping and classifying methods of patient and family involvement in regulatory practice in four countries; Norway, England, the Netherlands, and Australia. We thus provide a knowledge base that enables discussions about possible types of involvement, and advantages and difficulties of involvement encountered in practice. METHODS: The research design was a multiple case study of patient and family involvement in regulation in four countries. The authors collected 1) academic literature if available and 2) documents of regulators that describe user involvement. Based on the data collected, the authors from each country completed a pre-agreed template to describe the involvement methods. The following information was extracted and included where available: 1) Method of involvement, 2) Type of regulatory activity, 3) Purpose of involvement, 4) Who is involved and 5) Lessons learnt. RESULTS: Our mapping of involvement strategies showed a range of methods being used in regulation, which we classified into four categories: individual proactive, individual reactive, collective proactive, and collective reactive methods. Reported advantages included: increased quality of regulation, increased legitimacy, perceived justice for those affected, and empowerment. Difficulties were also reported concerning: how to incorporate the input of users in decisions, the fact that not all users want to be involved, time and costs required, organizational procedures standing in the way of involvement, and dealing with emotions. CONCLUSIONS: Our mapping of user involvement strategies establishes a broad variety of ways to involve patients and families. The four categories can serve as inspiration to regulators in healthcare. The paper shows that stimulating involvement in regulation is a challenging and complex task. The fact that regulators are experimenting with different methods can be viewed positively in this regard.

Investigating the Potential Contribution of Patient Rating Sites to Hospital Supervision: Exploratory Results From an Interview Study in the Netherlands.

BACKGROUND: Over the last decades, the patient perspective on health care quality has been unconditionally integrated into quality management. For several years now, patient rating sites have been rapidly gaining attention. These offer a new approach toward hearing the patient's perspective on the quality of health care. OBJECTIVE: The aim of our study was to explore whether and how patient reviews of hospitals, as reported on rating sites, have the potential to contribute to health care inspector's daily supervision of hospital care. METHODS: Given the unexplored nature of the topic, an interview study among hospital inspectors was designed in the Netherlands. We performed 2 rounds of interviews with 10 senior inspectors, addressing their use and their judgment on the relevance of review data from a rating site. RESULTS: All 10 Dutch senior hospital inspectors participated in this research. The inspectors initially showed some reluctance to use the major patient rating site in their daily supervision. This was mainly because of objections such as worries about how representative they are, subjectivity, and doubts about the relevance of patient reviews for supervision. However, confrontation with, and assessment of, negative reviews by the inspectors resulted in 23% of the reviews being deemed relevant for risk identification. Most inspectors were cautiously positive about the contribution of the reviews to their risk identification. CONCLUSIONS: Patient rating sites may be of value to the risk-based supervision of hospital care carried out by the Health Care Inspectorate. Health care inspectors do have several objections against the use of patient rating sites for daily supervision. However, when they are presented with texts of negative reviews from a hospital under their supervision, it appears that most inspectors consider it as an additional source of information to detect poor quality of care. Still, it should always be accompanied and verified by other quality and safety indicators. More research on the value and usability of patient rating sites in daily hospital supervision and other health settings is needed.

Influence of Intensified Supervision by Health Care Inspectorates on Online Patient Ratings of Hospitals: A Multilevel Study of More Than 43,000 Online Ratings.

BACKGROUND: In the Netherlands, hospitals with quality or safety issues are put under intensified supervision by the Dutch Health Care Inspectorate, which involves frequent announced and unannounced site visits and other measures. Patient rating sites are an upcoming phenomenon in health care. Patient reviews might be influenced by perceived quality including the media coverage of health care providers when the health care inspectorate imposes intensified supervision, but no data are available to show how these are related. OBJECTIVE: The aim of this study was to investigate whether and how being under intensified supervision of the health care inspectorate influences online patient ratings of hospitals. METHODS: We performed a longitudinal study using data from the patient rating site Zorgkaart Nederland, from January 1, 2010 to December 31, 2015. We compared data of 7 hospitals under intensified supervision with a control group of 28 hospitals. The dataset contained 43,856 ratings. We performed a multilevel logistic regression analysis to account for clustering of ratings within hospitals. Fixed effects in our analysis were hospital type, time, and the period of intensified supervision. Random effect was the hospital. The outcome variable was the dichotomized rating score. RESULTS: The period of intensified supervision was associated with a low rating score for the hospitals compared with control group hospitals; both 1 year before intensified supervision (odds ratio, OR, 1.67, 95% CI 1.06-2.63) and 1 year after (OR 1.79, 95% CI 1.14-2.81) the differences are significant. For all periods, the odds on a low rating score for hospitals under intensified supervision are higher than for the control group hospitals, corrected for time. Time is also associated with low rating scores, with decreasing ORs over time since 2010. CONCLUSIONS: Hospitals that are confronted with intensified supervision by the health care inspectorate have lower ratings on patient rating sites. The scores are independent of the period: before, during, or just after the intervention by the health care inspectorate. Health care inspectorates might learn from these results because they indicate that the inspectorate identifies the same hospitals as "at risk" as the patients rate as underperformers.

Trends in patient satisfaction in Dutch university medical centers: room for improvement for all.

BACKGROUND: Results of patient satisfaction research provide hospitals areas for quality improvement. Although it may take several years to achieve such improvement, not all hospitals analyze changes in patient satisfaction over time structurally. Consequently, they lack information from patients' perspective on effectiveness of improvement programs. This study presents a trend analysis of the patient satisfaction scores in the eight university medical centers in the Netherlands. We focus on the trends, effect size and its consequences for improving patient-centered care. METHODS: The Core Questionnaire for the assessment of Patient satisfaction (COPS) was used in four large-scale nationwide comparative studies (2003-2009). Data were analyzed at a national level, and for each academic hospital separately. We analyzed the polynomial contrasts in the four measurements by performing an univariate analysis of variance (ANCOVA). The trend lines are presented graphically, with the means, SD, F-statistics and the standardized effect size including confidence intervals expressed by Cohen's d. By analyzing the (logit transformed) percentages of very satisfied patients we examined the change scores. RESULTS: The dataset consisted of 58,055 inpatients and 79,498 outpatients. Significant positive trends were found on national level and hospital level, especially in outpatient departments. Improvement was especially seen on the dimensions "information" and "discharge and aftercare". Not only university medical centers with a lower score at the start, but surprisingly some best practices and university medical centers with a high initial score improved. CONCLUSIONS: We conclude that significant trends in patient satisfaction can be identified on a national and a hospital level, in inpatient and outpatient departments. The observed effect size expressed by Cohen's d is rather small. Hospitals have found room for improvement, even hospitals with initial high satisfaction scores. We recommend that hospitals monitor their patient satisfaction scores over time and relate these to quality interventions and organizational changes. Furthermore, we recommend to expand the research to subgroups of unsatisfied patients to improve patient-centered care for all patients.

Is the length of stay in hospital correlated with patient satisfaction?

OBJECTIVE: To investigate the correlation between length of stay (LOS) and patient satisfaction on the level of hospital wards. The underlying hypothesis is that good quality of care leads both to shorter LOS and to patients that are more satisfied. DESIGN: We used standardized LOS and standardized patient satisfaction data from seven specialisms: internal medicine, cardiology, pulmonology, neurology, general surgery, orthopaedic surgery and obstetrics and gynaecology in the period 2003-2010. All LOS data were derived from the National Medical Registration and patient satisfaction scores were measured by a questionnaire covering six aspects of care. The LOS data were standardized for the year of discharge, age, primary diagnosis and procedure. Patient satisfaction data were standardized for the year, age, education and health status. SETTING: One hundred and eighty-eight Dutch hospital wards. PARTICIPANTS: The patient satisfaction data were gathered by questionnaires returned by 102 815 patients. INTERVENTION: None. MAIN OUTCOME MEASURE: Pearson correlations and two-tailed significance. between standardized mean LOS and standardized mean patient satisfaction score. RESULTS: We found no correlation between LOS and patient satisfaction in six out of seven specialties. We only found significantly higher patient satisfaction scores in pulmonology for some specific items on hospitals wards with a shorter LOS. These items concerned the reception on the ward, the information provided by nurses on admission, the expertise of the nursing staff, the way information was transferred from one person to another and respect for patients' privacy such as in conversations, and during physical examinations. CONCLUSIONS: We found no evidence that hospital wards with a relatively short mean LOS had higher, or lower, patient satisfaction than hospital wards with a relatively long LOS, with the exception of pulmonology.

Patient satisfaction revisited: a multilevel approach.

Patient satisfaction surveys are increasingly used for benchmarking purposes. In the Netherlands, the results of these surveys are reported at the univariate level without taking case mix factors into account. The first objective of the present study was to determine whether differences in patient satisfaction are attributed to the hospital, department or patient characteristics. Our second aim was to investigate which case mix variables could be taken into account when satisfaction surveys are carried out for benchmarking purposes. Patients who either were discharged from eight academic and fourteen general Dutch hospitals or visited the outpatient departments of the same hospitals in 2005 participated in cross-sectional satisfaction surveys. Satisfaction was measured on six dimensions of care and one general dimension. We used multilevel analysis to estimate the proportion of variance in satisfaction scores determined by the hospital and department levels by calculating intra-class correlation coefficients (ICCs). Hospital size, hospital type, population density and response rate are four case mix variables we investigated at the hospital level. We also measured the effects of patient characteristics (gender, age, education, health status, and mother language) on satisfaction. We found ICCs on hospital and department levels ranging from 0% to 4% for all dimensions. This means that only a minor part of the variance in patient satisfaction scores is attributed to the hospital and department levels. Although all patient characteristics had some statistically significant influence on patient satisfaction, age, health status and education appeared to be the most important determinants of patient satisfaction and could be considered for case mix correction. Gender, mother language, hospital type, hospital size, population density and response rate seemed to be less important determinants. The explained variance of the patient and hospital characteristics ranged from 3% to 5% for the different dimensions. Our conclusions are, first, that a substantial part of the variance is on the patient level, while only a minor part of the variance is at the hospital and department levels. Second, patient satisfaction outcomes in the Netherlands can be corrected by the case mix variables age, health status and education.