Grading recommendations for enhanced patient safety in sentinel event analysis: the recommendation improvement matrix.

OBJECTIVES: The goal of sentinel event (SE) analysis is to prevent recurrence. However, the rate of SEs has remained constant over the past years. Research suggests this is in part due to the quality of recommendations. Currently, standards for the selection of recommendations are lacking. Developing a method to grade recommendations could help in both designing and selecting interventions most likely to improve patient safety. The aim of this study was to (1) develop a user-friendly method to grade recommendations and (2) assess its applicability in a large series of Dutch perioperative SE analysis reports. METHODS: Based on two grading methods, we developed the recommendation improvement matrix (RIM). Applicability was assessed by analysing all Dutch perioperative SE reports over a 12-month period. After which interobserver agreement was studied. RESULTS: In the RIM, two elements are crucial: whether the recommendation intervenes before or after an SE and whether it eliminates or controls the hazard. Applicability was evaluated in 115 analysis reports, encompassing 161 recommendations. Recommendation quality varied from the highest, category A, to the lowest, category D, with category A accounting for 44%, category B for 35%, category C for 2% and category D for 19% of recommendations. There was a fair interobserver agreement. CONCLUSION: The RIM can be used to grade recommendations in SE analysis and could possibly help in both designing and selecting interventions. It is relatively simple, user-friendly and has the potential to improve patient safety. The RIM can help formulate effective and sustainable recommendations, a second key objective of the RIM is to foster and facilitate constructive dialogue among those responsible for patient safety.

Criteria for recommendations after perioperative sentinel events.

BACKGROUND: The recurrence of sentinel events (SEs) is a persistent problem worldwide, despite repeated analyses and recommendations formulated to prevent recurrence. Research suggests this is partly attributable to the quality of the recommendations, and determining if a recommendation will be effective is not yet covered by an adequate guideline. Our objectives were to (1) develop and validate criteria for high-quality recommendations, and (2) evaluate recommendations using the criteria developed. METHODS: (1) Criteria were developed by experts using the bowtie method. Medical doctors then determined if the recommendations of Dutch in-hospital SE analysis reports met the criteria, after which interobserver variability was tested. (2) Researchers determined which recommendations of Dutch perioperative SE analysis reports produced from 2017 to 2018 met the criteria. RESULTS: The criteria were: (1) a recommendation needs to be well defined and clear, (2) it needs to specifically describe the intended changes, and (3) it needs to describe how it will reduce the risk or limit the consequences of a similar SE. Validation of criteria showed substantial interobserver agreement. The SE analysis reports (n=115) contained 442 recommendations, of which 64% failed to meet all criteria, and 28% of reports did not contain a single recommendation that met the criteria. CONCLUSION: We developed and validated criteria for high-quality recommendations. The majority of recommendations did not meet our criteria. It was disconcerting to find that over a quarter of the investigations did not produce a single recommendation that met the criteria, not even in SEs with a fatal outcome. Healthcare providers have an obligation to prevent SEs, and certainly their recurrence. We anticipate that using these criteria to determine the potential of recommendations will aid in this endeavour.

Towards the next generation of LMRA instruments: the influence of generic and specific questions during risk assessment.

Last minute risk assessment (LMRA) is a well-known work method to support employees' risk perception. However, little is known about the effectiveness of LMRA in providing this support. Here, we describe an eye-tracking experiment with which we attempted to gain more insight into the relationship between LMRA and risk perception and to assess the difference between generic and specific supporting questions. Employees from an international energy production and desalination company participated in this experiment by assessing photographs portraying a (staged) work situation and deciding whether it was safe enough to continue activities and which risk factors were present or absent. The results show a consistent interaction effect over several parameters between work experience and the type of supporting questions, indicating that generic and specific supporting questions should be considered complimentary to each other. Furthermore, the results revealed several other challenges concerning real-world application of the LMRA.

People with multiple disabilities learn to engage in occupation and work activities with the support of technology-aided programs.

These two studies were aimed at assessing technology-aided programs to help persons with multiple disabilities engage in basic occupation or work activities. Specifically, Study I focused on teaching two participants (an adolescent and an adult) with low vision or total blindness, severe/profound intellectual disabilities, and minimal object interaction to engage in constructive object-manipulation responses. The technology monitored their responses and followed them with brief stimulation periods automatically. Study II focused on teaching three adults with deafness, severe visual impairment, and profound intellectual disabilities to perform a complex activity, that is, to assemble a five-component water pipe. The technology regulated (a) light cues to guide the participants through the workstations containing single pipe components and the carton for completed pipes and (b) stimulation events. The results of both studies were positive. The participants of Study I showed consistent and independent engagement in object-manipulation responses. The participants of Study II showed consistent and independent pipe assembling performance. General implications of the two programs and the related technology packages for intervention with persons with multiple disabilities are discussed.

The ecometric properties of a measurement instrument for prospective risk analysis in hospital departments.

BACKGROUND: Safety management systems have been set up in healthcare institutions to reduce the number of adverse events. Safety management systems use a combination of activities, such as identifying and assessing safety risks in the organizational processes through retrospective and prospective risk assessments. A complementary method to already existing prospective risk analysis methods is Tripod, which measures latent risk factors in organizations through staff questionnaires. The purpose of this study is to investigate whether Tripod can be used as a method for prospective risk analysis in hospitals and whether it can assess differences in risk factors between hospital departments. METHODS: Tripod measures risk factors in five organizational domains: (1) Procedures, (2) Training, (3) Communication, (4) Incompatible Goals and (5) Organization. Each domain is covered by 15 items in the questionnaire. A total of thirteen departments from two hospitals participated in this study. All healthcare staff working in the participating departments were approached. The multilevel method ecometrics was used to evaluate the validity and reliability of Tripod. Ecometrics was needed to ensure that the differences between departments were attributable to differences in risk at the departmental level and not to differences between individual perceptions of the healthcare staff. RESULTS: A total of 626 healthcare staff completed the questionnaire, resulting in a response rate of 61.7%. Reliability coefficients were calculated for the individual level and department level. At the individual level, reliability coefficients ranged from 0.78 to 0.87, at the departmental level they ranged from 0.55 to 0.73. Intraclass correlations at the departmental level ranged from 3.7% to 8.5%, which indicate sufficient clustering of answers within departments. At both levels the domains from the questionnaire were positively interrelated and all significant. CONCLUSIONS: The results of this study show that Tripod can be used as a method for prospective risk analysis in hospitals. Results of the questionnaire provide information about latent risk factors in hospital departments. However, this study also shows that there are indications that the method is not sensitive enough to detect differences between hospital departments. Therefore, it is important to be careful when interpreting differences in potential risks between departments when using Tripod.

Supporting daily activities and indoor travel of persons with moderate Alzheimer's disease through standard technology resources.

These two studies were aimed at evaluating standard technology resources for supporting activity and travel among patients with moderate Alzheimer's disease. Specifically, Study I assessed a pictorial instruction program relying on the use of a portable computer and a commercially available and inexpensive video editing software for supporting the performance of daily activities with three patients. Study II assessed the indoor travel performance of four patients (i.e., the three involved in Study I and a fourth patient with no previous research exposure) using a commercially available, basic doorbell system with sound and light cues. The percentages of correct activity steps obtained with the instruction program used in Study I were relatively high and largely similar to the percentages reported in previous studies using more sophisticated technology. During Study II, the percentages of correct travels of two patients matched the data of the most successful patients involved in previous studies with more sophisticated technology. The percentages of the other two patients tended to be lower than those obtained previously, but were still practically relevant. The implications of the results of the two studies and a number of issues for new research are discussed.

Critical steps in learning from incidents: using learning potential in the process from reporting an incident to accident prevention.

Many incidents have occurred because organisations have failed to learn from lessons of the past. This means that there is room for improvement in the way organisations analyse incidents, generate measures to remedy identified weaknesses and prevent reoccurrence: the learning from incidents process. To improve that process, it is necessary to gain insight into the steps of this process and to identify factors that hinder learning (bottlenecks). This paper presents a model that enables organisations to analyse the steps in a learning from incidents process and to identify the bottlenecks. The study describes how this model is used in a survey and in 3 exploratory case studies in The Netherlands. The results show that there is limited use of learning potential, especially in the evaluation stage. To improve learning, an approach that considers all steps is necessary.

Technology-based orientation programs to support indoor travel by persons with moderate Alzheimer's disease: impact assessment and social validation.

The present study (a) extended the assessment of an orientation program involving auditory cues (i.e., verbal messages automatically presented from the destinations) with five patients with Alzheimer's disease, (b) compared the effects of this program with those of a program with light cues (i.e., a program in which strobe lights were used instead of the verbal messages) with the same five patients, and (c) conducted a social validation assessment of the two programs with 70 university psychology students employed as social raters. Results confirmed the effectiveness of the program with auditory cues and showed an equally strong impact of the program with light cues with all five patients. The psychology students involved in the social validation assessment provided significantly higher scores for the program involving light cues on a six-item questionnaire. Those scores suggested that this program was perceived as a practically and socially preferable choice. The implications of the findings for daily contexts dealing with patients with Alzheimer's disease are discussed.

Assessing the impact and social perception of self-regulated music stimulation with patients with Alzheimer's disease.

We assessed the impact and social rating of an active and a passive music condition implemented with six patients with Alzheimer's disease. In the active condition, the patients used a simple hand response and a microswitch to self-regulate music stimulation inputs. In the passive condition, music stimulation was automatically presented throughout the sessions. Active and passive stimulation sessions were preceded and followed by control (non-stimulation) sessions. The active condition sessions showed an increase in the patients' indices of positive participation (e.g., singing or music-related movements, and smiles) greater than that observed in the passive condition sessions for five of the six patients. Positive intervention effects could also spread to the post-intervention sessions. Social raters (42 care and rehabilitation staff members working with persons with multiple disabilities) favored the active condition on a six-item questionnaire dealing with, among others, conditions' suitability, respect of patients' dignity and independence, and practicality. The implications of the findings as to the plausibility/desirability of an active stimulation condition were discussed.

Technology-based programs to promote walking fluency or improve foot-ground contact during walking: two case studies of adults with multiple disabilities.

These two case studies assessed technology-based programs for promoting walking fluency and improving foot-ground contact during walking with a man and a woman with multiple disabilities, respectively. The man showed breaks during walking and the woman presented with toe walking. The technology used in the studies included a microprocessor with specific software, an MP3 with the recordings of preferred stimulus items, and optic sensors. Both studies were carried out according to an ABAB design. In Study I, the optic sensors were activated when the man crossed small marks distributed along the travel routes. At each sensor's activation, the man received a brief period of preferred stimulation. In Study II, the woman received preferred stimulation when the sensors at the toe and the heel of her shoes were activated in close time proximity. The man walked virtually without breaks and improved his mood (with an increase in indices of happiness) during the intervention phases of the study. The woman largely increased her percentages of steps with adequate foot-ground contact, which reached a mean of about 80 during the second intervention phase. The results were discussed in terms of rehabilitation implications and technology demands.

Promoting mouth-drying responses to reduce drooling effects by persons with intellectual and multiple disabilities: a study of two cases.

This study assessed the use of microswitch technology to promote mouth-drying responses and thereby reduce the effects of drooling by two adults with severe intellectual and multiple disabilities. Mouth-drying responses were performed via a special napkin that contained pressure sensors, a microprocessor and an MP3 to monitor the responses and ensure positive stimulation contingent on them. Initially, the responses produced 10 or 15 s of preferred stimulation. Subsequently, preferred stimulation was supplemented with matching periods of lower-grade stimulation to extend the inter-response intervals. Results showed that both participants (a) learned to dry their mouth consistently and reduce their chin wetness during the intervention, (b) stabilized their responding at lower frequencies as the lower-grade stimulation was added to the preferred stimulation, and (c) maintained the latter levels at a 3-month follow-up. Procedure and response conditions and outcome implications are discussed.

Promoting ambulation responses among children with multiple disabilities through walkers and microswitches with contingent stimuli.

Children with severe or profound intellectual and motor disabilities often present problems of balance and ambulation and spend much of their time sitting or lying, with negative consequences for their development and social status. Recent research has shown the possibility of using a walker (support) device and microswitches with preferred stimuli to promote ambulation with these children. This study served as a replication of the aforementioned research and involved five new children with multiple disabilities. For four children, the study involved an ABAB design. For the fifth child, only an AB sequence was used. All children succeeded in increasing their frequencies of step responses during the B (intervention) phase(s) of the study, although the overall frequencies of those responses varied largely across them. These findings support the positive evidence already available about the effectiveness of this intervention approach in motivating and promoting children's ambulation. Practical implications of the findings are discussed.

Persons with multiple disabilities accessing stimulation and requesting social contact via microswitch and VOCA devices: new research evaluation and social validation.

The first of these two studies assessed whether 11 participants with multiple disabilities of 5.3-18.2 (M=10.7) years of age would succeed in combining a microswitch for accessing preferred environmental stimuli and a Voice Output Communication Aid (VOCA) for requesting social contact. The second study conducted a social validation assessment of the aforementioned microswitch-VOCA combination. Data showed that all participants learned to use the microswitch and the VOCA. Moreover, the 10 participants, who received a 1-month post-intervention check, largely maintained their responding. The social validation assessment indicated that the raters (i.e., 110 university psychology students) favored the combination of microswitch and VOCA over the microswitch or the VOCA alone, and hypothetical combinations of microswitches or VOCAs.

A microswitch-cluster program to foster adaptive responses and head control in students with multiple disabilities: replication and validation assessment.

A program relying on microswitch clusters (i.e., combinations of microswitches) and preferred stimuli was recently developed to foster adaptive responses and head control in persons with multiple disabilities. In the last version of this program, preferred stimuli (a) are scheduled for adaptive responses occurring in combination with head control (i.e., head upright) and (b) last through the scheduled time only if head control is maintained for that time. The first of the present two studies was aimed at replicating this program with three new participants with multiple disabilities adding to the three reported by Lancioni et al. [Lancioni, G. E., Singh, N. N., O'Reilly, M. F., Sigafoos, J., Didden, R., Oliva, D., et al. (2007). Fostering adaptive responses and head control in students with multiple disabilities through a microswitch-based program: Follow-up assessment and program revision. Research in Developmental Disabilities, 28, 187-196]. The second of the two studies served to carry out an expert validation of the program's effects on head control and general physical condition with the three participants of Study I as well as the three participants involved in the Lancioni et al. study mentioned above. The expert raters were 72 new physiotherapists and 72 experienced physiotherapists. The results of Study I supported previous data and indicated that the program was effective in helping the participants increase the frequency of adaptive responses in combination with head control and the length of such control. The results of Study II showed that the raters found the effects of the new program more positive than those of other intervention conditions and also considered such program a useful complement to formal motor rehabilitation programs.

Assisting persons with multiple disabilities to move through simple occupational activities with automatic prompting.

The present study assessed the possibility of assisting four persons with multiple disabilities to move through and perform simple occupational activities arranged within a room with the help of automatic prompting. The study involved two multiple probe designs across participants. The first multiple probe concerned the two participants with blindness or minimal vision and deafness, who received air blowing as a prompt. The second multiple probe concerned the two participants with blindness and typical hearing who received a voice calling as a prompt. Initially, all participants had baseline sessions. Then intervention started with the first participant of each dyad. When their performance was consolidated, new baseline and intervention occurred with the second participant of each dyad. Finally, all four participants were exposed to a second intervention phase, in which the number of activities per session doubled (i.e., from 8 to 16). Data showed that all four participants: (a) learned to move across and perform the activities available with the help of automatic prompting and (b) remained highly successful through the second intervention phase when the sessions were extended. Implications of the findings are discussed.

Microswitch clusters promote adaptive responses and reduce finger mouthing in a boy with multiple disabilities.

The authors assessed new microswitch clusters (i.e., combinations of two microswitches) and contingent stimulation to increase adaptive responses (i.e., foot and head movements) and reduce aberrant behavior (i.e., finger mouthing)in a boy with multiple disabilities. Initially, intervention was directed at increasing the frequency of each adaptive response, individually, through contingent use of preferred stimuli. Subsequently, adaptive responses led to preferred stimuli only if they occurred in the absence of finger mouthing. Postintervention checks occurred 1, 2, and 3 months after the end of the intervention. Data showed that the boy (a) increased the frequency of the adaptive responses extensively, (b) learned to perform these responses largely free from finger mouthing, and (c) maintained these changes over time. The importance of microswitch clusters to simultaneously pursue the dual objective of promoting adaptive responses and reducing aberrant ones is underlined.

A brief account of statistical tests for single-case research with persons with developmental disabilities.

Education and rehabilitation research with persons with developmental disabilities is often based on single-case designs (with small numbers of ordinal data points collected at irregular intervals) and relies upon graphic display and visual inspection of the data. This paper (a) provides a brief account of some statistical tests, which may serve to supplement the visual inspection process and (b) underlines some of their strengths and limitations to help education and rehabilitation personnel make a reasonable choice among them.

Micro-switch clusters to enhance hand responses and appropriate head position in two children with multiple disabilities.

This study evaluated the use of micro-switch clusters to improve response activity and posture with two children with multiple disabilities. The children were first taught a hand response and then required to combine this response with appropriate head position. The micro-switch clusters adopted for this purpose consisted of a pressure or mercury micro-switch for the hand response combined with a mercury micro-switch for the head position. Both children had an increase in the frequency of the hand response and in the percentage of times this occurred in combination with appropriate head position. These changes were maintained at a 2-month post-intervention check.

Effects of Snoezelen room, Activities of Daily Living skills training, and Vocational skills training on aggression and self-injury by adults with mental retardation and mental illness.

Multi-sensory stimulation provided in a Snoezelen room is being used increasingly for individuals with mental retardation and mental illness to facilitate relaxation, provide enjoyment, and inhibit behavioral challenges. We observed aggressive and self-injurious behavior in three groups of 15 individuals with severe or profound mental retardation and mental illness before, during, and after being in a Snoezelen room. All participants were receiving psychotropic medication for their mental illness and function-derived behavioral interventions for aggression, self-injury, or both. Using a repeated measures counterbalanced design, each group of participants was rotated through three experimental conditions: Activities of Daily Living (ADL) skills training, Snoezelen, and Vocational skills training. All other treatment and training activities specified in each individual's person-centered plan were continued during the 10-week observational period. Both aggression and self-injury were lowest when the individuals were in a Snoezelen room, followed by Vocational skills training and ADL skills training. The levels in the Snoezelen room were significantly lower than in both the other conditions for aggression but only in ADL skills training for self-injury. The difference in levels before and after Snoezelen were statistically significant with self-injury but not with aggression. The order of conditions showed no significant effect on either behavior. Snoezelen may provide an effective context for reducing the occurrence of self-injury and aggression.