A systems science perspective on the capacity for change in public hospitals.

Many types of organisation are difficult to change, mainly due to structural, cultural and contextual barriers. Change in public hospitals is arguably even more problematic than in other types of hospitals, due to features such as structural dysfunctionalities and bureaucracy stemming from being publicly-run institutions. The main goals of this commentary are to bring into focus and highlight the "3 + 3 Decision Framework" proposed by Edwards and Saltman. This aims to help guide policymakers and managers implementing productive change in public hospitals. However, while change from the top is popular, there are powerful front-line clinicians, especially doctors, who can act to counterbalance top-down efforts. Front-line clinicians have cultural characteristics and power that allows them to influence or reject managerial decisions. Clinicians in various lower-level roles can also influence other clinicians to resist or ignore management requirements. The context is further complicated by multi-stakeholder agendas, differing goals, and accumulated inertia. The special status of clinicians, along with other system features of public hospitals, should be factored into efforts to realise major system improvements and progressive change.

The Unintended Consequences of Health Information Technology Revisited.

INTRODUCTION: The introduction of health information technology into clinical settings is associated with unintended negative consequences, some with the potential to lead to error and patient harm. As adoption rates soar, the impact of these hazards will increase. OBJECTIVE: Over the last decade, unintended consequences have received great attention in the medical informatics literature, and this paper seeks to identify the major themes that have emerged. RESULTS: Rich typologies of the causes of unintended consequences have been developed, along with a number of explanatory frameworks based on socio-technical systems theory. We however still have only limited data on the frequency and impact of these events, as most studies rely on data sets from incident reporting or patient chart reviews, rather than undertaking detailed observational studies. Such data are increasingly needed as more organizations implement health information technologies. When outcome studies have been done in different organizations, they reveal different outcomes for identical systems. From a theoretical perspective, recent advances in the emerging discipline of implementation science have much to offer in explaining the origin, and variability, of unintended consequences. CONCLUSION: The dynamic nature of health care service organizations, and the rapid development and adoption of health information technologies means that unintended consequences are unlikely to disappear, and we therefore must commit to developing robust systems to detect and manage them.

A New Informatics Geography.

INTRODUCTION: Anyone with knowledge of information systems has experienced frustration when it comes to system implementation or use. Unanticipated challenges arise frequently and unanticipated consequences may follow. OBJECTIVE: Working from first principles, to understand why information technology (IT) is often challenging, identify which IT endeavors are more likely to succeed, and predict the best role that technology can play in different tasks and settings. RESULTS: The fundamental purpose of IT is to enhance our ability to undertake tasks, supplying new information that changes what we decide and ultimately what occurs in the world. The value of this information (VOI) can be calculated at different stages of the decision-making process and will vary depending on how technology is used. We can imagine a task space that describes the relative benefits of task completion by humans or computers and that contains specific areas where humans or computers are superior. There is a third area where neither is strong and a final joint workspace where humans and computers working in partnership produce the best results. CONCLUSION: By understanding that information has value and that VOI can be quantified, we can make decisions about how best to support the work we do. Evaluation of the expected utility of task completion by humans or computers should allow us to decide whether solutions should depend on technology, humans, or a partnership between the two.

Surgical site infection-a population-based study in Australian adults measuring the compliance with and correct timing of appropriate antibiotic prophylaxis.

Prophylaxis for surgical site infection (SSI) is often at variance with guidelines, despite the prevalence of SSI and its associated cost, morbidity, and mortality. The CareTrack Australia study, undertaken by a number of the authors, demonstrated that appropriate care (in line with evidence- or consensus-based guidelines) was provided at 38% of eligible SSI healthcare encounters. Here, we report the indicator-level CareTrack Australia findings for SSI prophylaxis. Indicators were extracted from Australian and international clinical guidelines and ratified by clinical experts. A sample designed to be representative of the Australian population was recruited (n=1154). Participants' medical records were reviewed and analysed for compliance with the five SSI indicators. The main outcome measure was the percentage of eligible healthcare encounters with documented compliance with indicators for appropriate SSI prophylaxis. Of the 35,145 CareTrack Australia encounters, 702 (2%) were eligible for scoring against the SSI indicators. Where antibiotics were recommended, compliance was 49% for contaminated surgery, 57% for clean-contaminated surgery and 85% for surgery involving a prosthesis: these fell to 8%, 10% and 14%, respectively (an average of 11%), when currently recommended timing of antibiotic administration was included. Where antibiotics were not indicated, 72% of patients still received them. SSI prophylaxis in our sample was poor; over two-thirds of patients were given antibiotics, whether indicated or not, mainly at the wrong time. There is a need for national agreement on clinical standards, indicators and tools to guide, document and monitor SSI prophylaxis, with both local and national measures to increase and monitor their uptake.

The role and impact of research agendas on the comparative-effectiveness research among antihyperlipidemics.

Although it is well established that funding source influences the publication of clinical trials, relatively little is known about how funding influences trial design. We examined a public trial registry to determine how funding source shapes trial design among trials involving antihyperlipidemics. We used an automated process to identify and analyze 809 trials from a set of 72,564. Three networks representing industry-, collaboratively, and non-industry-funded trials were constructed. Each network comprised 18 drugs as nodes connected according to the number of comparisons made between them. The results indicated that industry-funded trials were more likely to compare across drugs and examine dyslipidemia as a condition, and less likely to register safety outcomes. The source of funding for clinical trials had a measurable effect on trial design, which helps quantify differences in research agendas. Improved monitoring of current clinical trials may be used to more closely align research agendas to clinical needs.

Clinician preferences for verbal communication compared to EHR documentation in the ICU.

BACKGROUND: Effective communication is essential to safe and efficient patient care. Additionally, many health information technology (HIT) developments, innovations, and standards aim to implement processes to improve data quality and integrity of electronic health records (EHR) for the purpose of clinical information exchange and communication. OBJECTIVE: We aimed to understand the current patterns and perceptions of communication of common goals in the ICU using the distributed cognition and clinical communication space theoretical frameworks. METHODS: We conducted a focus group and 5 interviews with ICU clinicians and observed 59.5 hours of interdisciplinary ICU morning rounds. RESULTS: Clinicians used an EHR system, which included electronic documentation and computerized provider order entry (CPOE), and paper artifacts for documentation; yet, preferred the verbal communication space as a method of information exchange because they perceived that the documentation was often not updated or efficient for information retrieval. These perceptions that the EHR is a "shift behind" may lead to a further reliance on verbal information exchange, which is a valuable clinical communication activity, yet, is subject to information loss. CONCLUSIONS: Electronic documentation tools that, in real time, capture information that is currently verbally communicated may increase the effectiveness of communication.

How online crowds influence the way individual consumers answer health questions: an online prospective study.

OBJECTIVE: To investigate whether strength of social feedback, i.e. other people who concur (or do not concur) with one's own answer to a question, influences the way one answers health questions. METHODS: Online prospective study. Two hundred and twenty-seven undergraduate students were recruited to use an online search engine to answer six health questions. Subjects recorded their pre- and post-search answers to each question and their level of confidence in these answers. After answering each question post-search, subjects were presented with a summary of post-search answers provided by previous subjects and were asked to answer the question again. RESULTS: There was a statistically significant relationship between the absolute number of others with a different answer (the crowd's opinion volume) and the likelihood of an individual changing an answer (P<0.001). For most questions, no subjects changed their answer until the first 10-35 subjects completed the study. Subjects' likelihood of changing answer increased as the percentage of others with a different answer (the crowd's opinion density) increased (P=0.047). Overall, 98.3% of subjects did not change their answer when it concurred with the majority (i.e. >50%) of subjects, and that 25.7% of subjects changed their answer to the majority response when it did not concur with the majority. When subjects had a post-search answer that did not concur with the majority, they were 24% more likely to change answer than those with answers that concurred (P<0.001). CONCLUSION: This study provides empirical evidence that crowd influence, in the form of online social feedback, affects the way consumers answer health questions.

The changing nature of clinical decision support systems: a focus on consumers, genomics, public health and decision safety.

OBJECTIVES: To review the recent research literature in clinical decision support systems (CDSS). METHODS: A review of recent literature was undertaken, focussing on CDSS evaluation, consumers and public health, the impact of translational bioinformatics on CDSS design, and CDSS safety. RESULTS: In recent years, researchers have concentrated much less on the development of decision technologies, and have focussed more on the impact of CDSS in the clinical world. Recent work highlights that traditional process measures of CDSS effectiveness, such as document relevance are poor proxy measures for decision outcomes. Measuring the dynamics of decision making, for example via decision velocity, may produce a more accurate picture of effectiveness. Another trend is the broadening of user base for CDSS beyond front line clinicians. Consumers are now a major focus for biomedical informatics, as are public health officials, tasked with detecting and managing disease outbreaks at a health system, rather than individual patient level. Bioinformatics is also changing the nature of CDSS. Apart from personalisation of therapy recommendations, translational bioinformatics is creating new challenges in the interpretation of the meaning of genetic data. Finally, there is much recent interest in the safety and effectiveness of computerised physician order entry (CPOE) systems, given that prescribing and administration errors are a significant cause of morbidity and mortality. Of note, there is still much controversy surrounding the contention that poorly designed, implemented or used CDSS may actually lead to harm. CONCLUSIONS: CDSS research remains an active and evolving area of research, as CDSS penetrate more widely beyond their traditional domain into consumer decision support, and as decisions become more complex, for example by involving sequence level genetic data.

Market-based control mechanisms for patient safety.

A new model is proposed for enhancing patient safety using market-based control (MBC), inspired by successful approaches to environmental governance. Emissions trading, enshrined in the Kyoto protocol, set a carbon price and created a carbon market--is it possible to set a patient safety price and let the marketplace find ways of reducing clinically adverse events? To "cap and trade," a regulator would need to establish system-wide and organisation-specific targets, based on the cost of adverse events, create a safety market for trading safety credits and then police the market. Organisations are given a clear policy signal to reduce adverse event rates, are told by how much, but are free to find mechanisms best suited to their local needs. The market would inevitably generate novel ways of creating safety credits, and accountability becomes hard to evade when adverse events are explicitly measured and accounted for in an organisation's bottom line.

Commentaries on "Informatics and medicine: from molecules to populations".

OBJECTIVE: To discuss interdisciplinary research and education in the context of informatics and medicine by commenting on the paper of Kuhn et al. "Informatics and Medicine: From Molecules to Populations". METHOD: Inviting an international group of experts in biomedical and health informatics and related disciplines to comment on this paper. RESULTS AND CONCLUSIONS: The commentaries include a wide range of reasoned arguments and original position statements which, while strongly endorsing the educational needs identified by Kuhn et al., also point out fundamental challenges that are very specific to the unusual combination of scientific, technological, personal and social problems characterizing biomedical informatics. They point to the ultimate objectives of managing difficult human health problems, which are unlikely to yield to technological solutions alone. The psychological, societal, and environmental components of health and disease are emphasized by several of the commentators, setting the stage for further debate and constructive suggestions.

Building a sustainable health system.

OBJECTIVES: To conduct a basic sustainability analysis of health systems, and explore models for conceptualising and creating sustainable organizations, based upon the experiences of the environmental sciences and organisational theory. To explore the role of information technologies in assisting health organizations become sustainable enterprises. METHODS: A review of recent literature into sustainable systems and an analysis and extension of the literature to the specific case of healthcare. RESULTS: Many if not all health systems around the globe face dual challenges of increasing demands and diminishing resources, which are ultimately unsustainable. Four physical system conditions which are pre-requisites for sustainability of systems--that materials should not be extracted, accumulate or be depleted faster than they can be managed, and that systems should fundamentally meet human needs apply equally to healthcare. For healthcare, in addition to physical material and energy, resources include people, and data, information and knowledge. Further, healthcare is an open system that needs to be sufficiently adaptive to changes if it is to sustain. Information and communication technologies are crucial tools to enable any large and complex modern enterprise to model, measure and then manage business processes. Technologies like organisational simulation, the electronic health record, and decision support are essential tools for sustainable health services. Applied inappropriately however, IT can itself create unsustainable conditions, for example through the accumulation of legacy systems, a situation that adherence to technical standards should mitigate. CONCLUSIONS: It is crucial that our nations undertake a formal sustainability analysis of their health systems, to identify where the most pressing challenges are. In concert, there needs to be a long term process of exploring innovative designs for health services that improve the sustainability of the system as a whole, and there needs to be a will to implement the health system policies, infrastructure and services to ensure that in 20 years time we do have a healthy health system.

The Centre for Health Informatics at the University of New South Wales--a clinical informatics research centre.

OBJECTIVES: Building a sustainable health system in the 21st Century will require the reinvention of much of the present day system, and the intelligent use of information and communication technologies (ICT) to deliver high quality, safe, efficient and affordable health care. The Centre for Health Informatics (CHI) is Australia's largest academic research group in this emerging discipline. METHODS: Our research is underpinned by a planning process, based on different future scenarios for the health system, which helps us identify longer-term problems needing a sustained research effort. A research competency matrix is used to ensure that the Centre has the requisite core capabilities in the research methods and tools needed to pursue our research program. RESULTS: The Centre's work is internationally recognized for its contributions in the development of intelligent search systems to support evidence-based healthcare, developing evaluation methodologies for ICT, and in understanding how communication shapes the safety and quality of health care delivery. Centre researchers also are working on safety models and standards for ICT in healthcare, mining complex gene micro array, medical literature and medical record data, building health system simulation methods to model the impact of health policy changes, and developing novel computational methods to automate the diagnosis of 3-D medical images. CONCLUSIONS: Any individual research group like CHI must necessarily focus on a few areas to allow it to develop sufficient research capacity to make novel and internationally significant contributions. As CHI approaches the end of its first decade, it is becoming clear that developing capacity becomes increasingly challenging as the research territory changes under our feet, and that the Centre will continue to evolve and shift its focus in the years to come.

The safety and quality of decision support systems.

OBJECTIVES: The use of clinical decision support systems (CDSS) can improve the overall safety and quality of health care delivery, but may also introduce machine-related errors. Recent concerns about the potential for CDSS to harm patients have generated much debate, but there is little research available to identify the nature of such errors, or quantify their frequency or clinical impact. METHODS: A review of recent literature into electronic prescribing systems, as well as related literature in decision support. RESULTS: There seems to be some evidence for variation in the outcomes of using CDSS, most likely reflecting variations in clinical setting, culture, training and organizational process, independent of technical variables. There is also preliminary evidence that poorly implemented CDSS can lead to increased mortality in some settings. Studies in the US, UK and Australia have found commercial prescribing systems often fail to uniformly detect significant drug interactions, probably because of errors in their knowledge base. Electronic medication management systems may generate new types of error because of user-interface design, but also because of events in the workplace such as distraction affecting the actions of system users. Another potential source of CDSS influenced errors are automation biases, including errors of omission where individuals miss important data because the system does not prompt them to notice them, and errors of commission where individuals do what the decision aid tells to do, even when this contradicts their training and other available data. Errors of dismissal occur when relevant alerts are ignored. On-line decision support systems may also result in errors where clinicians come to an incorrect assessment of the evidence, possibly shaped in part by cognitive decision biases. CONCLUSIONS: The effectiveness of decision support systems, like all other health IT, cannot be assessed purely by evaluating the usability and performance of the software, but is the outcome of a complex set of cognitive and socio-technical interactions. A deeper understanding of these issues can result in the design of systems which are not just intrinsically 'safe' but which also result in safe outcomes in the hands of busy or poorly resourced clinicians.

Treat or test first? Decision analysis of empirical antiviral treatment of influenza virus infection versus treatment based on rapid test results.

BACKGROUND: neuraminidase (NA) inhibitors have recently become available for treatment of influenza. Rapid antigen detection assays at 'point-of-care' may improve the accuracy of clinical diagnosis, but the value of these techniques in assisting with the appropriate use of antivirals remains controversial. OBJECTIVE: to compare the diagnostic utilities of two management strategies for influenza, empirical antiviral therapy versus therapy based on a positive rapid test result in pre-epidemic and epidemic periods. STUDY DESIGN: a threshold decision analytic model was designed to compare these competing strategies and sensitivity analysis performed to examine the impact of diagnostic variables on the expected utility of the decision with a range of prior probabilities of infection between 1 and 50%. RESULTS: on the basis of the calculated sensitivity (77%) and specificity (95%) of a point-of-care test for influenza, pre-treatment testing was preferred and cost-effective in non-epidemic stage of the influenza cycle. The alternative strategy of empirical treatment produces a higher utility value during epidemics, but may result in overuse of antivirals for low-risk populations. The two strategies had equivalent efficacy when the probability of influenza was 42%. CONCLUSIONS: Patients with flu-like illness, who present outside the influenza outbreak and are considered to be at low risk for influenza-related complications, should be tested to confirm the diagnosis before starting antiviral treatment with a NA inhibitor. The most important variables in the model were the accuracy of the clinical diagnosis and the pre-test probability of influenza. A threshold probability of influenza of 42% would dictate changing from the rapid testing strategy to a 'treat regardless' strategy.

What do physicians think about evidence-based antibiotic use in critical care? A survey of Australian intensivists and infectious disease practitioners.

BACKGROUND: The analysis of factors that influence prescribing decisions is increasingly important. Antibiotic use is often based on limited evidence and lack of information about clinical decision-making processes is an important obstacle to improving antibiotic utilization. AIMS: To compare the attitudes of intensive care unit practitioners (ICUP) and infectious disease practitioners (IDP) to antibiotic use and to the evidence-based information support. METHOD: A postal survey conducted between March and July 2000 of ICUP and IDP representing all States and Territories in Australia. RESULTS: One hundred and fifty-three of 224 clinicians returned the questionnaire (68.3% response rate). In choosing an antibiotic, IDP placed significantly more weight than ICUP on the in vitro susceptibility of the pathogen (P = 0.001), antibiotic cost (P = 0.05) and possible development of antibiotic resistance (P = 0.007). More than 95% of both groups believed that unit-specific antibiotic susceptibility of endemic pathogens was an essential factor in rational prescribing, but only 68.5% of IDP and 38.7% of ICUP use microbiology laboratory databases. When in doubt about appropriate antibiotic use, 63.8% of ICUP seek and 76.3% usually follow the advice of IDP. Both groups agree that published antibiotic guidelines are useful, but IDP were more likely to consult them. ICUP were more likely to believe that guidelines are used to control clinicians rather than to improve quality of care (P = 0.001). A greater proportion of IDP (71.2%) than ICUP (52.5%) believed that antibiotic prescribing in their intensive care unit (ICU) was evidence based but most (91.8% and 86.9%, respectively) agreed that it should be. CONCLUSIONS: Australian clinicians have positive views about evidence-based prescribing and antibiotic guidelines. However, there are clinically significant differences in prescribing behaviour between ICUP and IDP. These may be explained by different disease spectra managed by each group or different cultures, training and/or cognitive styles. Improvements in the understanding of physicians' information and decision support needs are required to strengthen evidence-based prescribing.

Maximising the uptake of evidence into clinical practice: an information economics approach.

Evidence such as systematic reviews or clinical practice guidelines are information products, and clinicians are consumers of those products; their current proliferation but low uptake by consumers indicates an information oversupply. The costs and benefits of accessing and applying information are at least as important as are the costs and benefits of the treatments the information describes. In the same way that a citation index is a measure of the impact of a scientific paper, an evidence uptake index could measure effectiveness of evidence products in a clinical population. The uptake of evidence-based medicine may be hampered by the perceived high cost of changing to it. At present, most costs are borne by individual clinicians, but individual benefits for clinicians are downplayed in favour of population benefits. Specific strategies to increase evidence uptake into practice include decreasing the "cost of ownership"; increasing the direct or perceived value of evidence resources in routine practice; and customising evidence to suit different users, tasks and clinical contexts.

Improving clinical communication: a view from psychology.

Recent research has studied the communication behaviors of clinical hospital workers and observed a tendency for these workers to use communication behaviors that were often inefficient. Workers were observed to favor synchronous forms of communication, such as telephone calls and chance face-to-face meetings with colleagues, even when these channels were not effective. Synchronous communication also contributes to a highly interruptive working environment, increasing the potential for clinical errors to be made. This paper reviews these findings from a cognitive psychological perspective, focusing on current understandings of how human memory functions and on the potential consequences of interruptions on the ability to work effectively. It concludes by discussing possible communication technology interventions that could be introduced to improve the clinical communication environment and suggests directions for future research.