Usability evaluation of an integrated electronic medication management system implemented in an oncology setting using the unified theory of the acceptance and use of technology.

BACKGROUND: Medication management processes in an Oncology setting are complex and difficult to examine in isolation from interrelated processes and contextual factors. This qualitative study aims to evaluate the usability of an Electronic Medication Management System (EMMS) implemented in a specialised oncology unit using the Unified Theory of Acceptance and Use of Technology (UTAUT) framework. METHODS: The study was conducted in a 12-bed outpatient Oncology unit of a major teaching hospital 6 months following implementation of a commercial EMMS. In-depth semi-structured interviews were conducted with doctors, nurses and pharmacists using the system to assess usability. The UTAUT framework was used to analyse the results, which facilitated evaluation of interrelated aspects and provided a structured summary of user experience and usability factors. RESULTS: Direct cross-comparison between user groups illustrated that doctors and pharmacists were generally satisfied with the facilitating conditions (hardware and training), but had divergent perceptions of performance (automation, standardised protocols and communication and documented) and effort (mental and temporal demand) expectancy. In counterpoint, nurses were generally satisfied across all constructs. Prior experience using an alternative EMMS influenced performance and effort expectancy and was related to early dissatisfaction with the EMMS. Furthermore, whilst not originally designed for the healthcare setting, the flexibility of the UTAUT allowed for translation to the hospital environment. CONCLUSION: Nurses demonstrated overall satisfaction with the EMMS, whilst doctors and pharmacists perceived usability problems, particularly related to restricted automaticity and system complexity, which hindered perceived EMMS success. The study demonstrates the feasibility and utility of the UTAUT framework to evaluate usability of an EMMS for multiple user groups in the Oncology setting.

Medication safety improvements during care transitions in an Australian intensive care unit following implementation of an electronic medication management system.

BACKGROUND: For patients requiring admission to the Intensive Care Unit (ICU), transfers of care (TOC) during admission to and discharge from the ICU are particularly high-risk periods for medication errors. In the Australian setting, commonly general wards and the ICU do not share an integrated Electronic Medical ecord (EMR) and specifically an Electronic Medication Management System (EMMS) as part of the EMR. PURPOSE: To evaluate the effect of a hospital wide integrated EMMS on medication error rates during ICU admission and at TOC. METHOD: A 6-month historical control study was performed before and after implementation of the EMMS in the ICU of a tertiary hospital. Prescribing errors detected by pharmacists in the study period were divided into phase 1, (pre-EMMS, 6months), phase 2 (3 months post implementation after shakedown stage) and phase 3 (next 3 months of post implementation). They were categorized as prescribing error types under system or clinical intervention. Chi square statistics and interrupted time series analysis were used to determine if there was significant change in the proportion of patients who had an error at TOC during each phase. Logistics regression was used to determine the relationship between the dependent (error type) and the independent variable (study phase) for errors that occurred during TOC. RESULTS: Errors occurred during TOC in 42 %, 64 % and 19 % of patients in phase 1, 2 and 3 respectively. There was a significant decline in the proportion of patients with an error between phase 1 and 3 (p < 0.01). During a patient's ICU admission, at least one medication error occurred in 28.3 %, 62.6 % and 25.1 % in phase 1, 2 and 3 respectively. Besides procedural errors, the likelihood of an error occurring was greatest in phase 1, compared to phase 2 and 3 across system-related error categories. CONCLUSION: Medication errors during TOC reduced following implementation of the integrated ICU EMMS. EMMS safety features facilitated reduced system related prescribing errors as well as the severity of errors made.

The Digitization of the ICU: An Evaluation of Usability and Hospital-Wide Acceptability.

This paper explores the impact of an electronic medication management system (EMMS) on users in an intensive care unit using the Unified Theory and Use of Technology constructs. It also explores the impact of having a consistent EMMS hospital wide, as it is the first Australian hospital to implement the same EMMS hospital wide. The research model was evaluated using survey data from 100 nurses, doctors and pharmacists both within the ICU and externally, to assess the usability and acceptability of the system. Results showed that performance expectancy, effort expectancy, social influence and facilitating condition all correlate with overall user satisfaction. Overall, teams external to the ICU are in strong favor of its implementation whist user acceptance from within the ICU itself is poor.