The Perceived Ease of Use and Perceived Usefulness of a Web-Based Interprofessional Communication and Collaboration Platform in the Hospital Setting: Interview Study With Health Care Providers.

BACKGROUND: Hospitalized patients with complex care needs require an interprofessional team of health professionals working together to support their care in hospitals and during discharge planning. However, interprofessional communication and collaboration in inpatient settings are often fragmented and inefficient, leading to poor patient outcomes and provider frustration. Health information technology can potentially help improve team communication and collaboration; however, to date, evidence of its effectiveness is lacking. There are also concerns that current implementations might further fragment communication and increase the clinician burden without proven benefits. OBJECTIVE: In this study, we aimed to generate transferrable lessons for future designers of health information technology tools that facilitate team communication and collaboration. METHODS: A secondary analysis of the qualitative component of the mixed methods evaluation was performed. The electronic communication and collaboration platform was implemented in 2 general internal medicine wards in a large community teaching hospital in Mississauga, Ontario, Canada. Fifteen inpatient clinicians in those wards, including nurses, physicians, and allied health care providers, were recruited to participate in semistructured interviews about their experience with a co-designed electronic communication and collaboration tool. Data were analyzed using the Technology Acceptance Model, and themes related to the constructs of perceived ease of use (PEOU) and perceived usefulness (PU) were identified. RESULTS: A secondary analysis guided by the Technology Acceptance Model highlighted important points. Intuitive design precluded training as a barrier to use, but lack of training may hinder participants' PEOU if features designed for efficiency are not discovered by users. Organized information was found to be useful for creating a comprehensive clinical picture of each patient and facilitating improved handovers. However, information needs to be both comprehensive and succinct, and information overload may negatively impact PEOU. The mixed paper and electronic practice environment also negatively impacted PEOU owing to unavoidable double documentation and the need for printing. Participants perceived the tool to be useful as it improved efficiency in information retrieval and documentation, improved the handover process, afforded another mode of communication when face-to-face communication was impractical, and improved shared awareness. The PU of this tool depends on its optimal use by all team members. CONCLUSIONS: Electronic tools can support communication and collaboration among interprofessional teams caring for patients with complex needs. There are transferable lessons learned that can improve the PU and PEOU of future systems.

Using an electronic tool to improve teamwork and interprofessional communication to meet the needs of complex hospitalized patients: A mixed methods study.

BACKGROUND: Teamwork and interprofessional communication are important in addressing the comprehensive care needs of complex hospitalized patients. The objective of this study is to evaluate the impact of an electronic interprofessional communication and collaboration platform on teamwork, communication, and adverse events in the hospital setting. MATERIALS AND METHODS: In this mixed methods study, we used a quasi-experimental design in the quantitative component and deployed the electronic tool in a staged fashion to 2 hospital wards 3 months apart. We measured teamwork, communication, and adverse events with Relational Coordination survey, video recordings of team rounds, and retrospective chart review. We conducted qualitative semi-structured interviews with clinicians to understand the perceived impacts of the electronic tool and other contextual factors. RESULTS: Teamwork sustainably improved (overall Relational Coordination score improved from 3.68 at baseline to 3.84 at three and six months after intervention, p = 0.03) on ward 1. A small change in face-to-face communication pattern during team rounds was observed (making plans increased from 22% to 24%, p = 0.004) at 3 months on ward 1 but was not sustained at 6 months. Teamwork and communication did not change after the intervention on ward 2. There was no meaningful change to adverse event rates on either ward. Clinicians reported generally positive views about the electronic tool's impact but described non-technology factors on each ward that affected teamwork and communication. CONCLUSION: The impact of using an electronic tool to improve teamwork and communication in the hospital setting appears mixed, but can be positive in some settings. Improving teamwork and communication likely require both appropriate technology and addressing non-technology factors.

Clinician user involvement in the real world: Designing an electronic tool to improve interprofessional communication and collaboration in a hospital setting.

OBJECTIVES: User involvement is vital to the success of health information technology implementation. However, involving clinician users effectively and meaningfully in complex healthcare organizations remains challenging. The objective of this paper is to share our real-world experience of applying a variety of user involvement methods in the design and implementation of a clinical communication and collaboration platform aimed at facilitating care of complex hospitalized patients by an interprofessional team of clinicians. METHODS: We designed and implemented an electronic clinical communication and collaboration platform in a large community teaching hospital. The design team consisted of both technical and healthcare professionals. Agile software development methodology was used to facilitate rapid iterative design and user input. We involved clinician users at all stages of the development lifecycle using a variety of user-centered, user co-design, and participatory design methods. RESULTS: Thirty-six software releases were delivered over 24 months. User involvement has resulted in improvement in user interface design, identification of software defects, creation of new modules that facilitated workflow, and identification of necessary changes to the scope of the project early on. CONCLUSION: A variety of user involvement methods were complementary and benefited the design and implementation of a complex health IT solution. Combining these methods with agile software development methodology can turn designs into functioning clinical system to support iterative improvement.

An analysis of messages sent between nurses and physicians in deteriorating internal medicine patients to help identify issues in failures to rescue.

OBJECTIVE: To evaluate in patients who deteriorate and require transfer to the intensive care unit (ICU), how many have a critical text message communicating deterioration and what is the quality of this message? Is message quality, message response or the timeliness of rapid response team (RRT) activation related to death? METHODS: We conducted a retrospective chart review of all ICU transfers from General Internal Medicine (GIM) wards from January 2012 until August 2014. All critical messages (CM) in the 48h prior to ICU transfer were analyzed for RRT calling criteria, time to RRT activation, message quality, presence of vitals, and the quality and timeliness of physician response. RESULTS: Of the 236 patients in the study, 93 (39%) had a CM in the 48h prior to ICU transfer. Within this subset, 76 patients did not have prior RRT activation and the median times from CM to RRT activation and CM to ICU transfer were 8.9 [IQR 2.9, 20.7] and 15.6 [IQR 9.0, 28.7] hours, respectively. Only 45% of messages contained 2 or more vitals and only 3% of messages contained Situation, Background, Assessment, and Recommendations (SBAR). Physician response was timely (3 [IQR 2, 17] min) but response quality was poor; nearly one quarter of responses only acknowledged receipt. Among message characteristics, only the number of SBAR elements was correlated with in-hospital survival (p=0.047). CONCLUSION: Communication between nurses and physicians about critically ill patients could be improved. There appear to be significant gaps in the quality of messages, their responses, and delays in RRT activation.

A smartphone-enabled communication system to improve hospital communication: usage and perceptions of medical trainees and nurses on general internal medicine wards.

BACKGROUND: There is increasing interest in the use of information and communication technologies to improve how clinicians communicate in hospital settings. METHODS: We implemented a communication system with support for physician handover and secure messaging on 2 general internal medicine wards. We measured usage and surveyed physicians and nurses on perceptions of the system's effects on communication. RESULTS: Between May 2011 and August 2012, a clinical teaching team received, on average, 14.8 messages per day through the system. Messages were typically sent as urgent (69.1%) and requested a text reply (76.5%). For messages requesting a text reply, 8.6% did not receive a reply. For those messages that did receive a reply, the median response time was 2.3 minutes, and 84.5% of messages received a reply within 15 minutes. Of those who completed the survey, 95.3% were medical residents (82 of 86) and 81.7% were nurses (83 of 116). Medical trainees (82.8%) and nursing staff (78.3%) agreed or strongly agreed that the system helped to speed up their daily work tasks. Overall, 67.1% of the trainees and 73.2% of nurses agreed or strongly agreed that the system made them more accountable in their clinical roles. Only 35.8% of physicians and 26.3% of nurses agreed or strongly agreed that the system was useful for communicating complex issues. CONCLUSIONS: In summary, with a system designed to improve communication, we found that there was high uptake and that users perceived that the system improved efficiency and accountability but was not appropriate for communicating complex issues.

Medical students and personal smartphones in the clinical environment: the impact on confidentiality of personal health information and professionalism.

BACKGROUND: Smartphones are becoming ubiquitous in health care settings. The increased adoption of mobile technology such as smartphones may be attributed to their use as a point-of-care information source and to perceived improvements in clinical communication and efficiency. However, little is known about medical students' use of personal smartphones for clinical work. OBJECTIVE: The intent of the study was to examine final-year medical students' experience with and attitudes toward using personal mobile technology in the clinical environment, with respect to the perceived impact on patient confidentiality and provider professionalism. METHODS: Cross-sectional surveys were completed by final-year medical students at the University of Toronto. Respondents were asked about the type of personal mobile phone they use, security features on their personal phone, experiences using their personal phone during clinical rotations, and attitudes about using their personal phone for clinical work purposes. RESULTS: The overall response rate was 45.4% (99/218). Smartphone ownership was prevalent (98%, 97/99) with the majority (86%, 85/99) of participants using their personal phones for patient-related communication during clinical rotations. A total of 26% (26/99) of participants reported not having any type of security feature on their personal phone, 94% (90/96) of participants agreed that using their personal phone for clinical work makes them more efficient, and 86% (82/95) agreed that their personal phone allows them to provide better patient care. Although 68% (65/95) of participants believe that the use of personal phones for patient-related communication with colleagues poses a risk to the privacy and confidentiality of patient health information, 22% (21/96) of participants still use their personal phone to text or email identifiable patient data to colleagues. CONCLUSIONS: Our findings suggest that the use of personal smartphones for clinical work by medical students is prevalent. There is a need to more fully address the threat to patient confidentiality posed by the use of unsecured communication devices such as smartphones.

Short message service or disService: issues with text messaging in a complex medical environment.

BACKGROUND: Hospitals today are experiencing major changes in their clinical communication workflows as conventional numeric paging and face-to-face verbal conversations are being replaced by computer mediated communication systems. In this paper, we highlight the importance of understanding this transition and discuss some of the impacts that may emerge when verbal clinical conversations are replaced by short text messages. METHODS: In-depth interviews (n=108) and non-participatory observation sessions (n=260h) were conducted on the General Internal Medicine wards at five academic teaching hospitals in Toronto, Canada. RESULTS: From our analysis of the qualitative data, we identified two major themes. De-contextualization of complex issues led to an increase in misinterpretation and an increase in back and forth messaging for clarification. Depersonalization of communication was due to less verbal conversations and face-to-face interactions and led to a negative impact on work relationships. CONCLUSIONS: Text-based communication in hospital settings led to the oversimplification of messages and the depersonalization of communication. It is important to recognize and understand these unintended consequences of new technology to avoid the negative impacts to patient care and work relationships.

Electronic immunization data collection systems: application of an evaluation framework.

BACKGROUND: Evaluating the features and performance of health information systems can serve to strengthen the systems themselves as well as to guide other organizations in the process of designing and implementing surveillance tools. We adapted an evaluation framework in order to assess electronic immunization data collection systems, and applied it in two Ontario public health units. METHODS: The Centers for Disease Control and Prevention's Guidelines for Evaluating Public Health Surveillance Systems are broad in nature and serve as an organizational tool to guide the development of comprehensive evaluation materials. Based on these Guidelines, and informed by other evaluation resources and input from stakeholders in the public health community, we applied an evaluation framework to two examples of immunization data collection and examined several system attributes: simplicity, flexibility, data quality, timeliness, and acceptability. Data collection approaches included key informant interviews, logic and completeness assessments, client surveys, and on-site observations. RESULTS: Both evaluated systems allow high-quality immunization data to be collected, analyzed, and applied in a rapid fashion. However, neither system is currently able to link to other providers' immunization data or provincial data sources, limiting the comprehensiveness of coverage assessments. We recommended that both organizations explore possibilities for external data linkage and collaborate with other jurisdictions to promote a provincial immunization repository or data sharing platform. CONCLUSIONS: Electronic systems such as the ones described in this paper allow immunization data to be collected, analyzed, and applied in a rapid fashion, and represent the infostructure required to establish a population-based immunization registry, critical for comprehensively assessing vaccine coverage.

The integration of barcode scanning technology into Canadian public health immunization settings.

BACKGROUND: As part of a series of feasibility studies following the development of Canadian vaccine barcode standards, we compared barcode scanning with manual methods for entering vaccine data into electronic client immunization records in public health settings. METHODS: Two software vendors incorporated barcode scanning functionality into their systems so that Algoma Public Health (APH) in Ontario and four First Nations (FN) communities in Alberta could participate in our study. We compared the recording of client immunization data (vaccine name, lot number, expiry date) using barcode scanning of vaccine vials vs. pre-existing methods of entering vaccine information into the systems. We employed time and motion methodology to evaluate time required for data recording, record audits to assess data quality, and qualitative analysis of immunization staff interviews to gauge user perceptions. RESULTS: We conducted both studies between July and November 2012, with 628 (282 barcoded) vials processed for the APH study, and 749 (408 barcoded) vials for the study in FN communities. Barcode scanning led to significantly fewer immunization record errors than using drop-down menus (APH study: 0% vs. 1.7%; p=0.04) or typing in vaccine data (FN study: 0% vs. 5.6%; p<0.001). There was no significant difference in time to enter vaccine data between scanning and using drop-down menus (27.6s vs. 26.3s; p=0.39), but scanning was significantly faster than typing data into the record (30.3s vs. 41.3s; p<0.001). Seventeen immunization nurses were interviewed; all noted improved record accuracy with scanning, but the majority felt that a more sensitive scanner was needed to reduce the occasional failures to read the 2D barcodes on some vaccines. CONCLUSION: Entering vaccine data into immunization records through barcode scanning led to improved data quality, and was generally well received. Further work is needed to improve barcode readability, particularly for unit-dose vials.

The good, bad, and ugly of online recruitment of parents for health-related focus groups: lessons learned.

BACKGROUND: We describe our experiences with identifying and recruiting Ontario parents through the Internet, primarily, as well as other modes, for participation in focus groups about adding the influenza vaccine to school-based immunization programs. OBJECTIVE: Our objectives were to assess participation rates with and without incentives and software restrictions. We also plan to examine study response patterns of unique and multiple submissions and assess efficiency of each online advertising mode. METHODS: We used social media, deal forum websites, online classified ads, conventional mass media, and email lists to invite parents of school-aged children from Ontario, Canada to complete an online questionnaire to determine eligibility for focus groups. We compared responses and paradata when an incentive was provided and there were no software restrictions to the questionnaire (Period 1) to a period when only a single submission per Internet protocol (IP) address (ie, software restrictions invoked) was permitted and no incentive was provided (Period 2). We also compared the median time to complete a questionnaire, response patterns, and percentage of missing data between questionnaires classified as multiple submissions from the same Internet protocol (IP) address or email versus unique submissions. Efficiency was calculated as the total number of hours study personnel devoted to an advertising mode divided by the resultant number of unique eligible completed questionnaires . RESULTS: Of 1346 submitted questionnaires, 223 (16.6%) were incomplete and 34 (2.52%) did not meet the initial eligibility criteria. Of the remaining 1089 questionnaires, 246 (22.6%) were not from Ontario based on IP address and postal code, and 469 (43.1%) were submitted from the same IP address or email address (multiple submissions). In Period 2 vs Period 1, a larger proportion of questionnaires were submitted from Ontario (92.8%, 141/152 vs 75.1%, 702/937, P<.001), and a smaller proportion of same IP addresses (7.9%, 12/152 vs 47.1%, 441/937, P<.001) were received. Compared to those who made unique submissions, those who made multiple submissions spent less time per questionnaire (166 vs 215 seconds, P<.001), and had a higher percentage of missing data among their responses (15.0% vs 7.6%, P=.004). Advertisements posted on RedFlagDeals were the most efficient for recruitment (0.03 hours of staff time per questionnaire), whereas those placed on Twitter were the least efficient (3.64 hours of staff time per questionnaire). CONCLUSIONS: Using multiple online advertising strategies was effective for recruiting a large sample of participants in a relatively short period time with minimal resources. However, risks such as multiple submissions and potentially fraudulent information need to be considered. In our study, these problems were associated with providing an incentive for responding, and could have been partially avoided by activating restrictive software features for online questionnaires.

Immunizing health care workers against influenza: a glimpse into the challenges with voluntary programs and considerations for mandatory policies.

BACKGROUND: Vaccination of health care workers (HCWs) is an important patient safety initiative. It prevents influenza infection among patients and reduces staff illness and absenteeism. Despite these benefits, HCW influenza immunization uptake is low. Therefore, strategies to achieve high immunization coverage in HCWs, barriers to uptake, and perceptions of mandatory influenza immunization policies were discussed in key informant interviews with influenza immunization program planners. METHODS: We conducted telephone interviews with 23 influenza immunization program planners from 21 organizations (7 acute care hospitals, 6 continuing care facilities, and 8 public health organizations) across Canada. We used content analysis to identify themes from the interviews. RESULTS: Participants used a variety of promotional and educational activities, and many vaccine delivery approaches, to support HCW immunization programs. Barriers to achieving high coverage in HCWs included misconceptions about the safety and effectiveness of the influenza vaccine, negative personal experiences associated with the vaccine, and antivaccine sentiments. Participants mentioned mandatory influenza immunizations as a solution to low coverage. However, they identified challenges with this approach such as obtaining support from stakeholders, enforcement, and limiting personal autonomy. CONCLUSION: Participants believed immunization coverage in health care organizations will continue to be suboptimal using existing program strategies. Although participants discussed mandatory immunization as a way to improve uptake, potential obstacles will need to be addressed for this to be implemented successfully.

Contagious comments: what was the online buzz about the 2011 Quebec measles outbreak?

BACKGROUND: Although interruption of endemic measles was achieved in the Americas in 2002, Quebec experienced an outbreak in 2011 of 776 reported cases; 80% of these individuals had not been fully vaccinated. We analyzed readers' online responses to Canadian news articles regarding the outbreak to better understand public perceptions of measles and vaccination. METHODS: We searched Canadian online English and French news sites for articles posted between April 2011 and March 2012 containing the words "measles" and "Quebec". We included articles that i) concerned the outbreak or related vaccination strategies; and ii) generated at least ten comments. Two English and two bilingual researchers coded the unedited comments, categorizing codes to allow themes to emerge. RESULTS: We analyzed 448 comments from 188 individuals, in response to three French articles and six English articles; 112 individuals expressed positive perceptions of measles vaccination (2.2 comments/person), 38 were negative (4.2 comments/person), 11 had mixed feelings (1.5 comments/person), and 27 expressed no opinion (1.1 comments/person). Vaccine-supportive themes involved the success of vaccination in preventing disease spread, societal responsibility to vaccinate for herd immunity, and refutation of the autism link. Those against measles vaccination felt it was a personal rather than societal choice, and conveyed a distrust of vaccine manufacturers, believing that measles infection is not only safe but safer than vaccination. Commenters with mixed feelings expressed uncertainty of the infection's severity, and varied in support of all vaccines based on perceived risk/benefit ratios. CONCLUSION: The anti-vaccine minority's volume of comments translates to a disproportionately high representation on online boards. Public health messages should address concerns by emphasizing that immunization is always a personal choice in Canada, and that the pharmaceutical industry is strictly controlled. Illustrating the dangers of measles through personal stories, rather than scientific data only, may also serve to strengthen messaging.

Educational impact of using smartphones for clinical communication on general medicine: more global, less local.

BACKGROUND: Medical trainees increasingly use smartphones in their clinical work. Similar to other information technology implementations, smartphone use can result in unintended consequences. This study aimed to examine the impact of smartphone use for clinical communication on medical trainees' educational experiences. DESIGN: Qualitative research methodology using interview data, ethnographic data, and analysis of e-mail messages. ANALYSIS: We analyzed the interview transcripts, ethnographic data, and e-mails by applying a conceptual framework consisting of 5 educational domains. RESULTS: Smartphone use increased connectedness and resulted in a high level of interruptions. These 2 factors impacted 3 discrete educational domains: supervision, teaching, and professionalism. Smartphone use increased connectedness to supervisors and may improve supervision, making it easier for supervisors to take over but can limit autonomy by reducing learner decision making. Teaching activities may be easier to coordinate, but smartphone use interrupted learners and reduced teaching effectiveness during these sessions. Finally, there may be professionalism issues in relation to how residents use smartphones during encounters with patients and health professionals and in teaching sessions. CONCLUSIONS: We summarized the impact of a rapidly emerging information technology-smartphones-on the educational experience of medical trainees. Smartphone use increase connectedness and allow trainees to be more globally available for patient care but creates interruptions that cause trainees to be less present in their local interactions with staff during teaching sessions. Educators should be aware of these findings and need to develop curriculum to address the negative impacts of smartphone use in the clinical training environment.

Health care worker influenza immunization rates: the missing pieces of the puzzle.

BACKGROUND: Immunization rates are used to assess the level of protection against influenza, but limited data exist on how such rates are measured in health care organizations. We conducted key informant interviews with campaign planners to learn about processes for collecting immunization data, including barriers and facilitating factors for measuring and reporting rates. METHODS: We conducted telephone interviews with 23 influenza immunization program planners across Canada working in 7 acute care hospitals, 6 continuing care facilities, and 8 public health organizations in 2012. We used content analysis to examine the interview data. RESULTS: The methods used to collect immunization data varied by the size and type of health care organization. Immunization data from different personnel groups were included in immunization rate calculations depending on the local public health reporting requirements and the organization's size. Challenges associated with collecting immunization data and calculating rates included lack of resources for identifying personnel immunized off-site, tracking personnel who declined immunization, identifying non-payroll staff, and interpreting unclear public health reporting requirements. CONCLUSION: Support from other vaccine providers, public health, employers, and professional and external bodies is needed to provide the necessary information and resources to calculate accurate and complete rates. Further work is needed to refine and standardize the collection of HCW influenza immunization data so that it may be used for surveillance and quality assessment purposes.

The intended and unintended consequences of communication systems on general internal medicine inpatient care delivery: a prospective observational case study of five teaching hospitals.

BACKGROUND: Effective clinical communication is critical to providing high-quality patient care. Hospitals have used different types of interventions to improve communication between care teams, but there have been few studies of their effectiveness. OBJECTIVES: To describe the effects of different communication interventions and their problems. DESIGN: Prospective observational case study using a mixed methods approach of quantitative and qualitative methods. SETTING: General internal medicine (GIM) inpatient wards at five tertiary care academic teaching hospitals. PARTICIPANTS: Clinicians consisting of residents, attending physicians, nurses, and allied health (AH) staff working on the GIM wards. METHODS: Ethnographic methods and interviews with clinical staff (doctors, nurses, medical students, and AH professionals) were conducted over a 16-month period from 2009 to 2010. RESULTS: We identified four categories that described the intended and unintended consequences of communication interventions: impacts on senders, receivers, interprofessional collaboration, and the use of informal communication processes. The use of alphanumeric pagers, smartphones, and web-based communication systems had positive effects for senders and receivers, but unintended consequences were seen with all interventions in all four categories. CONCLUSIONS: Interventions that aimed to improve clinical communications solved some but not all problems, and unintended effects were seen with all systems.

It's not about pager replacement: an in-depth look at the interprofessional nature of communication in healthcare.

BACKGROUND: Institutions have tried to replace the use of numeric pagers for clinical communication by implementing health information technology (HIT) solutions. However, failing to account for the sociotechnical aspects of HIT or the interplay of technology with existing clinical workflow, culture, and social interactions may create other unintended consequences. OBJECTIVE: To evaluate a Web-based messaging system that allows asynchronous communication between health providers and identify the unintended consequences associated with implementing such technology. DESIGN: Intervention-a Web-based messaging system at the University Health Network to replace numeric paging practices in May 2010. The system facilitated clinical communication on the medical wards for coordinating patient care. Study design-pre-post mixed methods utilizing both quantitative and qualitative measures. PARTICIPANTS: Five residents, 8 nurses, 2 pharmacists, and 2 social workers were interviewed. Pre-post interruption-15 residents from 5 clinical teams in both periods. MEASUREMENTS: The study compared the type of messages sent to physicians before and after implementation of the Web-based messaging system; a constant comparative analysis of semistructured interviews was used to generate key themes related to unintended consequences. RESULTS: Interruptions increased 233%, from 3 pages received per resident per day pre-implementation to 10 messages received per resident per day post-implementation. Key themes relating to unintended consequences that emerged from the interviews included increase in interruptions, accountability, and tactics to improve personal productivity. CONCLUSIONS: Meaningful improvements in clinical communication can occur but require more than just replacing pagers. Introducing HIT without addressing the sociotechnical aspects of HIT that underlie clinical communication can lead to unintended consequences.

Measuring influenza immunization coverage among health care workers in acute care hospitals and continuing care organizations in Canada.

BACKGROUND: Immunizing health care workers against influenza is important for preventing and reducing disease transmission in health care environments. We describe the ability of Canadian health care organizations to measure influenza immunization coverage among health care workers and identify factors associated with comprehensive influenza immunization measurement. METHODS: A Web-based survey was distributed to influenza immunization campaign planners responsible for delivering the 2010-2011 influenza vaccine to health care workers working in acute care hospitals or long-term continuing care organizations. The primary outcome was the ability to comprehensively measure influenza immunization coverage. RESULTS: Of the 1,127 health care organizations approached, 721 (64%) responded. Ninety-one percent had incomplete immunization coverage measurement; 7% could not measure coverage among any personnel. After multivariable adjustment, organizations with a written influenza immunization implementation plan (odds ratio, 2.0; 95% confidence interval, 1.1-3.5) or a policy or procedure describing how to calculate or report immunization rates (odds ratio, 2.1; 95% confidence interval, 1.2-3.9) were more likely to have comprehensive measurement of influenza immunization coverage than organizations without these practices. CONCLUSION: Most organizations demonstrated incomplete measurement of influenza immunization among health care workers. Given the use of influenza immunization coverage as a measure of quality of care, further work is needed to develop a standardized approach to improve its measurement.

Incorporating scannable forms into immunization data collection processes: a mixed-methods study.

INTRODUCTION: Individual-level immunization data captured electronically can facilitate evidence-based decision-making and planning. Populating individual-level records through manual data entry is time-consuming. An alternative is to use scannable forms, completed at the point of vaccination and subsequently scanned and exported to a database or registry. To explore the suitability of this approach for collecting immunization data, we conducted a feasibility study in two settings in Ontario, Canada. METHODS AND FINDINGS: Prior to the 2011-2012 influenza vaccination campaign, we developed a scannable form template and a corresponding database that captured required demographic and clinical data elements. We examined efficiency, data quality, and usability through time observations, record audits, staff interviews, and client surveys. The mean time required to scan and verify forms (62.3 s) was significantly shorter than manual data entry (69.5 s) in one organization, whereas there was no difference (36.6 s vs. 35.4 s) in a second organization. Record audits revealed no differences in data quality between records populated by scanning versus manual data entry. Data processing personnel and immunized clients found the processes involved to be straightforward, while nurses and managers had mixed perceptions regarding the ease and merit of using scannable forms. Printing quality and other factors rendered some forms unscannable, necessitating manual entry. CONCLUSIONS: Scannable forms can facilitate efficient data entry, but certain features of the forms, as well as the workflow and infrastructure into which they are incorporated, should be evaluated and adapted if scannable forms are to be a meaningful alternative to manual data entry.

Barriers to the use of reminder/recall interventions for immunizations: a systematic review.

BACKGROUND: Although many studies have demonstrated the benefits of reminder/recall (RR) measures to address patient under-immunization and improve immunization coverage, they are not widely implemented by healthcare providers. We identified providers' perceived barriers to their use from existing literature. METHODS: We conducted a systematic review of relevant articles published in English between January 1990 and July 2011 that examined the perceptions of healthcare providers regarding barriers to tracking patient immunization history and implementing RR interventions. We searched MEDLINE, PubMed, EMBASE, Cumulative Index to Nursing and Allied Health Literature, Academic Search Premier, and PsychINFO. Additional strategies included hand-searching the references of pertinent articles and related reviews, and searching keywords in Google Scholar and Google. RESULTS: Ten articles were included; all described populations in the United States, and examined perceptions of family physicians, pediatricians, and other immunization staff. All articles were of moderate-high methodological quality; the majority (n=7) employed survey methodology. The most frequently described barriers involved the perceived human and financial resources associated with implementing an RR intervention, as well as low confidence in the accuracy of patient immunization records, given the lack of data sharing between multiple immunization providers. Changes to staff workflow, lack of appropriate electronic patient-tracking functionalities, and uncertainty regarding the success of RR interventions were also viewed as barriers to their adoption. CONCLUSIONS: Although transitioning to electronic immunization records and registries should facilitate the implementation of RR interventions, numerous perceived barriers must still be overcome before the full benefits of these methods can be realized.

Influenza vaccination coverage across ethnic groups in Canada.

BACKGROUND: The success of influenza vaccination campaigns may be suboptimal if subgroups of the population face unique barriers or have misconceptions about vaccination. We conducted a national study to estimate influenza vaccine coverage across 12 ethnic groups in Canada to assess the presence of ethnic disparities. METHODS: We pooled responses to the Canadian Community Health Survey between 2003 and 2009 (n = 437 488). We estimated ethnicity-specific self-reported influenza vaccine coverage for the overall population, for people aged 65 years and older, and for people aged 12-64 years with and without chronic conditions. We used weighted logistic regression models to examine the association between ethnicity and influenza vaccination, adjusting for sociodemographic factors and health status. RESULTS: Influenza vaccination coverage ranged from 25% to 41% across ethnic groups. After adjusting for sociodemographic factors and health status for people aged 12 years and older, all ethnic groups were more likely to have received a vaccination against influenza than people who self-identified as white, with the exception of those who self-identified as black (odds ratio [OR] 1.01, 95% confidence interval [CI] 0.88-1.15). Compared with white Canadians, Canadians of Filipino (OR 2.00, 95% CI 1.67-2.40) and Southeast Asian (OR 1.66, 95% CI 1.36-2.03) descent had the greatest likelihood of having received vaccination against influenza. INTERPRETATION: Influenza vaccine coverage in Canada varies by ethnicity. Black and white Canadians have the lowest uptake of influenza vaccine of the ethnic groups represented in our study. Further research is needed to understand the facilitators, barriers and misconceptions relating to vaccination that exist across ethnic groups, and to identify promotional strategies that may improve uptake among black and white Canadians.