Telehealth readiness assessment tools.

In planning a telehealth project, a readiness assessment can help to improve the chances of successful implementation by identifying the stakeholders and the factors that should be targeted. We conducted a literature search and identified six questionnaires on readiness that can be used when implementing telehealth projects. Only one of them was sufficiently generic to be used with all kinds of telehealth projects and with different groups of participants (patients and public, health-care practitioners and organization personnel like health-care managers and technical support managers), but it had rather limited psychometric evaluation. Two of them had had good psychometric evaluation but they were specific to particular telehealth projects and groups of stakeholders. All six published questionnaires were in English. We have developed and validated a French-Canadian version of the practitioner and organizational telehealth readiness assessment tool.

Developing and validating the French-Canadian version of the practitioner and organizational telehealth readiness assessment tools.

Only one telehealth readiness assessment tool, that of Jennett et al., covers all types of telehealth projects, regardless of health-care provision context. However, this instrument is only available in English and has not undergone psychometric evaluation. We developed a French-Canadian version of the Practitioner Telehealth Readiness Assessment Tool and the Organizational Telehealth Readiness Assessment Tool. Transcultural validity was assessed by nine practitioners and 12 clinical project co-ordinators or administrators. For practitioners and managers, there was no significant difference between the scores of the English and the French versions of the questionnaires. The results showed that the telehealth readiness of co-ordinators or administrators was greater than that of practitioners when the range in scores was taken into account. The French-Canadian versions of the two questionnaires make it possible to assess telehealth readiness among French speakers. However, other studies involving patients will be necessary to validate the Patient-Public Telehealth Readiness Assessment Tool.

Telehealth as gatekeeper: policy implications for geography and scope of services.

Why, despite enthusiasm, is telehealth still a relatively minor part of healthcare delivery in many health systems? We examined two less-considered policy issues: (1) the scope of services being offered by telehealth and how this matches existing arrangements for insured services; and (2) how the ability of telehealth services to minimize barriers associated with geography is dealt with in a system organized and financed on geographical boundaries. Fifty-three semistructured interviews with key stakeholders involved in the management of 43 Canadian telehealth programs were conducted. In addition, quantitative activity data were analyzed from 33 telehealth programs. Two telehealth approaches emerged: telephone-based (N = 3), and video-conferencing-based (N = 40). Most programs reflected, rather than superceded, existing geographical boundaries; with the technology being used, the videoconferencing models imposed significant barriers to unfettered access by outlying communities because they required sites to acquire expensive technology, be affiliated with an existing telehealth network, and schedule visits in advance. In consequence, much activity was administrative and educational, rather than clinical, and often extended beyond the set of mandatory insured services. Despite high hopes that telehealth would improve access to care for rural/remote areas, gatekeeping inherent in certain telehealth systems imposes barriers to unfettered use by rural/remote areas, although it does facilitate other valued activities. Policy approaches are needed to promote a closer match between the expectations for telehealth and the realities reflected by many existing models.

A survey in Alberta and Quebec of the telehealth applications that physicians need.

We studied the utility of various telehealth applications to support practice in rural and remote regions from the physicians' point of view. A postal survey was conducted among physicians from rural and remote regions of Alberta and Eastern Quebec. A total of 321 questionnaires were returned (13% response rate), comprising 180 from Quebec (16%) and 141 from Alberta (11%). Differences in the perceived utility of telehealth applications were explored using univariate and multivariate analyses. Telehealth applications were grouped into four categories: (1) asynchronous; (2) synchronous; (3) education; and (4) access to health information. The perceived utility of each application varied significantly between provinces. However, the two categories of telehealth applications perceived to be the most relevant were the same in both provinces: access to health information and applications for tele-education.

Framework for Canadian telehealth guidelines: summary of the environmental scan.

A Canadian project (the National Initiative for Telehealth Guidelines) was established to develop telehealth guidelines that would be used by health professionals, by telehealth providers as benchmarks for standards of service and by accrediting agencies for accreditation criteria. An environmental scan was conducted, which focused on organizational, human resource, clinical and technological issues. A literature review, a stakeholder survey (245 mail-outs, 84 complete responses) and 48 key informant interviews were conducted. A framework of guidelines was developed and published as a preliminary step towards pan-Canadian policies. Interim recommendations were that organizations and jurisdictions might consider formal agreements to specify: (1) organizational interoperability; (2) technical interoperability; (3) personnel requirements; (4) quality and continuity-of-care responsibilities; (5) telehealth services; (6) remuneration; and (7) quality assurance processes. An additional recommendation was that flexible mechanisms were needed to ensure that accreditation criteria will be realistic and achievable in the context of rapid changes in technology, service integration and delivery, as well as in the context of operating telehealth services in remote or underserved areas.

Learning gains derived from a high-fidelity mannequin-based simulation in the pediatric emergency department.

There are limited data on the effectiveness of mannequin-based simulations in pediatrics. This study developed a training program using a high-fidelity child mannequin to simulate critical cases in an emergency department, and examined the learning gains derived from this simulation. Eighteen pediatric residents, as pairs, participated in a high-fidelity simulation pretest, training session and a posttest. The training session, developed based on participants' pretest performance, included videotape review, feedback, and hands-on practice, and focused on the improvement of management skills for shock and tachydyspnea. The pre- and posttest performances were scored for task-specific technical skills and behaviors. The learning gains between the pre- and posttests were significant (p < 0.001) for task-specific technical skills (from 64 +/- 15% to 93 +/- 4%) and behaviors (from 65 +/- 18% to 85 +/- 12%). This study suggests that high-fidelity simulation can enhance learning about how to manage critical cases in the pediatric emergency department.

The essence of telehealth readiness in rural communities: an organizational perspective.

This paper examines telehealth readiness from an organizational perspective and explores the essence of telehealth readiness among four domains, namely, patients, practitioners, the public, and organizations in rural Canadian communities. Because readiness is a necessary requirement for the successful implementation of an innovation, it is important to identify and ensure core factors of readiness before costly investments are made. The findings presented here derive from a qualitative phenomenological research approach involving semistructured telephone interviews with four key informants (respondents). The data identified four categories of readiness in an organizational setting: core readiness, engagement, structural readiness, and nonreadiness. Understanding organizational readiness within rural and remote communities is an important step for the successful implementation of telehealth services into existing systems of health care.

Access and authorisation in a Glocal e-Health Policy context.

Challenges to the development of appropriate yet adaptable policy and tools for security of the individual patient electronic health record (EHR) are proving to be significant. Compounding this is the unique capability of e-health to transgress all existing geo-political and other barriers. Initiatives to develop and advance policy, standards, and tools in relation to EHR access control and authorisation management must address this capability. Currently policy development initiatives take place largely in an isolated manner. This jeopardises the potential of e-health because decisions made in one jurisdiction might hamper, even prevent, an e-health opportunity in another. This paper places access and authorisation issues in an overall policy context through describing current Canadian initiatives. The National Initiative for Telehealth (NIFTE) Guidelines project is developing a framework of national guidelines for telehealth. The Policy and Peer Permission (PPP) project is developing a unique tool that provides persistent protection of data. The new corporate body 'Infoway' is developing a pan-Canadian electronic health record solution. Finally, the Glocal e-Health Policy initiative is developing a tool with which to identify and describe the inter-relationships of e-health issues amongst policy levels, themes, and actors.

The need for economic evaluation of telemedicine to evolve: the experience in Alberta, Canada.

Economic evaluation of telemedicine applications is required to provide decision makers in health care with appropriate information on costs and benefits of this information and communications technology. The level of economic evaluation should evolve as telemedicine applications mature. At the basic level, economic evaluation may include basic cost analysis and primarily observational data on nonmonetary benefits. The focus will change as telemedicine programs develop. At this intermediate level, practice patterns and workforce issues are addressed as they affect utilization and costs of telemedicine services. Longer-term economic evaluation, thus far not achieved in telemedicine assessment, should focus on assessment of health outcomes and economic impact. Alberta, Canada has made progress assessing telemedicine applications in psychiatry, radiology, rheumatology, and rehabilitation. Data availability and analytic resources continue to present challenges to economic assessment of telemedicine.

A study of a rural community's readiness for telehealth.

A qualitative approach was used to explore the readiness of a rural community for the implementation of telehealth services. There were four domains of interest: patient, practitioner, public and organization. Sixteen semistructured telephone interviews (three to five in each domain) were carried out with key informants and recorded on audio-tape. Two community awareness sessions were held, which were followed by five audio-taped focus groups (with five to eight people in each) in the practitioner, patient and public domains. In addition, two in-depth interviews were conducted with community physicians. Analysis of the data suggested that there were four types of community readiness: core, engagement, structural and non-readiness. The level of readiness varied across domains. There were six main themes: core readiness; structural readiness; projection of benefits; assessment of risk; awareness and education; and intra-group and inter-group dynamics. The results of the study can be used to investigate the readiness of rural and remote communities for telehealth, which should improve the chance of successful implementation.

Telemedicine approach to screening for severe retinopathy of prematurity: a pilot study.

PURPOSE: To evaluate the use of remote reading of digital retinal photographs in the diagnosis of severe (referral-warranted) retinopathy of prematurity (ROP) during longitudinal screening for ROP. STUDY DESIGN: Prospective, longitudinal cohort study. SUBJECTS: Forty-four consecutive premature infants at risk for ROP. METHODS: All infants were examined longitudinally, over a series of examinations, by indirect ophthalmoscopy (gold standard) and digital photography using the RetCam-120 Digital Retinal Camera (Massie Research Laboratories Inc., Dublin, CA) equipped with an ROP lens. Images were stored and read remotely by a masked reader. Referral-warranted ROP was defined as ROP in zone 1, the presence of plus disease or the presence of any stage 3 ROP. We determined whether and when referral-warranted ROP was diagnosed for each eye, of each infant, on each examination, during the course of each of the infant's screening. RESULTS: Severe (referral-warranted) ROP was diagnosed in 23 eyes by indirect ophthalmoscopy during their series of examinations. Digital photography had a sensitivity of 100% and a specificity of 96% in detecting referral-warranted ROP. The positive predictive value of digital photography was 92%, and the negative predictive value was 100%. In 87% of eyes, referral-warranted ROP was diagnosed by digital photography before or at the same time as indirect ophthalmoscopy. CONCLUSIONS: Longitudinal remote reading of digital photographs using the RetCam-120 system has excellent specificity and sensitivity in detecting referral-warranted ROP. This pilot study has shown that remote reading of digital photographs has promise for telemedicine strategies in ROP screening.

A readiness model for telehealth is it possible to pre-determine how prepared communities are to implement telehealth?

Telehealth "readiness" can be defined as the degree to which users, health care organizations, and the health system itself are prepared to participate and succeed in its application. This project developed a readiness model for rural/remote locations in Canada. Specifically defined groups or communities with shared characteristics within a rural geographical community (i.e. practitioners, patients, the public, and health care organizations) participated in key informant interviews, awareness sessions, focus groups, and face-to-face interviews. The data were examined and organized keeping in mind Weiss' Program's Theory of Change. This approach allowed concrete and abstract factors to be considered. The model that emerged suggests that there are four types of readiness for each of the defined communities: core, engagement, structural, and non-readiness. The "communities" share some readiness factors and risks, but also exhibit unique elements. This finding is critical to acknowledge when the goal is to implement a useful, effective, and sustainable telehealth system within remote settings. Study results hold a key to understanding why technology systems have failed in the past, in spite of dedicating considerable human and financial resources towards their implementation. Notations of these findings will be helpful in future telehealth implementations within rural and isolated areas.

Organizational readiness for telemedicine: implications for success and failure.

The use of telemedicine brings about change in health-care organizations and opens up new possibilities for service delivery. The organizational environment is often crucial in determining whether or not telemedicine applications will be successful. To examine the concept of 'organizational readiness for telemedicine' as a factor to explain why telemedicine initiatives succeed or fail, the results were used of interviews with key informants, conducted in two studies: the Alliance for Building Capacity project and the National Initiative for Telehealth guidelines project. The data indicate that organizational readiness for telemedicine is a multifaceted concept that is related to planning and the workplace environment. A greater understanding of the factors within organizational readiness could help to avoid costly implementation errors. 'Readiness' needs to be systematically assessed and is important for long-term success.