Inventory of validation approaches in selected health telematics projects.

This paper presents the results from an inventory of validation approaches and methodologies which have been used in selected health telematics projects. The inventory was performed in the VATAM Validation of Telematic Applications in Medicine project, HC1115HC. The purpose of the inventory was to analyse the methodologies and their application assumptions in order to identify possibilities for harmonization and consolidation. The inventory was performed using five validation dimensions: IT-development; quality; user; technology assessment and marketing. The inventory results show that possibilities exist to synthesise methodologies and to provide practical guidance and support for projects that are developing health telematics applications. All stakeholders in health telematics projects, i.e. users, health care decision-makers, developers, suppliers and IT-industries, can benefit from practical validation guidelines and support for validation when guidelines are represented in a usable, easy to access and informative way.

The VATAM guidelines.

Evaluation and assessment of the impact of information and communication technology in medicine is gaining interest. Unfortunately, till now there were no agreed upon approaches. The objective of the VATAM project is to develop guidelines that will assist assessors to set-up and execute studies. This paper describes the background of the VATAM project and provides an account of the current state of the guidelines. It concludes with an indication of the developments that will take place in the short term to further elaborate the guidelines and some considerations for consolidation of VATAM's results.

VATAM: developing consensus in validation of health telematics applications.

VATAM (Validation of Telematics Applications in Medicine) is an EU supported project in the Health care sector of the Telematics Application Programme. Its objective is to assist other health telematics projects by providing a platform for discussion on validation, eventually resulting in 'guidelines for validation of telematics applications in medicine'. The VATAM work can be subdivided into three phases: the inventory phase (1996) in which information is collected on validation approaches in the Telematics Application Programme, previous efforts and expertise. The dissemination phase (1997) will be used to extend and adapt the framework developed in the inventory phase, through cooperation with other projects The experiences phase (1998) in which the projects are actually applying validation, will be used by VATAM to validate the VATAM methodology. VATAM has finished the inventory phase successfully and is now working on the dissemination phase by--among others--establishing contacts with other projects, and providing information on the inventory through the World Wide Web (URL: http:(/)/www-vatam.unimaas.nl). This paper discusses the approach adopted and the proposed VATAM framework to structure the large variety of validation approaches.

Guidelines for cost-effective implementation of Picture Archiving and Communication Systems. An approach building on practical experiences in three European hospitals.

This paper describes a comprehensive approach for the assessment of the impact of (partial) Picture Archiving and Communication Systems (PACS). The approach is developed, based on actual clinical experience in three European hospitals and tested in these environments. The approach departs from a thorough analysis of the working procedures and information flows before implementation, both descriptive and quantitative. On the basis of this analysis, quantitative (and hence testable) objectives of the implementation are defined. The implementation strategy is defined after comparison of various scenarios, taking costs and effects for both the final and the transition phases into account. The approach is supported by a comprehensive evaluation protocol and a software package (PACER). The approach is demonstrated in this paper by applying it on a hypothetical PACS implementation for CT, ultrasound and for the part of the radiology department serving ICU. The objectives of this PACS are: (1)--to shorten the turn around time between the radiology department and ICU from 4 h to 30 min, (2)--to save 2000 m2 of film per year and (3)--to save personnel time. In this case the PACS is introduced in three phases and completed after three years. The cost analysis shows that, if started in 1995, a financial break even point is reached after 6 years, when comparing costs for the film-based system with those of the PACS. Experiences in the three sites show that the approach helps to harvest potential benefits, allowing a cost-effective implementation of PACS.