Validation of Australian data in the Australasian Vascular Audit.

BACKGROUND: Accuracy of data is important in any clinical audit. It is necessary to determine how complete the dataset is as well as the accuracy of the data that have been entered. The Australasian Vascular Audit has been operational for 4 years and a data validation process has been undertaken. METHOD: An independent data source is available, which is collected by the Australian Institute of Health and Welfare. This collects all public and private hospital data and is available for interrogation. Similarly, private-only data are available from the Medicare website. This has been compared with the Australasian Vascular Audit dataset to establish completeness of data collection. Quality of data collected has been verified by comparing accuracy of data fields with that present in patient records in a 5% random sample. RESULTS: For the 2 years studied, there was a 63% capture rate in Australia for all patients. In the private sector, only 50% of patients were captured with a significant decrease noted in 2013. The quality of data entered had a 2.6% error rate. CONCLUSION: There is a need to increase compliance with vascular audit in Australia and data accuracy is acceptable but could be improved.

Development of the Australasian vascular surgical audit.

OBJECTIVE: The purpose of this study was to describe the development of the Australasian Vascular Audit that was created to unify audit activities under the umbrella of the Australian and New Zealand Society for Vascular Surgery as a Web-based application. METHODS: Constitutional change in late 2008 deemed participation in this audit compulsory for Society members. The Web-based application was developed and tested during 2009. Data for all open vascular surgery and for all endovascular procedures are collected at two points in the admission episode: at the time of operation and at discharge, and entered into the application. Data are analyzed to produce risk-adjusted outcomes. An algorithm has been developed to deal with outliers according to natural justice and to comply with the requirements of regulatory bodies. The Audit is protected by legislated privilege and is officially endorsed and indemnified by the Royal Australasian College of Surgeons. Confidentiality of surgeons and patients alike is ensured by a legally protected coding system and computer encryption system. Validation is by a verification process of 5% of members per year who are randomly selected. The application is completely funded by the Society. RESULTS: Data entry commenced on January 1, 2010. Over 40,000 vascular procedures were entered in the first year. The Audit application allows instantaneous on-line access to individual data and to deidentified group data and specific reports. It also allows real-time instantaneous production of log books for vascular trainees. The Audit has already gained recognition in the Australasian public arena during its first year of operation as an important benchmark of correct professional surgical behavior. Compliance has been extremely high in public hospitals but less so in private hospitals such that only 60% of members received a certificate of complete participation at the end of its first year of operation. CONCLUSION: An Internet-based compulsory audit of complete surgical practice is possible to create and be maintained by a society of surgeons with a membership of just over 200. The 60% compliance rate for complete data entry has created an immediate constitutional challenge for the Society. Future challenges are to improve total participation to an acceptable level and to ensure accurate data entry via a robust validation system.