The Use and Effectiveness of an Online Diagnostic Support System for Blood Film Interpretation: Comparative Observational Study.

BACKGROUND: The recognition and interpretation of abnormal blood cell morphology is often the first step in diagnosing underlying serious systemic illness or leukemia. Supporting the staff who interpret blood film morphology is therefore essential for a safe laboratory service. This paper describes an open-access, web-based decision support tool, developed by the authors to support morphological diagnosis, arising from earlier studies identifying mechanisms of error in blood film reporting. The effectiveness of this intervention was assessed using the unique resource offered by the online digital morphology Continuing Professional Development scheme (DM scheme) offered by the UK National External Quality Assessment Service for Haematology, with more than 3000 registered users. This allowed the effectiveness of decision support to be tested within a defined user group, each of whom viewed and interpreted the morphology of identical digital blood films. OBJECTIVE: The primary objective of the study was to test the effectiveness of the decision support system in supporting users to identify and interpret abnormal morphological features. The secondary objective was to determine the pattern and frequency of use of the system for different case types, and to determine how users perceived the support in terms of their confidence in decision-making. METHODS: This was a comparative study of identical blood films evaluated either with or without decision support. Selected earlier cases from the DM scheme were rereleased as new cases but with decision support made available; this allowed a comparison of data sets for identical cases with or without decision support. To address the primary objectives, the study used quantitative evaluation and statistical comparisons of the identification and interpretation of morphological features between the two different case releases. To address the secondary objective, the use of decision support was assessed using web analytical tools, while a questionnaire was used to assess user perceptions of the system. RESULTS: Cases evaluated with the aid of decision support had significantly improved accuracy of identification for relevant morphological features (mean improvement 9.8%) and the interpretation of those features (mean improvement 11%). The improvement was particularly significant for cases with higher complexity or for rarer diagnoses. Analysis of website usage demonstrated a high frequency of access for web pages relevant to each case (mean 9298 for each case, range 2661-24,276). Users reported that the decision support website increased their confidence for feature identification (4.8/5) and interpretation (4.3/5), both within the context of training (4.6/5) and also in their wider laboratory practice (4.4/5). CONCLUSIONS: The findings of this study demonstrate that directed online decision support for blood morphology evaluation improves accuracy and confidence in the context of educational evaluation of digital films, with effectiveness potentially extending to wider laboratory use.

Evaluation of the suitability of the World Health Organization International Reference Reagent for Hb A2 quantitation (89/666) for continued use.

INTRODUCTION: The accurate determination of Hb A2 is a key marker when screening for a ß-thalassaemia carrier. Data from external quality assessment (EQA) exercises have shown a lack of alignment of Hb A2 quantitation both within and between methods. The only reference material available for Hb A2 quantitative assay at the time of writing is the World Health Organization International Reference Reagent (89/666; WHO IRR) prepared in the 1980s and not validated for all current methodologies. METHOD: The WHO IRR was analysed for Hb A2 concentration by 52 laboratories using a representative range of high-performance liquid chromatography and capillary electrophoresis analysers. The results of the analysis were compared to those of a whole blood EQA specimen of similar Hb A2 concentration, distributed in the same week. RESULTS: The mean Hb A2 value obtained for the WHO IRR was 5.17%, compared to the assigned value of 5.3%. The range of results returned was wide (4.0%-6.2%), with differences in the results observed by between and within analyser groups. A similar range of results was seen with the whole blood sample, although the bias observed between analyser types was different from that seen with the WHO IRR. CONCLUSION: The results may indicate a lack of commutability of the WHO IRR material, resulting from deterioration, matrix effects or changes in reagent formulation or calibration parameters. Further examination of the suitability of the WHO IRR (89/666) for continued use is required.

Web-Based Virtual Microscopy of Digitized Blood Slides for Malaria Diagnosis: An Effective Tool for Skills Assessment in Different Countries and Environments.

BACKGROUND: Morphological examination of blood films remains the reference standard for malaria diagnosis. Supporting the skills required to make an accurate morphological diagnosis is therefore essential. However, providing support across different countries and environments is a substantial challenge. OBJECTIVE: This paper reports a scheme supplying digital slides of malaria-infected blood within an Internet-based virtual microscope environment to users with different access to training and computing facilities. The feasibility of the approach was established, allowing users to test, record, and compare their own performance with that of other users. METHODS: From Giemsa stained thick and thin blood films, 56 large high-resolution digital slides were prepared, using high-quality image capture and 63x oil-immersion objective lens. The individual images were combined using the photomerge function of Adobe Photoshop and then adjusted to ensure resolution and reproduction of essential diagnostic features. Web delivery employed the Digital Slidebox platform allowing digital microscope viewing facilities and image annotation with data gathering from participants. RESULTS: Engagement was high with images viewed by 38 participants in five countries in a range of environments and a mean completion rate of 42/56 cases. The rate of parasite detection was 78% and accuracy of species identification was 53%, which was comparable with results of similar studies using glass slides. Data collection allowed users to compare performance with other users over time or for each individual case. CONCLUSIONS: Overall, these results demonstrate that users worldwide can effectively engage with the system in a range of environments, with the potential to enhance personal performance through education, external quality assessment, and personal professional development, especially in regions where educational resources are difficult to access.

Do We Know Why We Make Errors in Morphological Diagnosis? An Analysis of Approach and Decision-Making in Haematological Morphology.

BACKGROUND: The laboratory interpretation of blood film morphology is frequently a rapid, accurate, and cost-effective final-stage of blood count analysis. However, the interpretation of findings often rests with a single individual, and errors can carry significant impact. Cell identification and classification skills are well supported by existing resources, but the contribution and importance of other skills are less well understood. METHODS: The UK external quality assurance group in haematology (UK NEQAS(H)) runs a Continued Professional Development scheme where large digital-images of abnormal blood smears are presented using a web-based virtual microscope. Each case is answered by more than 800 individuals. Morphological feature selection and prioritisation, as well as diagnosis and proposed action, are recorded. We analysed the responses of participants, aiming to identify successful strategies as well as sources of error. FINDINGS: The approach to assessment by participants depended on the affected cell type, case complexity or skills of the morphologist. For cases with few morphological abnormalities, we found that accurate cell identification and classification were the principle requirements for success. For more complex films however, feature recognition and prioritisation had primary importance. Additionally however, we found that participants employed a range of heuristic techniques to support their assessment, leading to associated bias and error. INTERPRETATION: A wide range of skills together allow successful morphological assessment and the complexity of this process is not always understood or recognised. Heuristic techniques are widely employed to support or reinforce primary observations and to simplify complex findings. These approaches are effective and are integral to assessment; however they may also be a source of bias or error. Improving outcomes and supporting diagnosis require the development of decision-support mechanisms that identify and support the benefits of heuristic strategies while identifying or avoiding associated biases. FUNDING: The CPD scheme is funded by participant subscription.

The accuracy of platelet counting in thrombocytopenic blood samples distributed by the UK National External Quality Assessment Scheme for General Haematology.

A knowledge of the limitations of automated platelet counting is essential for the effective care of thrombocytopenic patients and management of platelet stocks for transfusion. For this study, 29 external quality assessment specimen pools with platelet counts between 5 and 64 × 10(9)/L were distributed to more than 1,100 users of 23 different hematology analyzer models. The same specimen pools were analyzed by the international reference method (IRM) for platelet counting at 3 reference centers. The IRM values were on average lower than the all-methods median values returned by the automated analyzers. The majority (~67%) of the automated analyzer results overestimated the platelet count compared with the IRM, with significant differences in 16.5% of cases. Performance differed between analyzer models. The observed differences may depend in part on the nature of the survey material and analyzer technology, but the findings have implications for the interpretation of platelet counts at levels of clinical decision making.

Guidelines for point-of-care testing: haematology.

This guideline provides a framework for the arrangement of point-of-care testing (POCT) services, previously known as near patient testing (patient self-testing not covered). POCT is defined as any analytical test performed outside the laboratory. Primary users are often non-laboratory healthcare workers. The guidance applies to units within hospitals as well as general practioner surgeries, community clinics and pharmacies. The head of the haematology laboratory or a point of care coordinator must take responsibility for all aspects of the POCT service, including quality and training. Depending on the size and nature of the POCT practice, a local POCT manager may also be required. Equipment selected should have received a successful independent performance evaluation. If an independent evaluation has not been performed the purchaser should assess the device according to the protocol in this document. POCT devices should generate results that are comparable to those of the local laboratory. An accredited external quality assessment programme and internal quality control system must be established. Manufacturers promoting POCT devices designed for non-laboratory sites, e.g. pharmacies, should undertake training and annual competency assessment, perhaps using a web-based system. A diagram to illustrate the stages for the implementation of a POCT service is illustrated.