Serological diagnostic for SARS-CoV-2: an experimental External Quality Assessment Scheme.

OBJECTIVES: Numerous analytical systems, rapidly made available on the market throughout the SARS-CoV-2 pandemic, aim to detect COVID-19, and to continuously update and improve the same systems. Medical laboratory professionals have also developed in-house analytical procedures in order to satisfy the enormous volume of requests for tests. These developments have highlighted the need control the analytical procedures used in order to guarantee patient safety. The External Quality Assessment (EQA) Scheme, an important quality assurance tool, aims to guarantee high standard performance for laboratory and analytical procedures. The aim of the present study was to report on the results collected in an experimental EQA scheme for the serological diagnosis of SARS-CoV-2. METHODS: All qualitative results collected in the different EQA surveys were summarized in order to identify the percentage of laboratory results in relation to typology of antibodies, results and samples. RESULTS: A total of 4,867 data sets were collected. The analysis of EQA data made, demonstrates a better agreement among laboratories results for total Ig than single immunoglobulins (IgG, IgM, IgA) in the case samples positive for SARS-CoV-2, and a wide divergence between IgM results for positive samples (only 34.9% were correct). Results for negative controls and specificity controls demonstrated a better overall agreement than results for positive samples. CONCLUSIONS: Working in collaboration with the IVD manufacturers, laboratory professionals must strive to achieve harmonization of results, and to develop well-defined protocols complying with the ISO 15189 requirements.

The Italian External Quality Assessment (EQA) program on urinary sediment by microscopy examination: a 20 years journey.

OBJECTIVES: In spite of the introduction of automated systems for urinary sediment analysis, microscopy examination remains the gold standard, and it is more than ever important to perform it with a good and reliable quality. External Quality Assessment (EQA) programs on urinary sediment are rare. The present paper provides an analysis of results from 2001 to date of the EQA Italian program which involves today 230 laboratories. METHODS: The program includes four surveys per year. Participants are asked the identification and clinical associations of urinary sediment particles, shown as phase contrast microscopy images in the website of the Center of Biomedical Research (CRB) (2 surveys), and the diagnosis of clinical cases presented by both images and a short clinical history (2 surveys). The results of each survey are then scored and commented. In 20 years, 298 images were presented: 90 cells (9 types), 23 lipids (5 types), 87 casts (21 types), 53 crystals (14 types), 22 microorganisms (5 types), and 23 contaminants (9 types). Moreover, 27 clinical cases, covering a wide spectrum of conditions with different degrees of complexity, were presented to participants. RESULTS: Identification: among urinary particle categories, the correct identification rate (obtained for each particle from the sum of correct + partially correct answers) was very high for micro-organisms (mean ± SD: 96.2 ± 3.5%), high for lipids (88.0 ± 11.8%) and crystals (87.0 ± 16.5%) followed, in decreasing order, by cells (82.1 ± 15.9%), casts (81.8 ± 14.8%), and contaminants (76.7 ± 22.1%). Clinical associations (n=67): the rate of correct answers was 93.5 ± 5.7% ranging from 75.0 to 100% for all but one clinical association (i.e., acute glomerulonephritis: 55.4%). Clinical cases: throughout surveys, due to the overall rate of particle misidentification, only 59.8 ± 17.1%, (range 32.5-88.7%) of participants achieved access to clinical diagnosis. Of these, 88.7 ± 10.6% (range 59.9-99.3%) were able to indicate the correct diagnosis. CONCLUSIONS: Our program can be used as a tool to improve the identification of urine particles and the knowledge of their clinical meaning and to encourage specialists of laboratory medicine to correlate urinary findings with other laboratory data and the clinical history, an aspect that improves the value of the day by day work.

Performance evaluation of 14 specific proteins measurement checked by an External Quality Assessment Scheme.

AIMS OF THE STUDY: To evaluate the state-of-the-art of 14 specific proteins measurement; to evaluate the laboratories' performance and the degree of harmonization in reporting results of participants in the External Quality Assessment Program of the Centre of Biomedical Research (CRB). METHODS: Overall and system-related inter-laboratory analytical variability (mean CVs%) and between-system differences (mean bias%) were evaluated from data of six EQA cycles 2013-2018. Moreover, we evaluated the analytical performance of participants as well as the units used to express proteins results. RESULTS: Overall inter-laboratory variability ranged from 3.8% for haptoglobin (HPT) to 12.5% for α1-antitrypsin (AAT) and decreased for IgA, α2-macroglobulin (A2M) and transferrin (TRF). Mean CVs% were generally higher for Siemens BN and Beckman Immage immunonephelometric systems, but <7.0% for all proteins. Mean bias > 7.0% was observed for BN (IgA, C4, AAT, transthyretin TTR), Siemens Vista (IgA, C4) and Immage (C4), whereas mean bias < -7.0% was found for Immage (AAT), Beckman AU (IgM) and Roche Cobas (C4, TTR, C-reactive protein). The laboratories' performance within the limits ranged from 85.1% of albumin (ALB) to 97.2% of HPT. The census of units employed in 2018, demonstrated that ~ 70% of laboratories still express the results in mg/dL. CONCLUSIONS: Despite a reduction in inter-laboratory variability for some proteins, different analytical systems showed both proportional and constant bias between methods. Units used by participants have not been substantially changed and dL is still largely used. The CRB EQA Program, with its performance data sets, is a valuable resource for laboratories and IVD manufacturers and support the goals of harmonization.

[PHYSICAL, CHEMICAL AND MORPHOLOGICAL URINE EXAMINATION: RECOMMENDATIONS FOR THE POST ANALYTICAL PHASE FROM THE INTERDISCIPLINARY URINALYSIS GROUP (GIAU)].

With these recommendations the Interdisciplinary Urinalysis Group (GIAU) aims to stimulate the following aspects : improvement and standardization of the post analytical approach to physical, chemical and morphological urine examination (ECMU); emphasize the value added to ECMU by selection of clinically significant parameters, indication of analytical methods, of units of measurement, of reference values; improvement of interpretation of dip stick urinalysis with particular regard to the reconsideration of the diagnostic significance of the evaluated parameters together with an increasing awareness of the limits of sensitivity and specificity of this analytical method. Accompanied by the skills to propose and carry out in-depth investigations with analytical methods that are more sensitive and specific;increase the awareness of the importance of professional skills in the field of urinary morphology and their relationships with the clinicians. through the introduction, in the report, of descriptive and interpretative comments depending on the type of request, the complexity of the laboratory, the competence of the pathologist;implement a policy of evaluation of the analytical quality by using, in addition to traditional internal and external controls, a program for the evaluation of morphological competence. The hope is to revalue the enormous potential diagnostic of ECMU, implementing a urinalysis on personalized diagnostic needs that each patient brings with it.

Harmonization of units and reference intervals of plasma proteins: state of the art from an External Quality Assessment Scheme.

BACKGROUND: The need to harmonize laboratory information is particularly intense in the field of plasma proteins, considering their clinical impact and relevance in monitoring diseases. METHODS: We evaluated units and reference intervals (RIs) utilized by participants of the External Quality Assessment Scheme (EQAS) for plasma proteins of the Centre of Biomedical Research. Moreover, we evaluated inter-laboratory analytical variability from 2001 to 2017. RESULTS: The census of participants' units employed in 2017 showed that for albumin (ALB), ~66% of laboratories still used dL instead of L, and for most other proteins, ~70% still expressed the results in mg/dL. Laboratories primarily used the RIs reported in the packaging inserts of their analytical systems, but for each protein, there was a wide variability of RIs, also among laboratories using the same analytical method. Mean CVs% of the 13 certified proteins in the last five EQA cycles ranged from 3.8% of haptoglobin (HPT) to 12.4% of α1-antitrypsin (AAT) and decreased from 2001 to 2017 for most of them, in particular for C3, ALB, α2-macroglobulin (A2M), HPT and transferrin (TRF). CONCLUSIONS: In the face of a reduction in inter-laboratory variability for a lot of proteins, there has not been a substantial change in the units and in the RIs used by the participants. To change old habits is difficult and requires coordination and collaboration. The EQAS plays an important role in the assessment and monitoring of all elements that contribute to the formulation of laboratory information and may be useful to contribute to their harmonization.

Analytical performance of 17 general chemistry analytes across countries and across manufacturers in the INPUtS project of EQA organizers in Italy, the Netherlands, Portugal, United Kingdom and Spain.

BACKGROUND: Optimum patient care in relation to laboratory medicine is achieved when results of laboratory tests are equivalent, irrespective of the analytical platform used or the country where the laboratory is located. Standardization and harmonization minimize differences and the success of efforts to achieve this can be monitored with international category 1 external quality assessment (EQA) programs. METHODS: An EQA project with commutable samples, targeted with reference measurement procedures (RMPs) was organized by EQA institutes in Italy, the Netherlands, Portugal, UK, and Spain. Results of 17 general chemistry analytes were evaluated across countries and across manufacturers according to performance specifications derived from biological variation (BV). RESULTS: For K, uric acid, glucose, cholesterol and high-density density (HDL) cholesterol, the minimum performance specification was met in all countries and by all manufacturers. For Na, Cl, and Ca, the minimum performance specifications were met by none of the countries and manufacturers. For enzymes, the situation was complicated, as standardization of results of enzymes toward RMPs was still not achieved in 20% of the laboratories and questionable in the remaining 80%. CONCLUSIONS: The overall performance of the measurement of 17 general chemistry analytes in European medical laboratories met the minimum performance specifications. In this general picture, there were no significant differences per country and no significant differences per manufacturer. There were major differences between the analytes. There were six analytes for which the minimum quality specifications were not met and manufacturers should improve their performance for these analytes. Standardization of results of enzymes requires ongoing efforts.

Post-standardization of routine creatinine assays: are they suitable for clinical applications.

Introduction Reliable serum creatinine measurements are of vital importance for the correct classification of chronic kidney disease and early identification of kidney injury. The National Kidney Disease Education Programme working group and other groups have defined clinically acceptable analytical limits for creatinine methods. The aim of this study was to re-evaluate the performance of routine creatinine methods in the light of these defined limits so as to assess their suitability for clinical practice. Method In collaboration with the Dutch External Quality Assurance scheme, six frozen commutable samples, with a creatinine concentration ranging from 80 to 239 µmol/L and traceable to isotope dilution mass spectrometry, were circulated to 91 laboratories in four European countries for creatinine measurement and estimated glomerular filtration rate calculation. Two out of the six samples were spiked with glucose to give high and low final concentrations of glucose. Results Results from 89 laboratories were analysed for bias, imprecision (%CV) for each creatinine assay and total error for estimated glomerular filtration rate. The participating laboratories used analytical instruments from four manufacturers; Abbott, Beckman, Roche and Siemens. All enzymatic methods in this study complied with the National Kidney Disease Education Programme working group recommended limits of bias of 5% above a creatinine concentration of 100 µmol/L. They also did not show any evidence of interference from glucose. In addition, they also showed compliance with the clinically recommended %CV of ≤4% across the analytical range. In contrast, the Jaffe methods showed variable performance with regard to the interference of glucose and unsatisfactory bias and precision. Conclusion Jaffe-based creatinine methods still exhibit considerable analytical variability in terms of bias, imprecision and lack of specificity, and this variability brings into question their clinical utility. We believe that clinical laboratories and manufacturers should work together to phase out the use of relatively non-specific Jaffe methods and replace them with more specific methods that are enzyme based.

[Physical, chemical and morphological urine examination guidelines for the Analytical Phase from the Intersociety Urinalysis Group]. / Esame fisico, chimico e morfologico delle urine proposta di linee guida per la fase analitica del Gruppo Intersocietario Analisi delle Urine (GIAU).

With these guidelines the Intersociety Urinalysis Group (GIAU) aims to stimulate the following aspects: Improvement and standardization of the analytical approach to physical, chemical and morphological urine examination (ECMU). Improvement of the chemical analysis of urine with particular regard to the reconsideration of the diagnostic significance of the parameters that are traditionally evaluated in dipstick analysis together with an increasing awareness of the limits of sensitivity and specificity of this analytical method. Increase the awareness of the importance of professional skills in the field of urinary morphology and the relationship with the clinicians. Implement a policy of evaluation of the analytical quality by using, in addition to traditional internal and external controls, a program for the evaluation of morphological competence. Stimulate the diagnostics industry to focus research efforts and development methodology and instrumental catering on the needs of clinical diagnosis. The hope is to revalue the enormous diagnostic potential of 'ECMU, implementing a urinalysis on personalized diagnostic needs for each patient. Emphasize the value added to ECMU by automated analyzers for the study of the morphology of the corpuscular fraction urine. The hope is to revalue the enormous potential diagnostic of 'ECMU, implementing a urinalysis on personalized diagnostic needs that each patient brings with it.

The Italian External Quality Assessment (EQA) program on urinary sediment: results of the period 2012-2015.

BACKGROUND: Manual microscopy still represents the gold standard for urinary sediment (US) examination. We report the results obtained in the period 2012-2015 by the EQA Italian program on US, which today involves about 260 laboratories. METHODS: The program includes four surveys per year. In two surveys, participants are asked to supply identification and clinical association of US particles. In two other surveys, they are asked to supply the diagnosis of clinical cases, presented with images, some key laboratory findings and a short clinical history. Sixty-six images of US particles (21 cells, 2 lipids, 21 casts, 10 crystals, 3 microorganisms, 15 contaminants) and seven clinical cases were presented. RESULTS: The correct identification rate for each category of particles, in decreasing order, was: micro-organisms (mean±SD: 92.4%±4.5%), lipids (92.0%±1.8%), casts (82.8%±8.8%), crystals (79.4%±29.8%), cells (77.3%±13.5%), and contaminants (70.9%±22.2%). For 13 particles, a correct clinical association was indicated by 91.5%±11.7% of participants, while it was 52.7% for particles associated with urinary tract infection. For clinical cases, due to a high rate of particles misidentification, only 44.3%±10.1% of participants achieved access to clinical diagnosis, which was then correctly indicated by 92.5%±5.3% of them. CONCLUSIONS: The results of the EQA program confirm that, while some US particles are well known in terms of identification, clinical association and clinical meaning, others particles still are not, and this represents an important reason to encourage EQA programs on US.

Evaluation of clinical cases in External Quality Assessment Scheme (EQAS) for the urinary sediment.

BACKGROUND: The few available External Quality Assessment (EQA) programs on urinary sediment rarely include an evaluation of clinical cases. The present paper provides a descriptive analysis of clinical cases included in the Italian EQA program on urinary sediment. METHODS: Ten cases were presented over a 5-year period (2007-2011). Each clinical case included a brief clinical history, some key laboratory data and four key urinary sediment particles obtained by phase contrast microscopy. The clinical diagnoses indicated by participants, chosen among four or five proposed, were evaluated only for those who had been able to correctly identify all four urinary sediment particles. The results of each survey were then evaluated, scored and commented on. RESULTS: The numbers of participants for the 10 surveys ranged from 268 to 325. Throughout surveys, only 63.9%±17.0% (range 39.6%-88.7%) of participants achieved access to clinical diagnosis. Of these, 90.2%±8.5% (range 73.7%-98.1%) were able to indicate the correct diagnosis. CONCLUSIONS: Our findings demonstrate that once the correct identification of urinary sediment particles is obtained, most participants are able to associate urinary findings with the respective clinical conditions, thus establishing the correct diagnosis.

An Italian external quality assessment (EQA) program on urinary sediment.

BACKGROUND: EQA programs on urinary sediment are rare. We describe an EQA Italian program which started in 2001 and involves today more than 300 laboratories. METHODS: The program, which started with a questionnaire about the methodological aspects on urinary sediment, includes today four surveys per year. These ask the participants the identification and clinical associations of urinary sediment particles shown by colour images (surveys 1 and 3) and the diagnosis of clinical cases presented by both images and a short clinical history (surveys 2 and 4). The results of each survey are then scored and commented. RESULTS: Questionnaire (participants = 287): most methodological aspects were not dealt with properly. IDENTIFICATION: cells, lipids, casts and some contaminants were poorly known. However, when 27 particles were presented for the second time and 16 particles for the third time, the correct identification rate for most of them increased significantly. Clinical associations (No presented = 16): a correct answer was indicated by > or = 84% of participants for all particles but one. Clinical cases (No presented=4): lowest correct identification for urine contamination from genital secretion (77.3%), highest for ureteric stone (94.4%). CONCLUSIONS: Our program shows that EQA programs are both useful and needed.

Risk management in laboratory medicine: quality assurance programs and professional competence.

To guarantee excellent performance and service, the process of identifying and treating error risks must be integrated into the total testing process. Quality Assurance Programs (QAPs) represent an important tool that allows us to identify errors and pinpoint any need for further systematic investigations, and to rectify procedures to improve the inputs and processes by which the service is delivered. The models used by the laboratory to assure quality and manage the risk of errors have been modified in line with an approach in which the identification of quality goals and the redefinition of professionals duties and responsibilities are indispensable. Error risk is currently high in some areas of laboratory activity, and QAP is needed now more than ever. The present paper provides some descriptive examples of an approach that can be followed to manage an External Quality Assessment Scheme (EQAS) and quality indicators (QIs), the main tools used by laboratories to assure the quality of their service, for the prevention of error risk. In particular, we describe the correct approach to choose EQAS, to use information from the EQAS report, to design a QI model, and to analyze any QI data. The examples highlight that any well-designed quality system can be ineffective if it is not managed by highly competent professionals with a deep sense of responsibility.

External Quality Assessment: an effective tool for Clinical Governance in laboratory medicine.

The implementation of Clinical Governance will require a redefinition of duties and accountability as a prerequisite to develop and achieve an overall improvement in clinical care through a culture of assessment and monitoring of quality. External Quality Assessment Schemes (EQAS) are the main tool enabling laboratories to measure the quality of their results; they must carefully assess and monitor all elements contributing to the formulation of laboratory information (results, reference ranges/decisional levels, interpretative comments and diagnostic algorithms). There are different ways to design and manage a Scheme and EQAS coordinators are mainly responsible for its effectiveness. The present paper reports, as an example, some experiences of the Centre of Biomedical Research (CRB), which manages EQAS according to high quality specifications and laboratories' needs, that can reflect the Clinical Governance philosophy. Our findings show that EQAS are able to control all the above aspects and, if organisers are committed to fulfilling the responsibility and accountability principles, they will be of great value in quality assessment and in developing an External Quality Assurance Program (EQAP). This is an inter-laboratory comparison designed and conducted to assure the following: evaluation of participants' performance (by evaluating not only analytical performance, but also test interpretation, and advice for clinicians on laboratory requests and diagnosis); evaluation of method performance; and continuous education, training and help. The main aim of the activities of an EQAP in Laboratory Medicine is to sustain improvements in the quality of services provided by participating laboratories for the benefit of patients.

Quality specifications in EQA schemes: from theory to practice.

BACKGROUND: External quality assessment (EQA) is a tool for quality management in clinical laboratories and its main objectives are assessment of participants and methods performance, training and advice. This paper describes the quality specifications used in EQA schemes of the Centre of Biomedical Research (CRB), in order to design schemes that can assess laboratory reliability performances, meet the changing needs and quality recommendations. METHODS: Quality specifications for control materials, statistical procedures and goals to assess laboratory performance have been applied and introduced in EQA schemes managed by CRB. RESULTS: The application of well-defined quality specifications has demonstrated effective. In particular, we report results on alkaline phosphatase and cholesterol obtained using commercial control materials and human serum controls, in two different EQA surveys; the inter-laboratory variability (CVinter%) for troponin I analysed with a diagnostic system and assigned values of CK-MB mass obtained using four different diagnostic systems; the percentage of acceptable performances obtained by means of the application of goals based on clinical criteria, biological variation, state-of-the-art and used for EQA schemes, and referring to some analytes with significant clinical values such as cholesterol, glucose, glycated hemoglobin and sodium. CONCLUSIONS: The design of reliable EQA schemes based on evidence-based quality specifications is a pre-requisite for supporting the quality improvement of clinical laboratories.

Interpretative comments and reference ranges in EQA programs as a tool for improving laboratory appropriateness and effectiveness.

INTRODUCTION: Laboratory information is generated when a meaning is given to certain data. This is usually achieved by comparing a laboratory test result with the reference range/decisional limit (RL), and by providing consultation for the interpretation of data, advice, and follow-up testing. AIM: In this paper, we investigate factors affecting the conversion of data into useful information with regard to biochemical markers of myocardial damage (CK-MB mass, myoglobin, and troponins), in view of their importance in detecting myocardial necrosis. Our aim was to report results obtained in order to verify the consensus between laboratories with reference to interpretative comments and the reference ranges/decisional limits added to clinical reports. METHODS: A questionnaire and simulated medical reports on three different patients were distributed to participants (94 laboratories) in the 2001 cycle of the External Quality Assessment (EQA). Moreover, we analysed 113 medical reports sent by laboratories during the most recent EQA cycle 2002, and checked the number of different RLs used, both independent and within the diagnostic system used. We also compared each laboratory result of a control sample, obtained in the 2002 cycle, with declared RL in order to verify the clinical significance of results ("normal" or "pathological") for troponin I and CK-MB. RESULTS: Our findings show that few laboratories regularly add interpretative comments to medical reports. On the contrary, they cooperate with clinicians who require consultation, advice, and information for the appropriate use of biochemical markers. There is a general consensus among participants regarding probable syndromes suggested by the interpretation of the same result and most laboratories also agree on further investigations to be carried out for several diseases. Concerning RL, the data demonstrate that numerous different RLs are used to report the results of the biochemical markers evaluated, both when considered independent of the diagnostic system used and within the diagnostic system used. DISCUSSION AND CONCLUSIONS: The biochemist does not have the opportunity to verify the efficacy of the interpretation that he/she provided. An audit of this activity is therefore required to allow the laboratory to monitor its own performance and to assure good practice. The evaluation of interpretative comments, through specific surveys, should be a prime objective of EQA organisers. Well-designed EQA programs can, moreover, support laboratories in establishing appropriate RL and in verifying the clinical significance of their results with respect to that of other laboratories. Our survey on interpretative comments and the analysis of the RLs further demonstrate how laboratory medicine can contribute to the objective evaluation of the patients' health status.

Appropriateness of cholesterol and triglycerides reporting checked by External Quality Assessment programs.

BACKGROUND: The recommendations of the Second Joint Task Force of European and Other Societies on Coronary Prevention and the third Adult Treatment Panel report (ATPIII) released by the National Cholesterol Education Program are based on accumulating evidence concerning the contribution of lipoproteins and other risk factors in the development of coronary heart disease (CHD). The laboratories play an important role in the successful adoption of these guidelines. METHODS: In External Quality Assessment (EQA) programs managed by the Center of Biomedical Research, results and respective reference intervals (RI) are sent as laboratory's medical form. We assessed how well the 200 participants to EQA scheme 2002 for clinical biochemistry reported total cholesterol (TC) and triglycerides (TGs) results according to either European or National Cholesterol Education Program (NCEP) guidelines. RESULTS: Only 18% of laboratories reported total cholesterol concentrations correctly in terms of desirable, borderline-high, and high risk for the CHD development, 12% reported a single desirable value (180, 190, or 200 mg/dl), and 70% reported the RI (85 laboratories in the whole interval, 34 are the only upper reference limit and 15 are the desirable value in addition to RI). The upper reference limit was 200 mg/dl in 65% of cases, but 32% of laboratories presented higher limits, reaching values as high as 250-260 mg/dl. Only the 3.7% of laboratories reported triglyceride concentrations in terms of risk-oriented ranges for the CHD development, 6.8% the single desirable value, and 89.5% the RI. CONCLUSION: Our study demonstrates that the current practice of reporting results for cholesterol and triglycerides does not follow the guidelines, and appropriate changes are required to be made.