Evaluation of System Accuracy, Precision, Hematocrit Influence, and User Performance of Two Blood Glucose Monitoring Systems Based on ISO 15197:2013/EN ISO 15197:2015.

INTRODUCTION: Sufficiently high analytical quality of blood glucose monitoring systems (BGMS) is a prerequisite for efficient diabetes therapy. In this study we assessed system accuracy, measurement repeatability, intermediate measurement precision, user performance, and the influence of hematocrit on two CE-marked blood glucose monitoring systems. For one BGMS, measurement accuracy using venous samples was additionally investigated. METHODS: Study procedures were based on the International Organization of Standardization (ISO) 15197:2013/EN ISO 15197:2015 ("ISO 15197"). User performance included data from 100 subjects who used one test strip lot, whereas for all other analyses three different reagent system lots were used. For system accuracy assessment, 100 capillary samples were measured in duplicate with each of three reagent system lots per system, resulting in 600 results per system. RESULTS: CareSens S Fit and CareSens H Beat both fulfilled the ISO 15197 accuracy criteria with 97.5-100% of each test strip lot's results falling within ± 15 mg/dL or ± 15% of the results of the comparison method and 100% of results in consensus error grid (CEG) zone A for all three lots. User performance evaluation revealed sufficient accuracy in the hands of lay users although some handling errors were documented by study staff. Assessment of measurement repeatability and intermediate measurement precision is given by standard deviation (SD) (glucose levels < 100 mg/dL) and by coefficient of variation (CV) (glucose concentrations ≥ 100 mg/dL). SD was ≤ 4.1 mg/dL and CV ≤ 4.2% for measurement repeatability and SD was ≤ 2.2 mg/dL and CV ≤ 2.6% for intermediate measurement precision. In case of hematocrit influence, both BGMS complied with all three tested lots with the defined criteria. CONCLUSION: Both BGMS analyzed in this study fulfilled the required accuracy criteria of ISO 15197. They showed high precision, good performance in the hands of lay users, and the influence of hematocrit was acceptable in the labeled range.

Drug Interference in Self-Monitoring of Blood Glucose and the Impact on Patient Safety: We Can Only Guard Against What We Are Looking for.

Self-monitoring of blood glucose is a key aspect of diabetes management. Depending on the technology used, however, various substances can jeopardize the reliability of the measurements and precipitate complications with potentially life-threatening consequences when blood glucose was deemed well-controlled. As such, it is important for all involved to be aware of those factors. Officially suggested procedures for testing and alternatives have each their own advantages and limitations, and interferences may be found beyond the substances to be tested provided by the various pertinent institutions. This article reviews these pros and cons and illustrates how interference testing beyond established standards contributes to patient safety. Once identified, interfering substances are included in product labeling and health care professionals and users need to be trained to be aware of these risks.

Mean Absolute Relative Difference of Blood Glucose Monitoring Systems and Relationship to ISO 15197.

BACKGROUND: The analytical quality of a blood glucose monitoring system (BGMS) is often assessed according to the requirements described in the international standard ISO 15197. However, the mean absolute relative difference (MARD) is sometimes used as well. This analysis aims at providing empirical data from BGMS evaluation studies conducted according to ISO 15197 and at providing an estimation of how MARD and percentage of measurement results within ISO accuracy limits are related. METHODS: Results of 77 system accuracy evaluations conducted according to ISO 15197 were used to calculate MARD between BGMS and a laboratory comparison method's results (glucose oxidase or hexokinase method). Additionally, bias and 95%-limits of agreement (LoA) using the Bland and Altman method were calculated. RESULTS: MARD results ranged from 2.3% to 20.5%. The lowest MARD of a test strip lot that showed <95% of results within ISO limits was 6.1%. The distribution of MARD results shows that only 3.6% of test strip lots with a MARD equal to or below 7% showed <95% of results within ISO limits (2.2% of all test strip lots). Bias of test strip lots that showed ≥95% of results within the limits ranged from -10.3% to +7.4%. The half-width of the 95%-LoA of test strip lots that showed ≥95% of results within the limits ranged from 4.8% to 24.0%. CONCLUSION: There is a threshold MARD that may allow an estimate whether ISO 15197 requirements are fulfilled, but this statement cannot be made with certainty.

Accuracy Beyond ISO: Introducing a New Method for Distinguishing Differences Between Blood Glucose Monitoring Systems Meeting ISO 15197:2013 Accuracy Requirements.

BACKGROUND: Diabetes treatment is intended to maintain near-normal glycemic levels. Self-monitoring of blood glucose (SMBG) allows patients to track their BG levels compared with glycemic targets and is associated with improved health outcomes. Because of the importance of SMBG, it is essential that results are accurate to prevent errors in nutritional intake and drug dosing. This study presents a new methodology to evaluate the accuracy of BG monitoring systems (BGMSs). METHODS: Sensitivity analyses were performed using real and simulated BGMS data to compute probabilities that, for any BG value, the BGMS result would be within prescribed error bounds and confidence limits compared with laboratory reference values. Multiple BG value ranges were used. RESULTS: Probability curves were created using data from 3 simulated BGMSs and anonymized data from 3 real-world BGMSs. Accuracy probability curves from capillary fingertip blood samples (actual clinical data) showed that all 3 real-world BGMSs met EN ISO 15197:2015 accuracy criteria, since 99.63%, 99.63%, and 99.81% of results from the 3 BGMSs were within ±15 mg/dL or ±15% of reference for BG <100 mg/dL and ≥100 mg/dL, respectively. However, there was identifiable variability between BGMSs if BG was <70 mg/dL; one BGMS showed further reductions in accuracy if BG was <50 mg/dL. CONCLUSIONS: Probability curves highlight the importance of BGMS accuracy to help achieve optimal glycemic control while avoiding hypoglycemia or hyperglycemia. This may be especially significant in very low BG ranges where small errors in BGMS measurements can have substantial impacts on patient-related outcomes, including hypoglycemia risk.

Evaluation of Hematocrit Influence on Self-Monitoring of Blood Glucose Based on ISO 15197:2013: Comparison of a Novel System With Five Systems With Different Hematocrit Ranges.

INTRODUCTION: ISO 15197:2013 recommends testing procedures and acceptance criteria for the evaluation of influence quantities such as hematocrit on measurement results with systems for self-monitoring of blood glucose (SMBG). In this study, hematocrit influence was evaluated for a novel SMBG system (system A) and five other systems with different hematocrit ranges based on ISO 15197:2013. METHODS: Test procedures were performed with one test strip lot for each system. Each system was tested within the hematocrit range indicated in the manufacturer's labeling (system A: 10-65%, B: 15-65%, C: 20-60%, D: 35-60%, E: 30-60%, F: 30-55%). According to ISO 15197:2013, clause 6.4.2, venous blood samples were used for the evaluation of hematocrit influence. The evaluation was performed for three glucose concentration categories (30-50 mg/dL, 96-144 mg/dL, and 280-420 mg/dL). For each glucose concentration category, at least five different hematocrit levels were investigated. RESULTS: The novel system A and systems B, E, and F complied with the tested lot with the defined criteria and showed ≤10 mg/dL and ≤10% difference between the test sample and the respective control sample with a hematocrit value of 42% ± 2% for BG concentrations <100 mg/dL and ≥100 mg/dL, respectively. Two systems showed >10% difference at glucose concentrations ≥100 mg/dL. CONCLUSIONS: Remarkable hematocrit influence within the labeled hematocrit range was obtained in two systems with the tested reagent system lot. Adequate SMBG systems should be carefully chosen by patients and their health care professionals, particularly for patients with increased and decreased hematocrit values.

System Accuracy and User Performance Evaluation of an Improved System for Self-Monitoring of Blood Glucose.

An improved test cassette for the integrated Accu-Chek® Mobile system (Roche Diabetes Care GmbH, Mannheim, Germany) has been developed. System accuracy of this improved system was evaluated based on ISO 15197:2013, clause 6.3, for three reagent system lots. According to this standard, at least 95% of the system's measurement results shall be within ±15 mg/dL and ±15% of the results of the comparison method at glucose concentrations <100 mg/dL and ≥100 mg/dL (accuracy criterion A), respectively, and at least 99% of results shall be within consensus error grid zones A and B (accuracy criterion B). In addition, accuracy was evaluated in the hands of users based on ISO 15197:2013, clause 8, with one reagent system lot.

Evaluation of the Self-Testing Blood Glucose Monitoring System GlucoDr.S According to ISO 15197:2013 Guidelines

BACKGROUND: The performance of the self-monitoring of blood glucose in patients with diabetes should be properly evaluated to ensure strict glycemic control. This study evaluated the self-testing Blood Glucose Monitoring System GlucoDr.S™ (All Medicus Co., Ltd., Korea). METHODS: This study recruited 120 patients. Use of the glucometer was evaluated according to ISO 15197:2013 guidelines. The YSI 2300 STAT PLUS Glucose Analyzer (YSI Life Sciences, USA) was used as the reference device. RESULTS: The standard deviation and coefficients of variation ranges for measurement repeatability and intermediate measurement precision conducted with 10 meters and 3 reagent lots on the same day were 2.7–3.2 mg/dL (0.99. The influence effect of hematocrit and the 24 interference agents was not significant, except for xylose. A system accuracy test was conducted with 100 subjects taking duplicate measurements from each of the 3 reagent lots. When glucose levels were 95% of the samples were within ±15 mg/dL and within ±15% of the average measured values of the reference measurement, respectively. In Consensus Error grid analysis, all results were distributed in zone A and B. The results of the user performance evaluation using 115 lay persons were also included in the acceptance range. CONCLUSION: The GlucoDr.S™ showed acceptable performance according to the ISO 15197:2013 guidelines and could be a clinically useful self-testing glucometer.

A New, Wireless-enabled Blood Glucose Monitoring System That Links to a Smart Mobile Device: Accuracy and User Performance Evaluation.

BACKGROUND: These studies investigated the accuracy of the new Contour®Next ONE blood glucose monitoring system (BGMS) that is designed to sync with the Contour™ Diabetes app on a smartphone or tablet. METHODS: A laboratory study tested fingertip capillary blood samples from 100 subjects in duplicate using 3 test strip lots, based on ISO 15197:2013 Section 6.3 analytical accuracy standards. A clinical study assessed accuracy per ISO 15197:2013 Section 8 criteria. Subjects with (n = 333) or without (n = 43) diabetes and who had not used the BGMS previously were enrolled. Each subject performed a self-test using the BGMS, which was repeated by a site staff member. Alternate site tests and venipunctures were also performed for analysis. A questionnaire was provided to assess user feedback on ease of use. RESULTS: In the laboratory study, 100% (600/600) of combined results for all 3 test strip lots met ISO 15197:2013 Section 6.3 accuracy criteria. In the clinical study, among subjects with diabetes, 99.4% (327/329) of subject self-test results, 99.7% (331/332) of results obtained by study staff, 97.2% (309/318) of subject palm results, and 100% (330/330) of venous results met ISO 15197:2013 Section 8 accuracy criteria. Moreover, 97.6% (321/329) of subject self-test results were within ±10 mg/dl (±0.6 mmol/L) or ±10% of the YSI reference result. Questionnaire results indicated that most subjects considered the system easy to use. CONCLUSIONS: The BGMS exceeded ISO 15197:2013 accuracy criteria in the laboratory and in a clinical setting.

Accuracy and User Performance Evaluation of a New, Wireless-enabled Blood Glucose Monitoring System That Links to a Smart Mobile Device.

BACKGROUND: The new Contour®Plus ONE blood glucose monitoring system (BGMS) features an easy-to-use, wireless-enabled blood glucose meter that links to a smart mobile device via Bluetooth® connectivity and can sync with the Contour™ Diabetes app on a smartphone or tablet. METHODS: The accuracy of the new BGMS was assessed in 2 studies according to ISO 15197:2013 criteria. In Study 1 (laboratory study), fingertip capillary blood samples from 100 subjects were tested in duplicate using 3 test strip lots. In Study 2 (clinical study), 134 subjects with type 1 or type 2 diabetes enrolled at 2 clinical sites. BGMS results and YSI analyzer (YSI) reference results were compared for fingertip blood obtained by untrained subjects' self-testing and for study staff-obtained fingertip, subject palm, and venous results. RESULTS: In Study 1, 99.0% (594/600) of combined results for all 3 test strip lots fulfilled ISO 15197:2013 Section 6.3 accuracy criteria. In Study 2, 99.2% (133/134) of subject-obtained capillary fingertip results, 99.2% (133/134) of study staff-obtained fingertip results, 99.2% (125/126) of subject-obtained palm results, and 100% (132/132) of study staff-obtained venous results met ISO 15197:2013 Section 8 accuracy criteria. Moreover, 95.5% (128/134) of subject-obtained fingertip self-test results were within ±10 mg/dl (±0.6 mmol/L) or ±10% of the YSI reference result. Questionnaire results showed that most subjects found the BGMS easy to use. CONCLUSIONS: The BGMS exceeded ISO 15197:2013 accuracy criteria both in the laboratory and in a clinical setting when used by untrained subjects with diabetes.

Accuracy Evaluation of 19 Blood Glucose Monitoring Systems Manufactured in the Asia-Pacific Region: A Multicenter Study.

BACKGROUND: System accuracy of current blood glucose monitors (BGMs) in the market has already been evaluated extensively, yet mostly focused on European and North American manufacturers. Data on BGMs manufactured in the Asia-Pacific region remain to be established. In this study, we sought to assess the accuracy performance of 19 BGMs manufactured in the Asia-pacific region. METHODS: A total of 19 BGMs were obtained from local pharmacies in China. The study was conducted at three hospitals located in the Asia-Pacific region. Measurement results of each system were compared with results of the reference instrument (YSI 2300 PLUS Glucose Analyzer), and accuracy evaluation was performed in accordance to the ISO 15197:2003 and updated 2015 guidelines. Radar plots, which is a new method, are described herein to visualize the analytical performance of the 19 BGMs evaluated. Consensus error grid is a tool for evaluating the clinical significance of the results. RESULTS: The 19 BGMs resulted in a satisfaction rate between 83.5% and 100.0% within ISO 15197:2003 error limits, and between 71.3% and 100.0% within EN ISO 15197:2015 (ISO 15197:2013) error limits. CONCLUSIONS: Of the 19 BGMs evaluated, 12 met the minimal accuracy requirement of the ISO 15197:2003 standard, whereas only 4 met the tighter EN ISO 15197:2015 (ISO 15197:2013) requirements. Accuracy evaluation of BGMs should be performed regularly to maximize patient safety.

Introduction of a Novel Smartphone-Coupled Blood Glucose Monitoring System.

The novel system for self-monitoring of blood glucose (SMBG) PixoTest couples SMBG to a smartphone and does not require a separate glucose meter. The integrated system includes all components necessary for a glucose measurement, and owing to a colorimetric measurement principle, a smartphone camera can capture color changes and a software app calculates the corresponding glucose value. In the presented study, the system was evaluated in terms of system accuracy as described in ISO 15197:2013. It was shown to fulfill system accuracy requirements with 97-99% of results from three different reagent system lots within the accuracy limits and 100% of results within zone A of the consensus error grid.

Why the Diabetes Technology Society Surveillance Protocol for Glucose Meters Needs to Be Revised.

The Diabetes Technology Society surveillance protocol provides a seal of approval for a glucose meter if a sufficient number of a candidate glucose meter's results meet ISO 15197:2013 limits. The protocol provides clear details about how to conduct this study and analyze the data but has two flaws. There is no specification about the size of glucose meter errors that are outside of ISO limits. A meter that has a result in the E zone of a glucose meter error grid could receive the DTS seal of approval. In addition, the protocol uses the ISO standard, which could be considered a "state of the art" standard instead of an error grid, which is a clinical standard. Remedies for these problems are to replace the ISO standard with an error grid and to include requirements for errors found in C or higher zones of an error grid.