Investigation of the Effect of 70 Potential Interferents on Measurement Results of Two Blood Glucose Monitoring Systems.

BACKGROUND: Reliable blood glucose (BG) measurements are important for people with diabetes to manage their therapy as well as in point-of-care testing (POCT) performed by health care professionals to monitor BG of patients or even to diagnose diabetes. Among other factors, endogenous and exogenous substances present in blood samples can impact the measurement results. To ensure and prove that blood glucose monitoring systems (BGMSs) are robust in terms of potential interferents, manufacturers have to perform extensive evaluations. METHOD: An interference screening test was performed for three reagent system lots of a POCT system and of a BGMS for self-monitoring of BG. A paired-difference approach based on ISO 15197:2013 and CLSI guideline EP07 was used with venous whole blood samples at two different glucose concentrations. Seventy potential interferents expected to be common in people with diabetes were evaluated. RESULTS: The interference effects were determined as normalized biases between test samples and corresponding control samples. For 69 of the 70 investigated potential interferents, both systems met the predefined acceptance criteria, with the normalized biases falling within ±10 mg/dL or ±10% at glucose concentrations ≤100 mg/dL or >100 mg/dL, respectively, for each of the three evaluated reagent system lots. CONCLUSIONS: The BGMS investigated in this study were found to be robust with respect to the 70 evaluated potential interferents. Interference effects were observed only for N-Acetyl-L-cysteine. Extensive evaluations of potential interfering factors can make an important contribution to ensure reliability of BGMS.

Evaluation of System Accuracy, Precision, Hematocrit Influence, and User Performance of Two Blood Glucose Monitoring Systems Based on ISO 15197:2013/EN ISO 15197:2015.

INTRODUCTION: Sufficiently high analytical quality of blood glucose monitoring systems (BGMS) is a prerequisite for efficient diabetes therapy. In this study we assessed system accuracy, measurement repeatability, intermediate measurement precision, user performance, and the influence of hematocrit on two CE-marked blood glucose monitoring systems. For one BGMS, measurement accuracy using venous samples was additionally investigated. METHODS: Study procedures were based on the International Organization of Standardization (ISO) 15197:2013/EN ISO 15197:2015 ("ISO 15197"). User performance included data from 100 subjects who used one test strip lot, whereas for all other analyses three different reagent system lots were used. For system accuracy assessment, 100 capillary samples were measured in duplicate with each of three reagent system lots per system, resulting in 600 results per system. RESULTS: CareSens S Fit and CareSens H Beat both fulfilled the ISO 15197 accuracy criteria with 97.5-100% of each test strip lot's results falling within ± 15 mg/dL or ± 15% of the results of the comparison method and 100% of results in consensus error grid (CEG) zone A for all three lots. User performance evaluation revealed sufficient accuracy in the hands of lay users although some handling errors were documented by study staff. Assessment of measurement repeatability and intermediate measurement precision is given by standard deviation (SD) (glucose levels < 100 mg/dL) and by coefficient of variation (CV) (glucose concentrations ≥ 100 mg/dL). SD was ≤ 4.1 mg/dL and CV ≤ 4.2% for measurement repeatability and SD was ≤ 2.2 mg/dL and CV ≤ 2.6% for intermediate measurement precision. In case of hematocrit influence, both BGMS complied with all three tested lots with the defined criteria. CONCLUSION: Both BGMS analyzed in this study fulfilled the required accuracy criteria of ISO 15197. They showed high precision, good performance in the hands of lay users, and the influence of hematocrit was acceptable in the labeled range.

Performance Assessment of Three Continuous Glucose Monitoring Systems in Adults With Type 1 Diabetes.

BACKGROUND: FIND, the global alliance for diagnostics, identified the nonmarket-approved continuous glucose monitoring (CGM) system, FiberSense system (FBS), as a potential device for use in low- and middle-income countries. Together with two market-approved, factory-calibrated CGM systems, namely, the FreeStyle Libre 2 (FL2) and the GlucoRx AiDEX (ADX), the FBS was subjected to a clinical performance evaluation. METHODS: Thirty adult participants with type 1 diabetes were enrolled. The study was mainly conducted at home, with three in-clinic sessions conducted over the study period of 28 days. Comparator measurements were collected from capillary samples, using a high-quality blood glucose monitoring system. RESULTS: Data from 31, 70, and 78 sensors of FBS, FL2, and ADX, respectively, were included in the performance analysis. The mean absolute relative differences between CGM and comparator data for FBS, FL2, and ADX were 14.7%, 9.2%, and 21.9%, and relative biases were -2.1%, -2.5%, and -18.5%, respectively. Analysis of individual sensor accuracy revealed low, moderate, and high sensor-to-sensor variability for FBS, FL2, and ADX, respectively. Sensor survival probabilities until the end of sensor life were 47.2% for FBS (28 days), 71.3% for FL2 (14 days), and 48.4% for ADX (14 days). CONCLUSIONS: The results of FBS were encouraging enough to conduct further performance and usability evaluations in a low- and middle-income country. The results of FL2 mainly agreed with existing studies, whereas ADX showed substantial deviations from previously reported results.

Accuracy Evaluation of a Novel Reusable Patch Pump Prototype.

A prototype of an insulin patch pump that operates with a double pump mechanism was tested. Accuracy of bolus delivery of 0.2 U and 1.0 U, and a basal rate of 1.0 U/h were evaluated with a microgravimetric method. In addition, occlusion detection time at basal rates of 0.1 U/h and 1.0 U/h was assessed. Mean deviation from target was lower than 2% for both bolus sizes. Regarding basal rate accuracy, mean deviation over 72 hours was lower than 1%. Occlusion detection occurred in less than 30 minutes with both basal rates. Our study results suggest that the tested pump prototype provides delivery accuracy and occlusion detection that is similar or even better compared to all commercially available pumps tested with a similar experimental approach.

User Performance Evaluation and System Accuracy Assessment of Four Blood Glucose Monitoring Systems With Color Coding of Measurement Results.

BACKGROUND: Blood glucose monitoring systems (BGMSs) are a cornerstone in diabetes management. They have to provide sufficiently accurate results in the hands of lay users, particularly in insulin-treated patients. The aim of this study was user performance evaluation and system accuracy assessment of four BGMSs with color coding of results. METHODS: Study procedures were based on ISO 15197:2013. User performance evaluation included data from 100 participants, each of whom used every system with one reagent lot. Study personnel observed user techniques. For the system accuracy assessment, 100 capillary samples were obtained for measurement in duplicate with each of three reagent system lots per system, resulting in 600 results per system. RESULTS: All assessed BGMSs exhibited a sufficient level of accuracy, with small differences between them. In the user performance evaluation, study personnel observed the smallest total number of user errors with Contour Next (Ascensia), followed by Accu-Chek Instant (Roche), Medisafe Fit Smile (Terumo), and OneTouch Ultra Plus Reflect (LifeScan). Approximately 90% of participants stated that a consistent color scheme, eg, for low blood glucose (BG) values, should be used across all BGMSs. There was no clear preference among the four tested BGMSs regarding the specific way of displaying color coding. CONCLUSIONS: The four BGMSs assessed in this study showed only small differences in an overall sufficient level of accuracy. User handling errors, as observed by study personnel, differed between the systems.

Mean Absolute Relative Difference of Blood Glucose Monitoring Systems and Relationship to ISO 15197.

BACKGROUND: The analytical quality of a blood glucose monitoring system (BGMS) is often assessed according to the requirements described in the international standard ISO 15197. However, the mean absolute relative difference (MARD) is sometimes used as well. This analysis aims at providing empirical data from BGMS evaluation studies conducted according to ISO 15197 and at providing an estimation of how MARD and percentage of measurement results within ISO accuracy limits are related. METHODS: Results of 77 system accuracy evaluations conducted according to ISO 15197 were used to calculate MARD between BGMS and a laboratory comparison method's results (glucose oxidase or hexokinase method). Additionally, bias and 95%-limits of agreement (LoA) using the Bland and Altman method were calculated. RESULTS: MARD results ranged from 2.3% to 20.5%. The lowest MARD of a test strip lot that showed <95% of results within ISO limits was 6.1%. The distribution of MARD results shows that only 3.6% of test strip lots with a MARD equal to or below 7% showed <95% of results within ISO limits (2.2% of all test strip lots). Bias of test strip lots that showed ≥95% of results within the limits ranged from -10.3% to +7.4%. The half-width of the 95%-LoA of test strip lots that showed ≥95% of results within the limits ranged from 4.8% to 24.0%. CONCLUSION: There is a threshold MARD that may allow an estimate whether ISO 15197 requirements are fulfilled, but this statement cannot be made with certainty.

Impact of Two Different Reference Measurement Procedures on Apparent System Accuracy of 18 CE-Marked Current-Generation Blood Glucose Monitoring Systems.

BACKGROUND: Measurement accuracy has been assessed for many different blood glucose monitoring systems (BGMS) over the years by different study groups. However, the choice of the comparison measurement procedure may impact the apparent level of accuracy found in such studies. MATERIALS AND METHODS: Measurement accuracy of 18 different BGMS was assessed in a setting based on ISO 15197 using two different comparison methods in parallel: a glucose oxidase (GOD)-based and a hexokinase (HK)-based method. Accuracy limits of ISO 15197 were applied, and additional analyses were performed, including bias, linear regression, and mean absolute relative difference (MARD) to assess the impact of possible differences between comparison methods on the apparent level of accuracy. RESULTS: While ≈80% of BGMS met the accuracy criteria of ISO 15197 when compared with the respective manufacturers' reference measurement procedure, only two-thirds did so against both comparison methods. The mean relative bias ranged from -6.6% to +5.7% for the analysis against the GOD-based method and from -11.1% to +1.3% for the analysis against the HK-based method, whereas MARD results ranged from 3.7% to 9.8% and from 2.3% to 10.5%, respectively. Results of regression analysis showed slopes between 0.85 and 1.08 (GOD-based method) and between 0.81 and 1.01 (HK-based method). CONCLUSIONS: The results of this study indicate that there are systematic differences between the reference measurement procedures used for BGMS calibration as well as for system accuracy assessment. Because of the potential impact on therapy of patients with diabetes resulting from these differences, further steps toward harmonization of the measurement procedures' results are important.

Description of a Novel Patch Pump for Insulin Delivery and Comparative Accuracy Evaluation.

A new insulin patch pump for continuous subcutaneous insulin infusion was developed. The pump is composed of reusable and disposable parts and operates with a stepping motor. This pump was compared to a patch pump and a durable pump regarding basal rate and bolus accuracy. Using a microgravimetric method, boluses of 0.2 U, 1 U and 7 U, and a basal rate of 1 U/h were tested. For all pumps, bolus accuracy was higher when larger volumes were delivered. While median deviations were similar for all pumps, there were differences in the precision of individual boluses and when regarding basal rate delivery divided into 1-h windows.

Evaluation of the Accuracy of Current Tubeless Pumps for Continuous Subcutaneous Insulin Infusion.

Background: Recently two new tubeless pumps for insulin therapy were introduced. They were tested for accuracy and occlusion detection and compared with the established patch pump Omnipod® (OP). Methods: Using a modified setup for tubeless pumps based on IEC 60601-2-24, the basal rate and bolus delivery of the Accu-Chek® Solo micropump system (ACS) and the A6 TouchCare® System (A6) were measured with a microgravimetric method. Bolus sizes of 0.2, 1, and 10 U, and basal rates of 0.1 and 1 U/h were evaluated in nine repetitions. For each parameter, mean deviation and number of individual boluses or 1-h basal rate windows within ±15% from target were calculated. In addition, occlusion detection time at basal rates of 0.1 and 1 U/h was determined. Results: Mean deviation of boluses of different volumes in the pumps ranged from -3.3% to +4.0% and 40%-100% of individual boluses were within ±15% of the target. During basal rate delivery, 48% to 98% of 1-h windows were within ±15% of the target with a mean deviation between -5.3% and +6.5%. In general, considerable differences between pump models were observed and deviations decreased with increasing doses. In most parameters, ACS was more accurate, and A6 less accurate, than OP. Mean occlusion detection time ranged from ∼3 to 7.5 h at 1 U/h and was >24 h or absent at 0.1 U/h. Conclusions: In this evaluation, significant differences between the tested tubeless pump models were observed that became most evident when regarding delivery errors over short time and small volumes.

Accuracy assessment of bolus and basal rate delivery of different insulin pump systems used in insulin pump therapy of children and adolescents.

BACKGROUND: Continuous subcutaneous insulin infusion (CSII) is commonly used in patients with diabetes. Accurate and reliable delivery by insulin pumps is essential for a safe and effective therapy, particularly when using small doses. In this study, accuracy of bolus and basal rate delivery of various available insulin pumps was evaluated. METHODS: In total, 13 insulin pump systems were tested: eight durable pumps with different infusion sets and one patch pump. Based on IEC 60601-2-24, insulin delivery was measured by recording weight gain of a beaker into which insulin was infused by the pumps. Bolus accuracy was determined by individually weighing 25 consecutive 0.1 or 1.0 U boluses and basal rate accuracy was determined during basal rate delivery of 0.1 or 1.0 U/h for 72 hours. For analyses, basal rate delivery was divided into 1-hour windows and deviation from target was calculated. RESULTS: Regarding different systems, average 0.1 U bolus delivery was -2% to +9% of the intended volume with 53% to 96% of boluses within ±15% of target. During 0.1 U/h basal rate delivery, most pumps showed an initial over-delivery for the first few hours. Three systems reached a total basal rate error <5%; others showed up to +24%. In general, delivery was more accurate when using larger doses. CONCLUSIONS: Considerable differences in insulin delivery accuracy were observed between the tested pumps. In general, when using very low doses, accuracy of insulin delivery is limited in most insulin pumps. This should be considered for CSII therapy in children.

System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015.

OBJECTIVE: Accuracy of 18 current-generation blood glucose monitoring systems (BGMS) available in Europe was evaluated applying criteria adapted from EN ISO 15197:2015 with one reagent system lot. BGMS were selected based on market research data. RESEARCH DESIGN AND METHODS: The BGMS ABRA, Accu-Chek Guide, AURUM, CareSens Dual, CERA-CHEK 1CODE, ContourNext One, eBsensor, FreeStyle Freedom Lite, GL50 evo, GlucoCheck GOLD, GlucoMen areo 2K, GluNEO, MyStar DoseCoach, OneTouch Verio Flex, Pic GlucoTest, Rightest GM700S, TRUEyou, and WaveSense JAZZ Wireless were tested using capillary blood from 100 different subjects and assessing the percentage of results within ±15 mg/dL (0.83 mmol/L) or 15% of comparison method results for BG concentrations below or above 100 mg/dL (5.55 mmol/L), respectively. In addition, the minimal deviation from comparison method results within which ≥95% of results of the respective BGMS were found was calculated. RESULTS: In total, 14 BGMS had ≥95% of results within ±15 mg/dL (0.83 mmol/L) or ±15% and 3 BGMS had ≥95% of results within ±10 mg/dL (0.55 mmol/L) or ±10% of the results obtained with the comparison method. The smallest deviation from comparison method results within which ≥95% of results were found was ±7.7 mg/dL (0.43 mmol/L) or ±7.7%; the highest deviation was ±19.7 mg/dL (1.09 mmol/L) or ±19.7%. CONCLUSIONS: This accuracy evaluation shows that not all CE-labeled BGMS fulfill accuracy requirements of ISO 15197 reliably and that there is considerable variation even among BGMS fulfilling these criteria. This safety-related information should be taken into account by patients and healthcare professionals when making therapy decisions. TRIAL REGISTRATION NUMBER: NCT03737188.

Evaluation of Analytical Performance of Three Blood Glucose Monitoring Systems: System Accuracy, Measurement Repeatability, and Intermediate Measurement Precision.

INTRODUCTION: Blood glucose monitoring systems (BGMS) should provide sufficient analytical quality to allow adequate therapy for diabetes patients. Besides system accuracy, measurement precision is an important aspect of a BGMS' analytical quality. METHODS: Based on ISO 15197:2013/EN ISO 15197:2015, system accuracy, measurement repeatability, and intermediate measurement precision were assessed. ISO 15197:2013 system accuracy criteria require that ⩾95% of individual BGMS' test strip lot results shall fall within ±15 mg/dl or ±15% of corresponding comparison method results (at glucose concentrations <100 mg/dl and ⩾100 mg/dl, respectively), and that ⩾99% of results fall within consensus error grid (CEG) zones A and B. Measurement repeatability was assessed using venous blood samples, whereas intermediate measurement precision was assessed using control solution samples. Standard deviation (SD) and coefficient of variation (CV) were calculated for glucose concentrations <100 mg/dl and ⩾100 mg/dl, respectively. Precision acceptance criteria are not specified by ISO 15197:2013. RESULTS: All three BGMS fulfilled system accuracy criteria with 96% to 98% of individual test strip lot's results falling within the acceptable accuracy limits. All measurement results fell within CEG zones A and B. For measurement repeatability, SD was ⩽3.3 mg/dl, and CV was ⩽3.9% for the investigated BGMS. Assessment of intermediate measurement precision showed SD ⩽1.3 mg/dl and CV ⩽3.0%. CONCLUSION: All three BGMS fulfilled system accuracy criteria of ISO 15197:2013. In absence of acceptance criteria, precision results were found to be consistent with the manufacturer's labeling of the investigated devices.

Assessment of System Accuracy, Intermediate Measurement Precision, and Measurement Repeatability of a Blood Glucose Monitoring System Based on ISO 15197.

BACKGROUND: Analytical quality of blood glucose monitoring systems (BGMS) is an important aspect for many diabetes patients. Sufficiently high analytical quality is required for adequate diabetes therapy. METHODS: In this study, system accuracy and measurement precision of a BGMS were assessed based on ISO 15197:2013. For system accuracy, this standard requires a specific glucose distribution and at least 95% of results obtained with the BGMS in capillary blood to fall within ±15 mg/dl or ±15% (at glucose concentrations <100 mg/dl or ≥100 mg/dl, respectively) of corresponding comparison method results, and at least 99% of results to be found within clinically acceptable consensus error grid (CEG) zones A and B. Based on ISO 15197:2013, intermediate measurement precision, using control solution, and measurement repeatability, using venous blood samples, were analyzed by calculation of standard deviations (SDs) and coefficients of variation (CV) at glucose concentrations <100 mg/dl or ≥100 mg/dl, respectively, although ISO 15197:2013 does not specify acceptance criteria. RESULTS: The BGMS fulfilled system accuracy requirements with ≥99% of results within ±15 mg/dl or ±15% of the comparison method results, and 100% of results in CEG zones A and B. Intermediate measurement precision analysis showed SD ≤2.2 mg/dl and CV ≤2.3%. Analysis of measurement repeatability showed SD ≤2.1 mg/dl and CV ≤2.4%. CONCLUSION: System accuracy requirements of ISO 15197:2013 were fulfilled by the BGMS. As ISO 15197:2013 does not specify precision requirements, precision analysis results were compared with those reported for other BGMS in the literature and found to be similar.