Comparator Data Characteristics and Testing Procedures for the Clinical Performance Evaluation of Continuous Glucose Monitoring Systems.

Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical study design. In particular, the absence of concise requirements for the distribution of comparator (reference) blood glucose (BG) concentrations and their rate of change (RoC) that are used to evaluate CGM performance, impairs comparability. For this article, several experts in the field of CGM performance testing have collaborated to propose characteristics of the distribution of comparator measurements that should be collected during CGM performance testing. Specifically, it is proposed that at least 7.5% of comparator BG concentrations are <70 mg/dL (3.9 mmol/L) and >300 mg/dL (16.7 mmol/L), respectively, and that at least 7.5% of BG-RoC combinations indicate fast BG changes with impending hypo- or hyperglycemia, respectively. These proposed characteristics of the comparator data can facilitate the harmonization of testing conditions across different studies and CGM systems and ensure that the most relevant scenarios representing real-life situations are established during performance testing. In addition, a study protocol and testing procedure for the manipulation of glucose levels are suggested that enable the collection of comparator data with these characteristics. This work is an important step toward establishing a future standard for the performance evaluation of CGM systems.

Clinical Performance Evaluation of Continuous Glucose Monitoring Systems: A Scoping Review and Recommendations for Reporting.

The use of different approaches for design and results presentation of studies for the clinical performance evaluation of continuous glucose monitoring (CGM) systems has long been recognized as a major challenge in comparing their results. However, a comprehensive characterization of the variability in study designs is currently unavailable. This article presents a scoping review of clinical CGM performance evaluations published between 2002 and 2022. Specifically, this review quantifies the prevalence of numerous options associated with various aspects of study design, including subject population, comparator (reference) method selection, testing procedures, and statistical accuracy evaluation. We found that there is a large variability in nearly all of those aspects and, in particular, in the characteristics of the comparator measurements. Furthermore, these characteristics as well as other crucial aspects of study design are often not reported in sufficient detail to allow an informed interpretation of study results. We therefore provide recommendations for reporting the general study design, CGM system use, comparator measurement approach, testing procedures, and data analysis/statistical performance evaluation. Additionally, this review aims to serve as a foundation for the development of a standardized CGM performance evaluation procedure, thereby supporting the goals and objectives of the Working Group on CGM established by the Scientific Division of the International Federation of Clinical Chemistry and Laboratory Medicine.

Improving the Bias of Comparator Methods in Analytical Performance Assessments Through Recalibration.

BACKGROUND: In analytical performance studies, the choice of comparator method plays an important role, as studies have shown that there exist relevant systematic differences (bias) between laboratory analyzers. The feasibility of retrospective recalibration of measurement results through comparison with methods or materials of higher metrological order to minimize bias was therefore assessed. METHOD: Existing data from performance studies of continuous and blood glucose monitoring systems were retrospectively analyzed. Comparison with a higher-order method was performed for two different data sets. In both cases, subject samples were measured, and a subset was also measured on a higher-order method. Recalibration based on higher-order materials (standard reference material [SRM]) was conducted for two different data sets containing results from SRM and subject samples. Linear regression analysis was performed for each device separately. Resulting equations were applied to the respective complete data set of subject samples. Bias between devices in a data set across all subject samples was assessed before and after recalibration. RESULTS: Bias between devices was reduced from -3.6% to +0.6% in one data set and from +11.0% to +0.3% in the other by recalibration based on higher-order method. Using higher-order materials, bias was also reduced by recalibration, but mixed results were found: Bias was reduced from -3.1% to -0.1% in one data set and from -4.3% to -2.7% in the other. CONCLUSIONS: Recalibration did lead to a decrease in bias and thus can reduce the impact of the choice of comparator method. The procedure should be verified in a prospectively designed setting.

[Achieving laboratory results you can rely on]. / Tillsammans skapar vi laboratorieresultat att lita på - Extern kvalitetssäkring är ett verktyg för att beskriva noggrannheten.

Many decisions within healthcare are based on results from laboratory tests. These results all have an uncertainty, which can be either neglectable or large enough to affect the clinical assessment. In external quality assessment (EQA) the laboratories make independent observations on the same control sample, with values unknown for the participants. The results can be used to determine if quality improvement is needed. We present EQA data for laboratory tests with three different measurement scales; quantitative, ordinal and nominal. Results from EQA should be used in the discussions of quality in test results and necessary analytical performance specifications should be agreed upon.