Use of Real-World Data in Population Science to Improve the Prevention and Care of Diabetes-Related Outcomes.

The past decade of population research for diabetes has seen a dramatic proliferation of the use of real-world data (RWD) and real-world evidence (RWE) generation from non-research settings, including both health and non-health sources, to influence decisions related to optimal diabetes care. A common attribute of these new data is that they were not collected for research purposes yet have the potential to enrich the information around the characteristics of individuals, risk factors, interventions, and health effects. This has expanded the role of subdisciplines like comparative effectiveness research and precision medicine, new quasi-experimental study designs, new research platforms like distributed data networks, and new analytic approaches for clinical prediction of prognosis or treatment response. The result of these developments is a greater potential to progress diabetes treatment and prevention through the increasing range of populations, interventions, outcomes, and settings that can be efficiently examined. However, this proliferation also carries an increased threat of bias and misleading findings. The level of evidence that may be derived from RWD is ultimately a function of the data quality and the rigorous application of study design and analysis. This report reviews the current landscape and applications of RWD in clinical effectiveness and population health research for diabetes and summarizes opportunities and best practices in the conduct, reporting, and dissemination of RWD to optimize its value and limit its drawbacks.

Practical Guidance for Involving Stakeholders in Health Research.

Stakeholder engagement is increasingly common in health research, with protocols for engaging multiple stakeholder groups becoming normative in patient-centered outcomes research. Previous work has focused on identifying relevant stakeholder groups with whom to work and on working with stakeholders in evidence implementation. This paper draws on the expertise of a team from four countries-Canada, Australia, the UK, and the USA-to provide researchers with practical guidance for carrying out multi-stakeholder-engaged projects: we present a list of questions to assist in selecting appropriate roles and modes of engagement; we introduce a matrix to help summarize engagement activities; and we provide a list of online resources. This guidance, matrix, and list of resources can assist researchers to consider more systematically which stakeholder groups to involve, in what study roles, and by what modes of engagement. By documenting how stakeholders are paired up with specific roles, the matrix also provides a potential structure for evaluating the impact of stakeholder engagement.

Engaging patients and stakeholders in research proposal review: the patient-centered outcomes research institute.

The inaugural round of merit review for the Patient-Centered Outcomes Research Institute (PCORI) in November 2012 included patients and other stakeholders, as well as scientists. This article examines relationships among scores of the 3 reviewer types, changes in scoring after in-person discussion, and the effect of inclusion of patient and stakeholder reviewers on the review process. In the first phase, 363 scientists scored 480 applications. In the second phase, 59 scientists, 21 patients, and 31 stakeholders provided a "prediscussion" score and a final "postdiscussion" score after an in-person meeting for applications. Bland-Altman plots were used to characterize levels of agreement among and within reviewer types before and after discussion. Before discussion, there was little agreement among average scores given by the 4 lead scientific reviewers and patient and stakeholder reviewers. After discussion, the 4 primary reviewers showed mild convergence in their scores, and the 21-member panel came to a much stronger agreement. Of the 25 awards with the best (and lowest) scores after phase 2, only 13 had ranked in the top 25 after the phase 1 review by scientists. Five percent of the 480 proposals submitted were funded. The authors conclude that patient and stakeholder reviewers brought different perspectives to the review process but that in-person discussion led to closer agreement among reviewer types. It is not yet known whether these conclusions are generalizable to future rounds of peer review. Future work would benefit from additional data collection for evaluation purposes and from long-term evaluation of the effect on the funded research.

PCORI at 3 years--progress, lessons, and plans.

The Patient-Centered Outcomes Research Institute (PCORI) has established distinctive pathways for funding and conducting practical research and has awarded over $318 million for studies covering a wide range of conditions, locations, and socioeconomic characteristics.

Screening for impaired fasting glucose and diabetes using available health plan data.

AIMS: To develop and validate prediction equations to identify individuals at high risk for type 2 diabetes using existing health plan data. METHODS: Health plan data from 2005 to 2009 from 18,527 members of a Midwestern HMO without diabetes, 6% of whom had fasting plasma glucose (FPG) ≥110mg/dL, and health plan data from 2005 to 2006 from 368,025 members of a West Coast-integrated delivery system without diabetes, 13% of whom had FPG ≥110mg/dL were analyzed. Within each health plan, we used multiple logistic regression to develop equations to predict FPG ≥110mg/dL for half of the population and validated the equations using the other half. We then externally validated the equations in the other health plan. RESULTS: Areas under the curve for the most parsimonious equations were 0.665 to 0.729 when validated internally. Positive predictive values were 14% to 32% when validated internally and 14% to 29% when validated externally. CONCLUSION: Multivariate logistic regression equations can be applied to existing health plan data to efficiently identify persons at higher risk for dysglycemia who might benefit from definitive diagnostic testing and interventions to prevent or treat diabetes.

Future directions for cardiovascular disease comparative effectiveness research: report of a workshop sponsored by the National Heart, Lung, and Blood Institute.

Comparative effectiveness research (CER) aims to provide decision makers with the evidence needed to evaluate the benefits and harms of alternative clinical management strategies. CER has become a national priority, with considerable new research funding allocated. Cardiovascular disease is a priority area for CER. This workshop report provides an overview of CER methods, with an emphasis on practical clinical trials and observational treatment comparisons. The report also details recommendations to the National Heart, Lung, and Blood Institute for a new framework for evidence development to foster cardiovascular CER, and specific studies to address 8 clinical issues identified by the Institute of Medicine as high priorities for cardiovascular CER.

Construction of a multisite DataLink using electronic health records for the identification, surveillance, prevention, and management of diabetes mellitus: the SUPREME-DM project.

INTRODUCTION: Electronic health record (EHR) data enhance opportunities for conducting surveillance of diabetes. The objective of this study was to identify the number of people with diabetes from a diabetes DataLink developed as part of the SUPREME-DM (SUrveillance, PREvention, and ManagEment of Diabetes Mellitus) project, a consortium of 11 integrated health systems that use comprehensive EHR data for research. METHODS: We identified all members of 11 health care systems who had any enrollment from January 2005 through December 2009. For these members, we searched inpatient and outpatient diagnosis codes, laboratory test results, and pharmaceutical dispensings from January 2000 through December 2009 to create indicator variables that could potentially identify a person with diabetes. Using this information, we estimated the number of people with diabetes and among them, the number of incident cases, defined as indication of diabetes after at least 2 years of continuous health system enrollment. RESULTS: The 11 health systems contributed 15,765,529 unique members, of whom 1,085,947 (6.9%) met 1 or more study criteria for diabetes. The nonstandardized proportion meeting study criteria for diabetes ranged from 4.2% to 12.4% across sites. Most members with diabetes (88%) met multiple criteria. Of the members with diabetes, 428,349 (39.4%) were incident cases. CONCLUSION: The SUPREME-DM DataLink is a unique resource that provides an opportunity to conduct comparative effectiveness research, epidemiologic surveillance including longitudinal analyses, and population-based care management studies of people with diabetes. It also provides a useful data source for pragmatic clinical trials of prevention or treatment interventions.

Clinical, epidemiologic, histopathologic and molecular features of an unexplained dermopathy.

BACKGROUND: Morgellons is a poorly characterized constellation of symptoms, with the primary manifestations involving the skin. We conducted an investigation of this unexplained dermopathy to characterize the clinical and epidemiologic features and explore potential etiologies. METHODS: A descriptive study was conducted among persons at least 13 years of age and enrolled in Kaiser Permanente Northern California (KPNC) during 2006-2008. A case was defined as the self-reported emergence of fibers or materials from the skin accompanied by skin lesions and/or disturbing skin sensations. We collected detailed epidemiologic data, performed clinical evaluations and geospatial analyses and analyzed materials collected from participants' skin. RESULTS: We identified 115 case-patients. The prevalence was 3.65 (95% CI = 2.98, 4.40) cases per 100,000 enrollees. There was no clustering of cases within the 13-county KPNC catchment area (p = .113). Case-patients had a median age of 52 years (range: 17-93) and were primarily female (77%) and Caucasian (77%). Multi-system complaints were common; 70% reported chronic fatigue and 54% rated their overall health as fair or poor with mean Physical Component Scores and Mental Component Scores of 36.63 (SD = 12.9) and 35.45 (SD = 12.89), respectively. Cognitive deficits were detected in 59% of case-patients and 63% had evidence of clinically significant somatic complaints; 50% had drugs detected in hair samples and 78% reported exposure to solvents. Solar elastosis was the most common histopathologic abnormality (51% of biopsies); skin lesions were most consistent with arthropod bites or chronic excoriations. No parasites or mycobacteria were detected. Most materials collected from participants' skin were composed of cellulose, likely of cotton origin. CONCLUSIONS: This unexplained dermopathy was rare among this population of Northern California residents, but associated with significantly reduced health-related quality of life. No common underlying medical condition or infectious source was identified, similar to more commonly recognized conditions such as delusional infestation.

Lactation intensity and postpartum maternal glucose tolerance and insulin resistance in women with recent GDM: the SWIFT cohort.

OBJECTIVE: To examine the association between breastfeeding intensity in relation to maternal blood glucose and insulin and glucose intolerance based on the postpartum 2-h 75-g oral glucose tolerance test (OGTT) results at 6-9 weeks after a pregnancy with gestational diabetes mellitus (GDM). RESEARCH DESIGN AND METHODS: We selected 522 participants enrolled into the Study of Women, Infant Feeding, and Type 2 Diabetes (SWIFT), a prospective observational cohort study of Kaiser Permanente Northern California members diagnosed with GDM using the 3-h 100-g OGTT by the Carpenter and Coustan criteria. Women were classified as normal, prediabetes, or diabetes according to American Diabetes Association criteria based on the postpartum 2-h 75-g OGTT results. RESULTS: Compared with exclusive or mostly formula feeding (>17 oz formula per 24 h), exclusive breastfeeding and mostly breastfeeding (≤6 oz formula per 24 h) groups, respectively, had lower adjusted mean (95% CI) group differences in fasting plasma glucose (mg/dL) of -4.3 (-7.4 to -1.3) and -5.0 (-8.5 to -1.4), in fasting insulin (µU/mL) of -6.3 (-10.1 to -2.4) and -7.5 (-11.9 to -3.0), and in 2-h insulin of -21.4 (-41.0 to -1.7) and -36.5 (-59.3 to -13.7) (all P < 0.05). Exclusive or mostly breastfeeding groups had lower prevalence of diabetes or prediabetes (P = 0.02). CONCLUSIONS: Higher intensity of lactation was associated with improved fasting glucose and lower insulin levels at 6-9 weeks' postpartum. Lactation may have favorable effects on glucose metabolism and insulin sensitivity that may reduce diabetes risk after GDM pregnancy.

Study of Women, Infant Feeding, and Type 2 diabetes mellitus after GDM pregnancy (SWIFT), a prospective cohort study: methodology and design.

BACKGROUND: Women with history of gestational diabetes mellitus (GDM) are at higher risk of developing type 2 diabetes within 5 years after delivery. Evidence that lactation duration influences incident type 2 diabetes after GDM pregnancy is based on one retrospective study reporting a null association. The Study of Women, Infant Feeding and Type 2 Diabetes after GDM pregnancy (SWIFT) is a prospective cohort study of postpartum women with recent GDM within the Kaiser Permanente Northern California (KPNC) integrated health care system. The primary goal of SWIFT is to assess whether prolonged, intensive lactation as compared to formula feeding reduces the 2-year incidence of type 2 diabetes mellitus among women with GDM. The study also examines whether lactation intensity and duration have persistent favorable effects on blood glucose, insulin resistance, and adiposity during the 2-year postpartum period. This report describes the design and methods implemented for this study to obtain the clinical, biochemical, anthropometric, and behavioral measurements during the recruitment and follow-up phases. METHODS: SWIFT is a prospective, observational cohort study enrolling and following over 1, 000 postpartum women diagnosed with GDM during pregnancy within KPNC. The study enrolled women at 6-9 weeks postpartum (baseline) who had been diagnosed by standard GDM criteria, aged 20-45 years, delivered a singleton, term (greater than or equal to 35 weeks gestation) live birth, were not using medications affecting glucose tolerance, and not planning another pregnancy or moving out of the area within the next 2 years. Participants who are free of type 2 diabetes and other serious medical conditions at baseline are screened for type 2 diabetes annually within the first 2 years after delivery. Recruitment began in September 2008 and ends in December 2011. Data are being collected through pregnancy and early postpartum telephone interviews, self-administered monthly mailed questionnaires (3-11 months postpartum), a telephone interview at 6 months, and annual in-person examinations at which a 75 g 2-hour OGTT is conducted, anthropometric measurements are obtained, and self- and interviewer-administered questionnaires are completed. DISCUSSION: This is the first, large prospective, community-based study involving a racially and ethnically diverse cohort of women with recent GDM that rigorously assesses lactation intensity and duration and examines their relationship to incident type 2 diabetes while accounting for numerous potential confounders not assessed previously.

Risk of bladder cancer among diabetic patients treated with pioglitazone: interim report of a longitudinal cohort study.

OBJECTIVE: Some preclinical in vivo studies and limited human data suggest a possible increased risk of bladder cancer with pioglitazone therapy. This is an interim report of an ongoing cohort study examining the association between pioglitazone therapy and the risk of bladder cancer in patients with diabetes. RESEARCH DESIGN AND METHODS: This study includes 193,099 patients in the Kaiser Permanente Northern California diabetes registry who were ≥40 years of age between 1997 and 2002. Those with prior bladder cancer were excluded. Ever use of each diabetes medication (defined as two or more prescriptions within 6 months) was treated as a time-dependent variable. Cox regression-generated hazard ratios (HRs) compared pioglitazone use with nonpioglitazone use adjusted for age, sex, race/ethnicity, diabetes medications, A1C, heart failure, household income, renal function, other bladder conditions, and smoking. RESULTS: The group treated with pioglitazone comprised 30,173 patients. There were 90 cases of bladder cancer among pioglitazone users and 791 cases of bladder cancer among nonpioglitazone users. Overall, ever use of pioglitazone was not associated with risk of bladder cancer (HR 1.2 [95% CI 0.9-1.5]), with similar results in men and women (test for interaction P = 0.8). However, in the a priori category of >24 months of therapy, there was an increased risk (1.4 [1.03-2.0]). Ninety-five percent of cancers diagnosed among pioglitazone users were detected at early stage. CONCLUSIONS: In this cohort of patients with diabetes, short-term use of pioglitazone was not associated with an increased incidence of bladder cancer, but use for more than 2 years was weakly associated with increased risk.

Correlates of depression among people with diabetes: The Translating Research Into Action for Diabetes (TRIAD) study.

AIM: The broad objective of this study was to examine multiple dimensions of depression in a large, diverse population of adults with diabetes. Specific aims were to measure the association of depression with: (1) patient characteristics; (2) outcomes; and (3) diabetes-related quality of care. METHODS: Cross-sectional analyses were performed using survey and chart data from the Translating Research Into Action for Diabetes (TRIAD) study, including 8790 adults with diabetes, enrolled in 10 managed care health plans in 7 states. Depression was measured using the Patient Health Questionnaire (PHQ-8). Patient characteristics, outcomes and quality of care were measured using validated survey items and chart data. RESULTS: Nearly 18% of patients had major depression, with prevalence 2-3 times higher among patients with low socioeconomic status. Pain and limited mobility were strongly associated with depression, controlling for other patient characteristics. Depression was associated with slightly worse glycemic control, but not other intermediate clinical outcomes. Depressed patients received slightly fewer recommended diabetes-related processes of care. CONCLUSIONS: In a large, diverse cohort of patients with diabetes, depression was most prevalent among patients with low socioeconomic status and those with pain, and was associated with slightly worse glycemic control and quality of care.

Population trends in the incidence and outcomes of acute myocardial infarction.

BACKGROUND: Few studies have characterized recent population trends in the incidence and outcomes of myocardial infarction. METHODS: We identified patients 30 years of age or older in a large, diverse, community-based population who were hospitalized for incident myocardial infarction between 1999 and 2008. Age- and sex-adjusted incidence rates were calculated for myocardial infarction overall and separately for ST-segment elevation and non-ST-segment elevation myocardial infarction. Patient characteristics, outpatient medications, and cardiac biomarker levels during hospitalization were identified from health plan databases, and 30-day mortality was ascertained from administrative databases, state death data, and Social Security Administration files. RESULTS: We identified 46,086 hospitalizations for myocardial infarctions during 18,691,131 person-years of follow-up from 1999 to 2008. The age- and sex-adjusted incidence of myocardial infarction increased from 274 cases per 100,000 person-years in 1999 to 287 cases per 100,000 person-years in 2000, and it decreased each year thereafter, to 208 cases per 100,000 person-years in 2008, representing a 24% relative decrease over the study period. The age- and sex-adjusted incidence of ST-segment elevation myocardial infarction decreased throughout the study period (from 133 cases per 100,000 person-years in 1999 to 50 cases per 100,000 person-years in 2008, P<0.001 for linear trend). Thirty-day mortality was significantly lower in 2008 than in 1999 (adjusted odds ratio, 0.76; 95% confidence interval, 0.65 to 0.89). CONCLUSIONS: Within a large community-based population, the incidence of myocardial infarction decreased significantly after 2000, and the incidence of ST-segment elevation myocardial infarction decreased markedly after 1999. Reductions in short-term case fatality rates for myocardial infarction appear to be driven, in part, by a decrease in the incidence of ST-segment elevation myocardial infarction and a lower rate of death after non-ST-segment elevation myocardial infarction.

Meaningful variation in performance: what does variation in quality tell us about improving quality?

BACKGROUND: Variance reduction is sometimes considered as a goal of clinical quality improvement. Variance among physicians, hospitals, or health plans has been evaluated as the proportion of total variance (or intraclass correlation, ICC) in a quality measure; low ICCs have been interpreted to indicate low potential for quality improvement at that level. However, the absolute amount of variation, expressed in clinically meaningful units, is less frequently reported. Moreover, changes in variance components have not been studied as quality improves. OBJECTIVES: To examine changes in variance components at primary care physician and medical facility levels as performance improved for 4 quality indicators: systolic blood pressure levels in hypertension; low-density lipoprotein-cholesterol levels in hyperlipidemia; patient-reported care experience scores after primary care visits; and mammography screening rates. POPULATION: Adult members (n = 62,596-410,976) of Kaiser Permanente in Northern California, served by more than 1000 primary care physicians in 35 facilities, from 2001 to 2006. METHODS: Multilevel linear and logistic regression to examine the interphysician and interfacility variances in 4 quality indicators over 6 years, after case-mix adjustment. RESULTS: ICCs were low for all 4 indicators at both levels (0.0021-0.086). Nevertheless, variances at both levels were statistically and clinically significant. For systolic blood pressure and the care experience score, interfacility and interphysician variance as well as ICCs decreased further as quality improved; declines were greater at the facility level. For low-density lipoprotein-cholesterol, variability at both levels increased with quality improvement; and for screening mammography, small declines were not statistically significant for either physicians or facilities. CONCLUSIONS: Low proportions of variance do not predict low potential for quality improvement. Despite low ICCs for facilities, quality improvement efforts directed primarily at facilities improved quality for all 4 indicators.