The validity of race and ethnicity in enrollment data for Medicare beneficiaries.

OBJECTIVE: To assess the validity of race/ethnicity in Medicare databases for studies of racial/ethnic disparities. DATA SOURCES: The 2010 Medicare Consumer Assessments of Healthcare Providers and Systems (CAHPS(®)) survey was linked to Medicare enrollment data and local area characteristics from the 2000 Census. STUDY DESIGN: Race/ethnicity was cross-tabulated for CAHPS and Medicare data. Within each self-reported category, demographic, geographic, health, and health care variables were compared between those that were and were not similarly identified in Medicare data. DATA COLLECTION METHODS: The Medicare CAHPS survey included 343,658 responses from elderly participants (60 percent response rate). Data were weighted for sampling and nonresponse to be representative of the national population of elderly Medicare beneficiaries. PRINCIPAL FINDINGS: Self-reported Hispanics, Asians, Pacific Islanders, and American Indians were underidentified in Medicare enrollment data. Individuals in these groups who were identified in Medicare data tended to be more strongly identified with their group, poorer, and in worse health and to report worse health care experiences than those who were not so identified. CONCLUSIONS: Self-reported members of racial and ethnic groups other than Whites and Blacks who are identified in Medicare data differ substantially from those who are not so identified. These differences should be considered in assessments of disparities in health and health care among Medicare beneficiaries.

Profiling hospitals by survival of patients with colorectal cancer.

OBJECTIVE: To profile hospitals by survival rates of colorectal cancer patients in multiple periods after initial treatment. DATA SOURCES: California Cancer Registry data from 50,544 patients receiving primary surgery with curative intent for stage I-III colorectal cancer in 1994-1998, supplemented with hospital discharge abstracts. STUDY DESIGN: We estimated a single Bayesian hierarchical model to quantify associations of survival to 30 days, 30 days to 1 year, and 1-5 years by hospital, adjusted for patient age, sex, race, stage, tumor site, and comorbidities. We compared two profiling methods for 30-day survival and four longer-term profiling methods by the fractions of hospitals with demonstrably superior survival profiles and of hospital pairs whose relative standings could be established confidently. PRINCIPAL FINDINGS: Interperiod correlation coefficients of the random effects are (95 percent credible interval 0.27, 0.85), (0.20, 0.76), and (0.19, 0.82). The three-period model ranks 5.4 percent of pairwise comparisons by 30-day survival with at least 95 percent confidence, versus 3.3 percent of pairs using a single-period model, and 15-20 percent by weighted multiperiod methods. CONCLUSIONS: The quality of care for colorectal cancer provided by a hospital system is somewhat consistent across the immediate postoperative and long-term follow-up periods. Combining mortality profiles across longer periods may improve the statistical reliability of outcome comparisons.

Market and beneficiary characteristics associated with enrollment in Medicare managed care plans and fee-for-service.

BACKGROUND: Risk selection in the Medicare managed care program ("Medicare Advantage") is an important policy concern. Past research has shown that Medicare managed care plans tend to attract healthier beneficiaries and that market characteristics such as managed care penetration may also affect risk selection. OBJECTIVES: To assess whether patient enrollment in Medicare managed care (MMC) or traditional fee-for-service (FFS) Medicare is related to beneficiary and market characteristics and provide a baseline for understanding how changes in Medicare policy affect MMC enrollment over time. RESEARCH DESIGN: Data sources were the 2004 Medicare MMC and FFS CAHPS surveys, the Social Security Administration's Master Beneficiary Record, MMC Market Penetration Files, and 2000 Census data. We estimated logistic regression models to assess what beneficiary characteristics predict enrollment in MMC and the moderating effects of market characteristics. RESULTS: Enrollees in MMC plans tend to have better health than those in FFS. This effect is weaker in areas with more competition. Latinos and beneficiaries with less education and lower income, as indicated by earnings history or local-area median income, are more likely to enroll in MMC. CONCLUSIONS: Enrollment in MMC is related to beneficiary characteristics, including health status and socioeconomic status, and is modified by MMC presence in the local market. Because vulnerable subgroups are more likely to enroll in MMC plans, the Centers for Medicare & Medicaid Services should monitor how changes to Medicare Advantage policies and payment methods may affect beneficiaries in those groups.

Plan, geographical, and temporal variation of consumer assessments of ambulatory health care.

OBJECTIVE: To quantify contributions of health plans and geography to variation in consumer assessments of health plan quality. DATA SOURCES: Responses of beneficiaries of Medicare managed care plans to the Consumer Assessment of Health Plans Study (CAHPS(R)) survey. Our data included more than 700,000 survey responses assessing 381 Medicare managed care (MMC) contracts over a period of five years. STUDY DESIGN: The survey was administered to a nationally representative sample of beneficiaries of Medicare managed care plans. PRINCIPAL FINDINGS: Member assessments of their health plans, customer service functions, and prescription drug benefits varied most across health plans; these also varied the most over time. Assessments of direct interactions with doctors and their practices were more affected by geographical location, and these assessments were quite stable over time. A health plan's global rating often changed significantly between consecutive years, but only rarely were there such changes in ratings of care or doctor. Nationally, mean assessments tended to decrease over the study period. CONCLUSIONS: Our findings suggest that ratings of plans and reports about customer service and prescription access are affected by plan policies, benefits design, and administrative structures that can be changed relatively quickly. Conversely, assessments of other aspects of care are largely determined by characteristics of provider networks that are relatively stable. A consumer survey is unlikely to detect meaningful changes in quality of care from year to year unless quality improvement measures are developed that have substantially larger effects, possibly through area-wide initiatives, than historical temporal variations in quality.

Combining health plan performance indicators into simpler composite measures.

We investigated how the Consumer Assessment of Health Plan Study (CAHPS) survey and the Health Plan Employer Data Information System (HEDIS) measures from Medicare managed care (MMC) plans could be combined into fewer summary performance scores. Four scores summarize most of the variability in these measures, representing (1) care at the doctor's office, (2) customer service and access, (3) vaccinations, and (4) clinical quality measures. These summaries are substantively interpretable, internally consistent, and describe the majority of variation among units in the performance scores analyzed.

Factors affecting response rates to the Consumer Assessment of Health Plans Study survey.

OBJECTIVES: Assess the determinants of nonresponse to a consumer health care survey. METHODS: The first (1997; CAHPS 1.0) and third (1999; CAHPS 2.0) Medicare managed care (MMC) CAHPS surveys collected data on 215 and 365 health plan reporting units, respectively. Data indicated which beneficiaries responded by mail, responded by phone, could not be located, and did not respond. InterStudy data described plan characteristics. chi2 tests and logistic regression models, adjusted for clustering by plan, were used to test associations of individual and plan characteristics with availability of good contact information and response given good contact information. RESULTS: Response rates in the 1997 and 1999 surveys were 75% and 80%, respectively. Older and disabled beneficiaries, women, nonwhite beneficiaries, and persons living in areas with more residents who were nonwhite, on public assistance, and less educated had lower response rates. These associations were partly explained by the distribution of bad contact information, but even among beneficiaries who could be located plan response rates varied greatly. For-profit plans are significantly more likely to have high rates of bad contact information and lower response rates. Telephone follow-up improved the sociodemographic representativeness of the sample, for both high and low response rate plans. CONCLUSION: CAHPS-MMC survey procedures, in particular telephone follow-up, have resulted in high response rates, and current case-mix strategies compensate for some of the remaining effects of differing response rates on comparisons among plans. Further efforts to explore the determinants of response rates are warranted.

Adjusting Performance Measures to Ensure Equitable Plan Comparisons.

When comparing health plans on scores from the Medicare Managed Care Consumer Assessment of Health Plans (MMC-CAHPS®) survey, the results should be adjusted for patient characteristics, not under the control of health plans, that might affect survey results. We developed an adjustment model that uses self-reported measures of health status, age, education, and whether someone helped the respondent with the questionnaire. The associations of health and education with survey responses differed by HCFA administrative region. Consequently, we recommend that the case-mix model include regional interactions. Analyses of the impact of adjustment show that the adjustments were usually small but not negligible.