Development and Testing of the CAHPS Cancer Care Survey.

PURPOSE: The Consumer Assessment of Healthcare Providers and Systems (CAHPS) Cancer Care Survey is a systematic assessment of health care experiences of patients with cancer. It supports comparisons among all cancer treatment settings and modalities. METHODS: Formative research included 16 focus groups with patients receiving treatment and family members; advice from a panel of oncology and quality improvement experts; and interviews with stakeholders representing oncology associations, accredited cancer centers, and community oncology practices. We conducted cognitive tests of the instrument and field tests at six cancer centers and four community oncology practices, after which the survey was finalized and obtained the CAHPS trademark. RESULTS: The survey includes 56 questions that form six core composite measures (Getting Timely Care; Supporting Patient Self-Management; Available to Provide Care and Information; Provider Communication; Care Coordination; and Courteous Office Staff); two single-item measures of family participation in care and interpreter services; and two global ratings of cancer care and the treatment team. Sixteen additional items form three supplemental composite measures: Shared Decision-Making, Keeping Patients Informed, and Access to Care. CONCLUSION: Mail-only, mail-telephone mixed-mode, and Web-mail mixed-mode data collection methods are recommended. The questionnaires and instructions for use are free and available in English and Spanish on the CAHPS Website (www.ahrq.gov/cahps).

Giving voice to the vulnerable: the development of a CAHPS nursing home survey measuring family members' experiences.

BACKGROUND: To complement a nursing home resident survey, the team developed a survey asking family members about their experiences with nursing homes. Although a family member does not receive care directly from a nursing home, their experiences at the nursing home and with staff can contribute to understanding nursing home quality. OBJECTIVES: To describe how the nursing home family member instrument was developed, refined, tested, and finalized. RESEARCH DESIGN: The team developed a draft survey using information from a literature review, 12 focus groups with family members involved in choosing a nursing home for someone, review of nursing home surveys, and expert/stakeholder input. The survey went through 2 rounds of cognitive interviews (n=54) and revisions and was fielded in 15 nursing homes. Data from the pilot survey (n=885) were subjected to psychometric analyses to evaluate the measurement properties of items as well as the reliability and validity of the resulting composites. On the basis of these analyses and input from experts, the survey was finalized. RESULTS: Focus groups and experts provided input into discerning important indicators of quality, although in some cases family members were not the best sources of information. Cognitive testing refined the survey and eliminated some of the proxy items. The field test analysis and input from experts eliminated 10 items. The final survey included 21 items organized into 4 composites. CONCLUSIONS: This survey measures family members' experiences of nursing home care, and the results contribute to the understanding of quality of care in nursing homes.

Health insurance knowledge among Medicare beneficiaries.

OBJECTIVE: To assess the effect of new consumer information materials about the Medicare program on beneficiary knowledge of their health care coverage under the Medicare system. DATA SOURCE: A telephone survey of 2,107 Medicare beneficiaries in the 10-county Kansas City metropolitan statistical area. STUDY DESIGN: Beneficiaries were randomly assigned to a control group and three treatment groups each receiving a different set of Medicare informational materials. The "handbook-only" group received the Health Care Financing Administration's new Medicare & You 1999 handbook. The "bulletin" group received an abbreviated version of the handbook, and the "handbook + CAHPS" group received the Medicare & You handbook plus the Consumer Assessment of Health Plans (CAHPS) survey report comparing the quality of health care provided by Medicare HMOs. Beneficiaries interested in receiving information were oversampled. DATA COLLECTION METHODS: Data were collected during two separate telephone surveys of Medicare beneficiaries: one survey of new beneficiaries and another survey of experienced beneficiaries. The intervention materials were mailed to sample members in advance of the interviews. Knowledge for the treatment groups was measured shortly after beneficiaries received the intervention materials. PRINCIPAL FINDINGS: Respondents' knowledge was measured using a psychometrically valid and reliable 15-item measure. Beneficiaries who received the intervention materials answered significantly more questions correctly than control group members. The effect on beneficiary knowledge of providing the information was modest for all intervention groups but varied for experienced beneficiaries only, depending on the intervention they received. CONCLUSIONS: The findings suggest that all of the new materials had a positive effect on beneficiary knowledge about Medicare and the Medicare + Choice program. While the absolute gain in knowledge was modest, it was greater than increases in knowledge associated with traditional Medicare information sources.