Can naive viewers put themselves in the patients' shoes?: reliability and validity of the analogue patient methodology.

BACKGROUND: Analogue patients (APs) are untrained viewers given the task of viewing and rating their impressions of a medical interaction while taking on the patient role. This methodology is often used to assess patient perceptions when using real patient (RP) populations is unethical or impractical. OBJECTIVES: This study examines the reliability and validity of the AP methodology and its optimal implementation. RESEARCH DESIGN: Forty-six videotaped interactions of RP-physician interactions, where RP satisfaction scores existed, were viewed by 216 APs, who rated satisfaction. Interrater reliability for AP satisfaction scores was evaluated. AP and RP satisfaction scores were compared with each other and correlated with the physician's observer-coded patient-centeredness. MEASURES: RP satisfaction was measured with a 15-item scale after the whole interaction. Physicians' patient-centered behavior was coded with the Four Habits Coding Scheme. AP satisfaction was measured after viewing the entire interaction with a single satisfaction question, a 4-item satisfaction scale including that single item, and the original 15-item satisfaction scale used by the RPs. RESULTS: AP satisfaction ratings were reliable (=0.70 for 4 APs). AP satisfaction was a significant predictor of RP satisfaction (r=0.29, P=0.05), especially when the analysis was limited to the RPs who reported being less than perfectly satisfied (r=0.65, P=0.002). AP satisfaction was a better predictor than RP satisfaction of providers' patient-centered behaviors in the interaction. CONCLUSIONS: The AP methodology is a valid and reliable approach to gathering patient perception data about provider-patient interactions. Results suggest practical advice for researchers using the AP methodology.

An educational intervention for providers to promote bone health in high-risk older patients.

OBJECTIVES: To design, implement, and assess an educational intervention for providers focused on osteoporosis screening and management in older patients with chronic obstructive pulmonary disease or asthma who have been prescribed prolonged courses of oral or high-dose inhaled corticosteroids or both and are therefore at high risk for bone loss and fractures. DESIGN: One-group pretest-posttest. SETTING: Academic outpatient pulmonary practice. PARTICIPANTS: Nineteen pulmonary specialists at an academic medical center. INTERVENTION: Educational theory and a needs assessment and attitude survey guided the development of a multicomponent educational intervention. MEASUREMENTS: Change in provider behavior was assessed by auditing the electronic medical records for adherence to osteoporosis management guidelines in high-risk patients seen by participants at baseline and for 6 months after the educational intervention. Knowledge transfer and changes in attitude were assessed using pre- and posttests and surveys. RESULTS: A 19% increase in overall rate of adherence to osteoporosis management guidelines in high-risk patients was observed: 45% before intervention to 64% after intervention (n=249 patients, P=.003). Postintervention surveys and test scores also showed statistically significant gains from baseline. CONCLUSION: An educational intervention improved adherence to osteoporosis management guidelines of academic pulmonary specialists. The results of this study provide evidence for the positive effect of a multimodal educational program in altering practice behaviors.

Procedural competence in internal medicine residents: validity of a central venous catheter insertion assessment instrument.

PURPOSE: Despite mandates from accreditation bodies for programs to ensure procedural competence, standardized measures do not exist to assess residents' skills in performing central venous catheter (CVC) insertion. The objective of the present study was to develop an instrument to assess residents in subclavian (SC) CVC insertion, to set performance standards, and to validate the tool using performance data. METHOD: In 2007, the authors convened experts to create an assessment tool for CVC insertion using a modified Delphi method. They applied the Angoff method to a second set of experts to determine minimum passing scores (MPSs) for both the borderline trainee and the competent trainee. Two faculty evaluators then used the checklist to assess residents performing CVCs on simulators. RESULTS: The authors created and experts confirmed a 24-item checklist. Using the Angoff method, the MPS required completion of 10 major and 2 minor criteria for a trainee to show borderline proficiency with CVC insertion under supervision. This MPS was correlated with a global rating of 2 on a 5-point scale. The MPS for competence was 17 major and 5 minor criteria. None of the residents deemed competent on a global rating scale achieved the MPS for competence. CONCLUSIONS: The authors were able to create and validate a consensus-driven procedural assessment tool with data-driven standards for basic proficiency and competence that faculty can use to assess residents as they perform CVC insertion.

Primary care experiences of medicare beneficiaries, 1998 to 2000.

OBJECTIVE: To examine changes in the quality of primary care experienced and reported by Medicare beneficiaries from 1998 to 2000. DESIGN: Longitudinal observational study. SETTING: Thirteen states with large, mature Medicare HMO markets. PARTICIPANTS: Probability sample of noninstitutionalized Medicare beneficiaries aged 65 and older enrolled in traditional Medicare (FFS) or a Medicare HMO. MEASUREMENTS AND MAIN RESULTS: We examined 2-year changes in 9 measures derived from the Primary Care Assessment Survey (PCAS). The measures covered 2 broad areas of primary care performance: quality of physician-patient interactions (5 measures) and structural/organizational features of care (4 measures). For each measure, we computed the change in each beneficiary's score (1998 vs 2000) and standardized effect sizes (ES). Results revealed significant declines in 3 measures of physician-patient interaction quality (communication, interpersonal treatment, and thoroughness of physical exams; P < or = .0001). Physicians' knowledge of patients increased significantly over the 2-year period (P < or = .001). Patient trust did not change (P = .10). With regard to structural/organizational features of care, there were significant declines in financial access (P < or = .001), visit-based continuity (P < .001), and integration of care (P < or = .05), while organizational access increased (P < or = .05). With the exception of financial access, observed changes did not differ by system (FFS, HMO). CONCLUSIONS: Over a 2-year period, the quality of seniors' interactions with their primary physicians declined significantly, as did other hallmarks of primary care such as continuity, integration of care, and financial access. This decline is in sharp contrast to the marked improvements in technical quality that have been measured over this period. In an era marked by substantial national investment in quality monitoring, measures of these elements of care are notably absent from the nation's portfolio of quality indicators.

The clinical and occupational correlates of work productivity loss among employed patients with depression.

Employers who are developing strategies to reduce health-related productivity loss may benefit from aiming their interventions at the employees who need them most. We determined whether depression's negative productivity impact varied with the type of work employees performed. Subjects (246 with depression and 143 controls) answered the Work Limitations Questionnaire and additional work questions. Occupational requirements were measured objectively. In multiple regression analyses, productivity was most influenced by depression severity (P < 0.01 in 5/5 models). However, certain occupations also significantly increased employee vulnerability to productivity loss. Losses increased when employees had occupations requiring proficiency in decision-making and communication and/or frequent customer contact (P < 0.05 in 3/5 models). The Work Limitations Questionnaire can help employers to reduce productivity loss by identifying health and productivity improvement priorities.

Cognitive transformation as a marker of resilience.

Individuals often report positive, transformative changes in response to adversity. Cognitive transformation involves a turning point in a person's life characterized by: (1) the recognition that coping with adversity resulted in new opportunities; and, (2) the reevaluation of the experience from one that was primarily traumatic or threatening to one that is growth-promoting. Cognitive transformation often signifies enhanced adaptation to adverse circumstances, and thus, is a marker of resilience. The present study examined the relationship of cognitive transformation to indicators of resilience among 35 acutely bereaved young adults and a nonbereaved comparison group. Findings strongly supported the hypothesis that transformation predicts resilience, and may reduce one's risk trajectory to enhance adaptation. Results are discussed in terms of their implications for research on resilience, and on recovery from acute or chronic adverse circumstances, including addiction.