Performance Assessment of Pharmacotherapy: Results from a Content Validity Survey of the Psychopharmacotherapy-Structured Clinical Observation (P-SCO) Tool.

OBJECTIVE: The Psychopharmacotherapy-Structured Clinical Observation (P-SCO) tool is designed to assess performance of a medication management visit and to enhance feedback. Prior research indicated that the P-SCO was feasible to implement in a resident clinic and generated behaviorally specific, high-quality feedback. This research also highlighted problems with some of the instrument's items. This study seeks to improve the items. METHODS: The authors initially revised the P-SCO items based on the problems identified by a prior study. Next, these items were iteratively modified by experts in clinical pharmacotherapy and educational assessment. Forty-five items emerged. Finally, faculty attending an annual department education retreat rated each item on its relevance (4-point scale) and provided comments on how the item might be revised. For final inclusion, an item must have met a quantitative threshold (i.e., content validity index equal to or greater than 0.8 and the lower end of the asymmetric confidence interval equal to or greater than 3.0) and received comments that were supportive. RESULTS: Forty-one of the 45 items had strong quantitative support. However, the comments endorsed lumping a number of items in order to decrease overlap between items and to shorten the instrument. This process resulted in the further elimination of 15 items. CONCLUSIONS: The revised 26-item P-SCO builds upon prior evidence of feasibility and utility and now possesses additional evidence of content validity. The use of the tool should enhance feedback and improve the capacity of educational programs to assess performance.

Developing End-of-Training Entrustable Professional Activities for Psychiatry: Results and Methodological Lessons.

PURPOSE: To develop entrustable professional activities (EPAs) for psychiatry and to demonstrate an innovative, validity-enhancing methodology that may be relevant to other specialties. METHOD: A national task force employed a three-stage process from May 2014 to February 2017 to develop EPAs for psychiatry. In stage 1, the task force used an iterative consensus-driven process to construct proposed EPAs. Each included a title, full description, and relevant competencies. In stage 2, the task force interviewed four nonpsychiatric experts in EPAs and further revised the EPAs. In stage 3, the task force performed a Delphi study of national experts in psychiatric education and assessment. All survey participants completed a brief training program on EPAs. Quantitative and qualitative analysis led to further modifications. Essentialness was measured on a five-point scale. EPAs were included if the content validity index was at least 0.8 and the lower end of the asymmetric confidence interval was not lower than 4.0. RESULTS: Stages 1 and 2 yielded 24 and 14 EPAs, respectively. In stage 3, 31 of the 39 invited experts participated in both rounds of the Delphi study. Round 1 reduced the proposed EPAs to 13. Ten EPAs met the inclusion criteria in Round 2. CONCLUSIONS: The final EPAs provide a strong foundation for competency-based assessment in psychiatry. Methodological features such as critique by nonpsychiatry experts, a national Delphi study with frame-of-reference training, and stringent inclusion criteria strengthen the content validity of the findings and may serve as a model for future efforts in other specialties.

Intentions to receive a potentially available Lyme disease vaccine in an urban sample.

OBJECTIVES: The only human Lyme disease vaccine of LYMErix was voluntarily removed from the market in the United States in 2002 for a number of reasons. A new human Lyme disease vaccine is currently being developed. We would like any future approved human Lyme disease vaccine to be of interest and marketable to consumers. METHODS: We surveyed 714 participants to determine variables associated with intentions to receive a Lyme disease vaccine. Predictor variables included demographics, protection motivational theory, Lyme disease knowledge, Lyme disease preventive behaviors, beliefs and perceived health. RESULTS: We found in multivariate linear regression analyses that Asian/Asian American race/ethnicity (p < 0.001), South Asian race/ethnicity (p = 0.01) and coping appraisal variables of response efficacy (p < 0.001) and self-efficacy (p < 0.001) were each significantly associated with increased intentions. The belief that vaccines are typically not safe was significantly associated with decreased intentions (p = 0.03). CONCLUSIONS: Asian/Asian American and South Asian race/ethnicities have a strong interest in receiving a Lyme disease vaccine. Although pharmaceutical companies may benefit by advertising a Lyme disease vaccine to Asian/Asian Americans and South Asians, marketers need to address and use approaches to interest those from other race/ethnicities. Also, marketers need to address the erroneous belief that vaccines are typically not safe in order to interest those with such beliefs to use a Lyme disease vaccine.