Surgery resident selection and evaluation. A critical incident study.

This article reports a study of the process of selecting and evaluating general surgery residents. In personnel psychology terms, a job analysis of general surgery was conducted using the Critical Incident Technique (CIT). The researchers collected 235 critical incidents through structured interviews with 10 general surgery faculty members and four senior residents. The researchers then directed the surgeons in a two-step process of sorting the incidents into categories and naming the categories. The final essential categories of behavior to define surgical competence were derived through discussion among the surgeons until a consensus was formed. Those categories are knowledge/self-education, clinical performance, diagnostic skills, surgical skills, communication skills, reliability, integrity, compassion, organization skills, motivation, emotional control, and personal appearance. These categories were then used to develop an interview evaluation form for selection purposes and a performance evaluation form to be used throughout residency training. Thus a continuum of evaluation was established. The categories and critical incidents were also used to structure the interview process, which has demonstrated increased interview validity and reliability in many other studies. A handbook for structuring the interviews faculty members conduct with applicants was written, and an interview training session was held with the faculty. The process of implementation of the structured selection interviews is being documented currently through qualitative research.

Evaluation of an electronic message strip to recruit smokers to a smoking cessation program.

Knowledge of outcome is essential when analyzing effectiveness of educational programs. Although quantitative data can be analyzed more rigorously than other forms of data, quantitation of behavioral processes is often difficult. To promote our smoking-cessation program we designed a method that relies on electronic message strips and a dedicated telephone line capable of providing quantitative outcome information. This approach appears quite versatile and shows that the electronic message strip is a surprisingly ineffective method of enlisting subjects into a smoking-cessation program in our hospital.