Comparison of measures to assess change in diagnostic performance due to a decision support system.

Little has been done to examine the relative merit of measures used to assess the impact of diagnostic decision support systems (DDSS) on physician performance. In this study, 10 different single-measures of diagnostic performance were compared empirically. The measures were of three types: rank-order, all-or-none, and appropriateness. The responsiveness (RESP) of each measure was estimated under two repeated-measures experimental conditions. RESP is the degree to which a measure could detect differences between conditions of low and high performance. The diagnostic performance of 108 physicians was compared on medical cases of varying diagnostic difficulty and with or without a high level of assistance from a DDSS. The results showed that the RESP among the measures varied nearly tenfold. The rank-order measures tended to provide the highest RESP values (maximum = 2.14) while appropriateness measures provided the lowest RESP values (maximum = 1.41). The most responsive measures were rank-orders of the correct diagnosis within the top 5 to 10 listed diagnoses.

Effects of a decision support system on physicians' diagnostic performance.

PURPOSE: This study examines how the information provided by a diagnostic decision support system for clinical cases of varying diagnostic difficulty affects physicians' diagnostic performance. METHODS: A national sample of 67 internists, 35 family physicians, and 6 other physicians used the Quick Medical Reference (QMR) diagnostic decision support system to assist them in the diagnosis of written clinical cases. Three sets of eight cases, stratified by diagnostic difficulty and the potential of QMR to produce high-quality information, were used. The effects of using QMR on three measures of physicians' diagnostic performance were analyzed using analyses of variance. RESULTS: Physicians' diagnostic performance was significantly higher (p < 0.01) on the easier cases and the cases for which QMR could provide higher-quality information. CONCLUSIONS: Physicians' diagnostic performance can be strongly influenced by the quality of information the system produces and the type of cases on which the system is used.

Influence of case and physician characteristics on perceptions of decision support systems.

OBJECTIVE: This study examines how characteristics of clinical cases and physician users relate to the users' perceptions of the usefulness of the Quick Medical Reference (QMR) and their confidence in their diagnoses when supported by the decision support system. METHODS: A national sample (N = 108) of 67 internists, 35 family physicians, and 6 other U.S. physicians used QMR to assist in the diagnosis of written clinical cases. Three sets of eight cases stratified by diagnostic difficulty and the potential of QMR to produce high-quality information were used. A 2 x 2 repeated-measures analysis of variance was used to test whether these factors were associated with perceived usefulness of QMR and physicians' diagnostic confidence after using QMR. Correlations were computed among physician characteristics, ratings of QMR usefulness, and physicians' confidence in their own diagnoses, and between usefulness or confidence and actual diagnostic performance. RESULTS: The analyses showed that QMR was perceived to be significantly more useful (P < 0.05) on difficult cases, on cases where QMR could provide high-quality information, by non-board-certified physicians, and when diagnostic confidence was lower. Diagnostic confidence was higher when comfort with using certain QMR functions was higher. The ratings of usefulness or diagnostic confidence were not consistently correlated with diagnostic performance. CONCLUSIONS: The results suggest that users' diagnostic confidence and perceptions of QMR usefulness may be associated more with their need for decision support than with their actual diagnostic performance when using the system. Evaluators may fail to find a diagnostic decision support system useful if only easy cases are tested, if correct diagnoses are not in the system's knowledge base, or when only highly trained physicians use the system.

Disability caused by work-related musculoskeletal disorders.

This article describes the magnitude, extent, and economic consequences of some of the more common, work-related musculoskeletal disorders. In addition, it provides a brief historic overview of the state-federal vocational rehabilitation program in the United States. It identifies and considers a constellation of risk factors for work-related disability because of musculoskeletal disorders, and it discusses phases of physical rehabilitation as that process relates to injured workers. The shifting disability paradigm is examined, and attention is given to terminology that has become fashionable since passage of the landmark Americans with Disabilities Act of 1990. Finally, various factors and conditions that often become barriers to an injured person's successful return to the workforce are briefly discussed.

Health outcome improvements in patients with systemic lupus erythematosus using two telephone counseling interventions.

OBJECTIVE: To examine the effectiveness of two telephone intervention strategies for improving the health outcomes of patients with systemic lupus erythematosus (SLE). METHODS: Fifty-eight SLE patients were randomly assigned to receive a 6-month telephone counseling intervention using either a treatment counseling (TC) or symptom monitoring (SM) strategy. Health outcomes were assessed using the Fatigue Severity Scale (FSS) and the Arthritis Impact Measurement Scales 2 (AIMS2). RESULTS: At the 6-month followup, the mean AIMS2 Physical Function scale and AIMS2 Social Support scale scores were significantly improved (P < 0.05) for the TC group compared to the SM groups. The mean FSS score, AIMS2 Affect score, and AIMS2 Pain score were significantly improved (P < 0.05) for both groups. CONCLUSIONS: Telephone interventions, especially using the TC approach, can be effective for improving the functional status of persons with SLE.

Impact of a colposcopy satellite clinic.

A community educational program and the introduction of a colposcope in Decatur, Alabama, led to a dramatic decrease in the relative percent of patients evaluated by conization after a positive Pap smear, and a corresponding increase in the relative percent of colposcopic evaluations. The percent of negative or dysplastic tissue diagnoses from conization was reduced from 78% before the colposcopy program to 61% after the program. It was estimated that the colposcopy program resulted in an 81% reduction in the number of conizations and that colposcopy used in lieu of conization resulted in a substantial reduction in both morbidity and cost.