Washington State's model of physician leadership in cardiac outcomes reporting.

BACKGROUND: In 1993, the cardiac surgery community in Washington State opposed an effort by the state Health Care Authority (HCA) to identify "centers of excellence" for selective contracting of coronary artery bypass grafting (CABG) procedures, and proposed an alternate model that would create a statewide cardiac outcomes registry under physician governance to be used by all institutions for internal quality improvement activities. METHODS: A prospective pilot data collection effort, which examined preoperative and postoperative patient-reported health status, served as the basis for evaluating the capacity of a physician-led organization to develop a collaborative atmosphere and facilitate universal hospital participation. RESULTS: A surgical steering group met on a regular basis and reached consensus on governance issues, protocols for standardized data collection, and policies regarding data dissemination. All 14 centers that performed bypass surgery in the state participated. Patients who were surveyed reported statistically significant improvements in physical, emotional, and anginal-specific health status after bypass surgery. Baseline patient characteristics and longitudinal outcomes were compared across institutions. CONCLUSIONS: Based on the feasibility of this collaborative outcomes reporting program, the HCA revised its policy regarding selective contracting and has helped to support an ongoing physician-led and -governed cardiac outcomes reporting system that is particularly notable for the subsequent integration of both CABG surgery and catheterization-based procedures into one standardized registry.

Analysis, assessment, and presentation of risk-adjusted statewide obstetrical care data: the StORQS II study in Washington State. Statewide Obstetrics Review and Quality System.

OBJECTIVE: To develop an effective, concise presentation of hospital-specific birth event and delivery-related complication rates, including significant deviations from expected rates calculated using risk-adjusted peer hospital data, for distribution to all Washington State hospitals with delivery services. DATA SOURCES: Complete data for calendar year 1993, including inpatient discharge records for mothers and newborns, birth certificates, and infant death records, for 74 hospitals from Washington state source files. STUDY DESIGN: Institutions were classified into four peer groups based on presence of neonatal intensive care units, number of births, and rural/urban location. Twenty-three clinical indicators of procedure (e.g., cesarean section) and complication rates were analyzed and presented. METHODS: For each indicator, observed and expected rates (adjusted within peer group for categorized baseline risk factors) were calculated and presented by institution. Effective graphic and numeric techniques for presenting significant deviations from expected rates were developed. Results were calculated in terms of numbers of events as well as rates. Approaches applicable to institutions with small numbers of deliveries were selected. PRINCIPAL FINDINGS: Exact confidence intervals (C.I.s) for event rates were superior to binomial or Poisson approximations for small hospitals. For calculating expected rates, indirect adjustment was used due to small numbers within risk factor categories. For all indicators, observed and expected rates along with 95 percent C.I.s for the true rate were presented graphically by institution for each peer group. Transforming C.I.s into "statistically acceptable ranges" allowed hospital personnel to assess their performance in terms of actual numbers of events as well as rates. CONCLUSIONS: Readily available statistical methods and straightforward descriptive approaches allow accurate presentation of outcomes for both large and small institutions.

Assessing compliance to antihypertensive medications using computer-based pharmacy records.

Systematic approaches for compliance problem detection and intervention are needed if the benefits of prescribed drug therapy in chronic disease management are to be optimized. As with all measures of compliance, computer algorithms based on refill patterns have advantages and disadvantages. They are unobtrusive and easily determined, but they measure the timeliness of prescription refills, not actual drug-taking. Computer-generated algorithms for assessing compliance based on refill patterns should be used by practitioners with caution, because they are not only markers for potential drug taking compliance problems, but also for discrepancies between the medical chart, pharmacy records and verbal advice given to the patient. Because patients may obtain refills before depleting their supply, compliance rates using this methodology are best determined across several refills. In particular, we urge caution in applying them over time periods of less than 60 days. Longer minimum time periods further decrease the likelihood of "false positives" but limit the number of patients for whom a compliance measure can be computed. For the health professional (eg, the pharmacist) responsible for monitoring drug-taking compliance of patients, the message seems clear: when reviewing computer-generated noncompliance "flags," the first task is to fully explore the possibility of discrepancies in drug records before initiating compliance-related interventions.

Correlates and effect of non-response in a postpartum survey of obstetrical care quality.

This study investigated the differences between unprompted respondents, prompted respondents, and non-respondents to a postpartum postal survey, and determined the likely impact of non-response on the accuracy of calculations of patient assessments of obstetrical care quality. Birth certificate and hospital discharge data were obtained for 1664 live births at three hospitals in Washington State between 8/91-10/91 and linked with 1268 completed postpartum maternal postal surveys. Non-white race, public insurance payer, unmarried status, and smoking in pregnancy were independent risk factors for non-participation. Among participants, non-white race, unmarried status, and having an infant who was low birthweight, preterm, or discharged late were independent risk factors for prompted response. The inclusion of prompted respondents did not substantially alter the calculated proportion of women rating obstetrical care quality as low, and these figures were similar to proportions estimated for the entire intended cohort using a modification of Drane's method. A one-time mailing of an obstetrical care quality survey can provide information similar to that obtained with more extensive follow-up even though substantial differences may exist between unprompted and prompted respondents, and with adjustment for factors related to non-participation and timing of response, it may be possible to obtain accurate estimation of outcome prevalences for the entire intended cohort.

Cost of comorbid alcohol and drug problems.

The authors measured the comorbid effect of alcohol and other drug (AOD) problems on medical, surgical, and psychiatric inpatient charges and length of stay (LOS) in an urban hospital by use of retrospective study of hospital clinical computer data comparing AOD-affected patients with non-AOD-affected patients in terms of cost, diagnostic, demographic, and utilization variables (N = 14,768). Patients were men and women with and without comorbid history of AOD problems, admitted for medical, surgical, and psychiatric reasons. For 10 of the 20 most frequent Diagnosis-Related Groups (DRGs), total hospital charges and LOS were significantly lower in patients with comorbid AOD problems (P < 0.001). Overall, for the most frequent 20 DRGs, total charges and LOS remained significantly lower for the AOD group. Most physicians believed that AOD-affected patients were often less ill than non-AOD patients within the same DRG. Alcohol/drug-affected patients had robustly lower costs and LOS. Fragmentation of psychosocial costs and addiction treatment from general health care and the fee-for-service DRG system appear to financially reward acute-care hospitals to repeatedly treat secondary AOD sequelae without providing any apparent incentives for the treatment of the primary alcohol/drug condition itself.

Meeting clinician information needs by integrating access to the medical record and knowledge resources via the Web.

MINDscape is a web based integrated interface to diverse sources of clinical information including both patient specific information (electronic medical record) as well as medical knowledge (the "digital library") to provide "just in time" information at the point of care. It was developed at the University of Washington to meet clinical information needs both as identified locally and by a review of the literature. Beta testing by over 600 clinicians is in progress and medical centers wide access scheduled for Fall 1997. We describe the information needs we sought to meet and the ongoing evaluation approach we are taking to ensure the information needs of a diverse group of clinicians are met. The iterative evolution of the interface from prototype, to alpha to large scale beta testing is reported. Integration of information occurs at three levels: integration of information by patient, integration of information by provider, and integration of patient specific information with medical reference material and decision support tools.

The adequacy of prenatal care and incidence of low birthweight among the poor in Washington State and British Columbia.

OBJECTIVES: The purpose of this study was to examine differences in adequacy of prenatal care and incidence of low birthweight between low-income women with Medicaid in Washington State and low-income women with Canadian provincial health insurance in British Columbia. METHODS: A population-based cross-sectional study was done by using linked birth certificates and claims data. RESULTS: Overall, the adjusted odds ratio for inadequate prenatal care in Washington (comparing women with Medicaid with those with private insurance) was 3.2. However, the risk varied by time of Medicaid enrollment relative to pregnancy (2.0, 1.0, 2.7, 6.3; for women who enrolled prior to pregnancy, during the first trimester, during the second trimester, or during the third trimester, respectively). In British Columbia, the adjusted odds ratio for inadequate care (comparing women receiving a health premium subsidy with those receiving no subsidy) was 1.5 for women receiving a 100% subsidy and 1.2 for women receiving a 95% subsidy. The risk for low birthweight followed a similar trend in both regions, but there was no association with enrollment period in Washington. CONCLUSIONS: Overall, the risk for inadequate prenatal care among poor women was much greater in Washington than in British Columbia. Most of the difference was due to Washington women's delayed enrollment in Medicaid. In both regions, the poor were at similar risk for low birthweight relative to their more affluent counterparts.

Effect of changes in maternal age, parity, and birth weight distribution on primary cesarean delivery rates.

OBJECTIVE: To examine the effect of maternal age on cesarean delivery risk and to quantify the impact of demographic changes since 1970 on primary cesarean delivery rates. DESIGN: A cohort study. SETTING: Nonfederal short-stay hospitals in Washington State. PARTICIPANTS: All women who delivered live singletons with linked birth certificate and hospital discharge data from 1987 through 1990. MAIN OUTCOME MEASURES: Maternal age-, birth weight-, and parity-specific primary cesarean delivery rates, Mantel-Haenszel relative risk estimates for primary cesarean delivery by 5-year age category stratified by parity, and direct standardization of 1987 through 1990 primary cesarean rates to 1970 Washington State maternal age, birth weight, and parity distribution. RESULTS: Primary cesarean rates ranged from 3.2% for multiparous teenage women who delivered infants weighing 3500 g through 3999 g to 58.9% for primiparous women 40 years of age or older who delivered infants weighing 4000 g or more. After adjustment, the risk of cesarean delivery increased with each 5-year age increment among women 20 years of age or older. We estimated that if the maternal age, parity, and birth weight distribution from 1987 through 1990 were identical to what existed in 1970, Washington State's primary cesarean rate from 1987 through 1990 would have been 12.2%, compared with the observed rate of 14.8%. CONCLUSION: The lower adjusted primary cesarean rate reflects the demographic changes in the childbearing population, which may be responsible for 18% of the 1987 through 1990 cesarean delivery rates. These findings suggest the importance of using maternal age-, birth weight-, and parity-specific primary cesarean delivery rates to compare populations and study temporal trends.

Comparison of prescription and medical records in reflecting patient antihypertensive drug therapy.

OBJECTIVE: To determine the completeness of prescription records, and the extent to which they agreed with medical record drug entries for antihypertensive medications. SETTING: Three clinics affiliated with two staff model health maintenance organizations (HMOs). PARTICIPANTS: Randomly selected HMO enrollees (n = 982) with diagnosed hypertension. METHODS: Computer-based prescription records for antihypertensive medications were reviewed at each location using an algorithm to convert the directions-for-use codes into an amount to be consumed per day (prescribed daily dosage). The medical record was analyzed similarly for the presence of drug notations and directions for use. RESULTS: There was a high level of agreement between the medical record and prescription file with respect to identifying the drug prescribed by drug name. Between 5 and 14 percent of medical record drug entries did not have corresponding prescription records, probably reflecting patient decisions not to have prescriptions filled at HMO-affiliated pharmacies or at all. Further, 5-8 percent of dispensed prescription records did not have corresponding medical record drug entry notations, probably reflecting incomplete recording of drug information on the medical record. The percentage of agreement of medical records on dosage ranged from 68 to 70 percent across two sites. Approximately 14 percent of drug records at one location and 21 percent of records at the other had nonmatching dosage information, probably reflecting dosage changes noted on the medical record but not reflected on pharmacy records. CONCLUSIONS: In the sites studied, dispensed prescription records reasonably reflect chart drug entries for drug name, but not necessarily dosage.

Variations in the accuracy of obstetric procedures and diagnoses on birth records in Washington State, 1989.

The authors abstracted a sample of 7,536 hospital medical records to validate the accuracy of the coding of obstetric information on 1) birth certificates, 2) a statewide computerized hospital discharge abstract data system, and 3) a linked file merging birth certificates and the hospital abstract data for Washington State deliveries occurring in 1989. Measures of accuracy of coding of delivery method and obstetric procedures varied greatly among the 23 hospitals that participated in the study. Computerized hospital discharge data were generally more complete and accurate than were birth certificate data. The linked file was more likely to identify obstetric procedures than was either source alone. For example, only 84.1% of cesarean deliveries noted in the hospital charts were identified on birth certificates (range among hospitals, 37-100%). Using the linked file, the authors identified 99.8% of cesarean deliveries (range, 97-100%). Linked birth certificate-hospital abstract files may become an excellent source of data for epidemiologic and health care studies; however, further training of medical record personnel and standardization of coding are needed to improve the quality of computerized data on obstetric events.

Use of peer ratings to evaluate physician performance.

OBJECTIVE: To assess the feasibility and measurement characteristics of ratings completed by professional associates to evaluate the performance of practicing physicians. DESIGN: The clinical performance of physicians was evaluated using written questionnaires mailed to professional associates (physicians and nurses). Physician-associates were randomly selected from lists provided by both the subjects and medical supervisors, and detailed information was collected concerning the professional and social relationships between the associate and the subject. Responses were analyzed to determine factors that affect ratings and measurement characteristics of peer ratings. SETTING AND PARTICIPANTS: Physician-subjects were selected from among practicing internists in New York, New Jersey, and Pennsylvania who received American Board of Internal Medicine certification 5 to 15 years previously. MAIN OUTCOME MEASURE: Physician performance as assessed by peers. RESULTS: Peer ratings are not biased substantially by the method of selection of the peers or the relationship between the rater and the subject. Factor analyses suggest a two-dimensional conceptualization of clinical skills: one factor represents cognitive and clinical management skills and the other factor represents humanistic qualities and management of psychosocial aspects of illness. Ratings from 11 peer physicians are needed to provide a reliable assessment in these two areas. CONCLUSIONS: These findings suggest that it is feasible to obtain assessments from professional associates of practicing physicians in areas such as clinical skills, humanistic qualities, and communication skills. Using a shorter version of the questionnaire used in this study, peer ratings provide a practical method to assess clinical performance in areas such as humanistic qualities and communication skills that are difficult to assess with other measures.

Trends in the utilization of mammography in Washington state and British Columbia: relation to stage of diagnosis and mortality.

To compare the utilization of an imaging technology in the United States and Canada and its effect on clinical outcomes, trends in the utilization of mammography among women aged 50 to 75 years from 1984 through 1988 in Washington State and British Columbia were examined. Also compared were trends in the stage at time of diagnosis of invasive breast cancer and mortality due to breast cancer in the two regions. Annual mammography use increased in both regions, but the proportion of women examined was consistently two to three times higher in Washington than in British Columbia (43% vs 16% in 1988). Although there was no difference in mortality trends, the proportion of women diagnosed with localized disease in Washington increased each year (from 52% to 64%, P less than .001), while in British Columbia it remained unchanged at approximately 56%. Results of this study suggest that differences in utilization were influenced by clinical policies, the degree to which these policies were promoted, reimbursement, and the organization of radiology services.

Medicaid prenatal care: a comparison of use and outcomes in fee-for-service and managed care.

BACKGROUND: To control rising costs, state Medicaid agencies are enrolling recipients in managed care health plans (MCPs). We performed this study to assess this policy's impact on accessibility and outcomes of Medicaid-funded prenatal care. METHODS: We performed a retrospective, controlled study with three cohorts: a study group of 1106 Medicaid recipients enrolled in three MCPs, a matched comparison group of 4830 recipients receiving care in the fee-for-service (FFS) system, and a second matched comparison group of 4434 non-Medicaid enrollees of the same MCPs. Data on prenatal care use and birth outcomes were obtained through linkage of claims and discharge files with birth certificate files. RESULTS: Medicaid recipients enrolled in MCPs used prenatal care similarly to those in the FFS system and showed equal or modestly improved birth-weight distributions. However, Medicaid MCP enrollees showed poorer use of prenatal care and birth outcomes compared with non-Medicaid enrollees of the same plans. CONCLUSIONS: Enrollment in MCPs has a neutral or small beneficial effect on the prenatal care received by the Medicaid population. However, providing financial access and modifying the system of care for this population did not result in parity with the general population.

The Health of the Public Program at the University of Washington: a new role for academic medical centers.

The University of Washington Health of the Public Program has convened a consortium composed of the region's academic medical center, the two largest managed care plans in Washington, and representatives of the state's major private and public purchasers of health care. The consortium's purpose is to test the feasibility of collaboratively collecting cross-system data, assessing variations in practice, and implementing site-specific interventions to improve the management of common illnesses and encourage preventive care. Changes under way in the ambulatory training environment and in the undergraduate curriculum as a result of the consortium's initial efforts are described. In today's climate of cost consciousness and concerns about quality, academic medical centers can play an important role in helping to improve community-wide outcomes of care.

Changes over time in the knowledge base of practicing internists.

OBJECTIVE: To determine factors affecting the knowledge base of practicing internists. DESIGN: An 82-item multiple-choice examination with questions from the 1988 American Board of Internal Medicine (ABIM) certifying examination was used to assess the knowledge base of 289 internists. SETTING AND PARTICIPANTS: Participants were selected from among practicing internists in New York, New Jersey, and Pennsylvania who had received ABIM certification 5 to 15 years previously. RESULTS: significant inverse correlation (r = -.30) was found between examination scores and the number of years elapsed since certification. Knowledge declined sharply within 15 years of certification. In addition, procedure-oriented subspecialists (cardiologists and gastroenterologists) had lower scores than other internists in this examination of general medical knowledge. Multivariate analyses showed that independent variables that predicted test performance were initial ABIM certifying examination score, time elapsed since certification, subspecialty classification, medical school type, and residency type. CONCLUSIONS: These results support the recent decision for time-limited certification of internists and raise questions related to content and standard setting for recertification examinations.

An approach to several problems in using large databases for population-based case-control studies of the therapeutic efficacy and safety of anti-hypertensive medicines.

In this paper we discuss approaches to two distinct problems in using large computerized databases to conduct population-based case-control studies. The first topic, concerning case ascertainment, is a methodologic problem, and the second, concerning confounding by indication, is an analytic problem. The first involves attempting to ascertain all incident cases of coronary disease among enrollees of Group Health Cooperative of Puget Sound (GHC), a large health-maintenance organization. Methodologic studies reported here have helped us improve the efficiency of using the large computerized databases for case ascertainment at GHC. The second problem involves the issue of confounding by drug indication. Drugs such as beta-blockers have multiple indications, including the treatment of both high blood pressure and angina. These two indications may make it difficult in an observational study to determine whether beta-blockers may prevent coronary disease in patients with high blood pressure. We discuss here our current thinking about the best analytic approach to this problem.

Beta blockers and the primary prevention of nonfatal myocardial infarction in patients with high blood pressure.

A population-based, case-control study was conducted to determine whether beta blockers, used for the treatment of high blood pressure, prevent first events of coronary heart disease. All study subjects were health-maintenance organization enrollees with pharmacologically treated hypertension. Patients presented in 1982 to 1984 with new coronary heart disease, and control subjects were a probability sample of eligible hypertensive enrollees free of coronary heart disease. With the investigators blind to case-control status, the subjects' medical records were reviewed for other coronary risk factors, and the health-maintenance organization's computerized pharmacy database was used to ascertain the use of beta blockers. A larger proportion of controls than cases were using beta blockers. This difference was confined to the subgroup with nonfatal myocardial infarctions. For current use, the estimated relative risk for nonfatal myocardial infarction was 0.62 (95% confidence interval, 0.39 to 0.99). Among current users of beta blockers, higher doses conferred greater protection. Past use and total lifetime intake of beta blockers were only weakly associated with case-control status. The current use of beta blockers may prevent first events of nonfatal myocardial infarction in patients with high blood pressure.

The relation of obstetrical volume and nursery level to perinatal mortality.

We investigated the relation of hospital delivery volume and nursery technology level to perinatal outcome in 226,164 White singleton births in Washington State, 1980-83. Level III facilities (neonatal intensive care unit) were defined by the state licensing commission. We defined the Level II (intermediate) and Level I (normal newborn) facilities using published criteria. Infants under 2000 gm born in Level III facilities had half the risk of perinatal death compared to those born in a Level I or II facility. No significant improvement was noted among level or volume groupings for normal birthweight infants. A loglinear regression model of hospital perinatal death rates showed that when birthweight and maternal risk were controlled, obstetrical volume added minimal explanatory power to level of nursery care.