Disparities Associated with Decision to Undergo Oncologic Surgery: A Prospective Mixed-Methods Analysis.

BACKGROUND: Underrepresented minority patients with surgical malignancies experience disparities in outcomes. The impact of provider-based factors, including communication, trust, and cultural competency, on outcomes is not well understood. This study examines modifiable provider-based barriers to care experienced by patients with surgical malignancies. METHODS: A parallel, prospective, mixed-methods study enrolled patients with lung or gastrointestinal malignancies undergoing surgical consultation. Surveys assessed patients' social needs and patient-physician relationship. Semi-structured interviews ascertained patient experiences and were iteratively analyzed, identifying key themes. RESULTS: The cohort included 24 patients (age 62 years; 63% White and 38% Black/African American). The most common cancers were lung (n = 18, 75%) and gastroesophageal (n = 3, 13%). Survey results indicated that food insecurity (n = 5, 21%), lack of reliable transportation (n = 4, 17%), and housing instability (n = 2, 8%) were common. Lack of trust in their physician (n = 3, 13%) and their physician's treatment recommendation (n = 3, 13%) were identified. Patients reported a lack of empathy (n = 3, 13%), lack of cultural competence (n = 3, 13%), and inadequate communication (n = 2, 8%) from physicians. Qualitative analysis identified five major themes regarding the decision to undergo surgery: communication, trust, health literacy, patient fears, and decision-making strategies. Five patients (21%) declined the recommended surgery and were more likely Black (100% vs. 21%), lower income (100% vs. 16%), and reported poor patient-physician relationship (40% vs. 5%; all p < 0.05). CONCLUSIONS: Factors associated with declining recommended cancer surgery were underrepresented minority race and poor patient-physician relationships. Interventions are needed to improve these barriers to care and racial disparities.

Andragogy in Practice: Applying a Theoretical Framework to Team Science Training in Biomedical Research.

This study is the first to apply the theoretical principles of Malcolm Knowles' theory of andragogy to evaluate data collected from learners who participated in team science training workshops in a biomedical research setting. Briefly, andragogy includes six principles: the learner's self-concept, the role of experience, readiness to learn, orientation to learning, the learner's need to know, and intrinsic motivation. Using an embedded study design, the primary focus was on qualitative data, with quantitative data complementing the qualitative findings. The deductive analysis demonstrated that approximately 85% of the qualitative data could be connected to at least one andragogical principle. Participant responses to positive evaluation questions were largely related to two principles: readiness to learn and problem-based learning orientation. Participant responses to negative questions were largely connected to two different principles: the role of experience and self-direction. Inductive analysis found an additional theme: meeting biological needs. Quantitative survey results supported the qualitative findings. The study findings demonstrate that andragogy can serve as a valuable construct to integrate into the development of effective team science training for biomedical researchers.

Can a best practice advisory improve anticoagulation prescribing to reduce stroke risk in patients with atrial fibrillation?

BACKGROUND: Atrial fibrillation (AF) is the most common cardiac rhythm disorder and a risk factor for stroke. Randomized trials have demonstrated that anticoagulation can reduce strokes in AF patients. Yet, widespread underutilization of this therapy continues. To address this practice gap, we designed a study to implement and evaluate the effectiveness of a best practice advisory (BPA) for an Atrial Fibrillation Decision Support Tool (AFDST) embedded within our electronic health record. METHODS: Our intervention is provider-facing, focused on decision support. Clinical setting is ambulatory patients being seen by primary care physicians. We prospectively enrolled 608 patients in our health system who are currently receiving less than optimal anticoagulation therapy as determined by the AFDST and randomized them to one of two arms - 1) usual care, in which the AFDST is available for use; or 2) addition of a BPA to the AFDST notifying clinicians that their patient stands to gain significant benefit from a change in current therapy. Primary outcome was effectiveness of the BPA measured by change to "appropriate thromboprophylaxis" based on the AFDST recommendation at 3 months post-enrollment. Secondary endpoints included Reach and Adoption from the RE-AIM (Reach, Effectiveness, Adoption, Implementation, & Maintenance) framework for implementation studies. RESULTS: Among 562 patients with a minimum follow-up of 3 months, addition of a BPA to the AFDST resulted in significant improvement in anticoagulation therapy, 5 % (12/248) versus 11 % (33/314) p = 0.02, odds ratio 2.31 (95 % CI, 1.17-4.87). CONCLUSIONS: A BPA added to an AF decision support tool improved anticoagulation therapy among AF patients in a primary care academic health system setting.

Lung cancer screening utilization rate varies based on patient, provider, and hospital factors.

OBJECTIVE: Low-dose computed tomography has been proven to reduce mortality, yet utilization remains low. The purpose of this study is to identify factors that impact the utilization of lung cancer screening. METHODS: We performed a retrospective review of our institution's primary care network from November 2012 to June 2022 to identify patients who were eligible for lung cancer screening. Eligible patients were 55 to 80 years of age and current or former smokers with at least a 30 pack-year history. Analyses were performed on the screened populations and patients who met eligibility criteria but were not screened. RESULTS: A total of 35,279 patients in our primary care network were current/former smokers aged 55 to 80 years. A total of 6731 patients (19%) had a 30 pack-year or more cigarette history, and 11,602 patients (33%) had an unknown pack-year history. A total of 1218 patients received low-dose computed tomography. The utilization rate of low-dose computed tomography was 18%. The utilization rate was significantly lower (9%) if patients with unknown pack-year history were included (P < .001). The utilization rates between primary care clinic locations were significantly different (range, 18% vs 41%, P < .05). Utilization of low-dose computed tomography on multivariate analysis was associated with Black race, former smoker, chronic obstructive pulmonary disease, bronchitis, family history of lung cancer, and number of primary care visits (all P < .05). CONCLUSIONS: Lung cancer screening utilization rates are low and vary significantly on the basis of patient comorbidities, family history of lung cancer, primary care clinic location, and accurate documentation of pack-year cigarette history. The development of programs to address patient, provider, and hospital-level factors is needed to ensure appropriate lung cancer screening.

COVID-19 Vaccine Hesitancy: A Critical Time Period Analysis.

The COVID-19 pandemic has been a devastating, global public health crisis. Public health systems in the United States heavily focused on getting people to adhere to preventive behaviors, and later, to get vaccinated. January through May of 2021 was a critical and volatile time period for COVID-19 cases, deaths, and expanding vaccination programs coinciding with important political and social events which will have a lasting impact on how the public views science, places trust in our government, and views individual rights. Having collected almost 1400 surveys, our goal was to assess vaccine behavior, explore attitudes toward receiving the vaccine, and identify trusted information sources. More than 83% of our survey respondents said they were at least partially vaccinated. Of 246 unvaccinated, 31.3% were somewhat or extremely likely to get vaccinated when available. Their two most common concerns were vaccine effectiveness (41.1%) and safety (40.2%). Significant differences were observed between respondents who were likely to be vaccinated in the future and those who were hesitant on three of five demographic variables. Our data provide unique insight into the history of behavior and motivations related to COVID-19 vaccines-what will be seen as a "wicked problem" for years to come.

Electronic health record-embedded decision support to reduce stroke risk in patients with atrial fibrillation - Study protocol.

BACKGROUND: Atrial fibrillation (AF) is the most common significant cardiac rhythm disorder and is a powerful common risk factor for stroke. Randomized trials have demonstrated that anticoagulation can reduce the risk of stroke in patients with AF. Yet, there continues to be widespread underutilization of this therapy. To address this practice gap locally and improve efforts to reduce the risk of stroke for patients with AF in our health system, we have designed a study to implement and evaluate the effectiveness of an Atrial Fibrillation Decision Support Tool (AFDST) embedded within our electronic health record. METHODS: Our intervention is provider-facing and focused on decision support. The clinical setting is ambulatory patients being seen by primary care physicians. Patients include those with both incident and prevalent AF. This randomized, prospective trial will enroll 800 patients in our University of Cincinnati Health System who are currently receiving less than optimal anticoagulation therapy as determined by the AFDST. Patients will be randomized to one of two arms - 1) usual care, in which the AFDST is available for use; 2) addition of a best practice advisory (BPA) to the AFDST notifying the clinician that their patient stands to gain a significant benefit from a change in their current thromboprophylactic therapy. RESULTS: The primary outcome is effectiveness of the BPA measured by change to "appropriate thromboprophylaxis" based on the AFDST recommendation at 3 months post randomization. Secondary endpoints include Reach and Adoption, from the RE-AIM framework for implementation studies. Sample size is based upon an improvement from inappropriate to appropriate anticoagulation therapy estimated at 4% in the usual care arm and ≥10% in the experimental arm. CONCLUSION: Our goal is to examine whether addition of a BPA to an AFDST focused on primary care physicians in an ambulatory care setting will improve "appropriate thromboprophylaxis" compared with usual care. Results will be examined at 3 months post randomization and at the end of the study to evaluate durability of changes. We expect to complete patient enrollment by the end of June 2022. TRIAL REGISTRATION: Clinicaltrials.gov NCT04099485.

Racial and sex differences in optimizing anticoagulation therapy for patients with atrial fibrillation.

Study objective: Atrial fibrillation (AF) is the most common cardiac rhythm disorder, responsible for 15 % of strokes in the United States. Studies continue to document underuse of anticoagulation therapy in minority populations and women. Our objective was to compare the proportion of AF patients by race and sex who were receiving non-optimal anticoagulation as determined by an Atrial Fibrillation Decision Support Tool (AFDST). Design setting and participants: Retrospective cohort study including 14,942 patients within University of Cincinnati Health Care system. Data were analyzed between November 18, 2020, and November 20, 2021. Main outcomes and measures: Discordance between current therapy and that recommended by the AFDST. Results: In our two-category analysis 6107 (41 %) received non-optimal anticoagulation therapy, defined as current treatment category ≠ AFDST-recommended treatment category. Non-optimal therapy was highest in Black (42 % [n = 712]) and women (42 % [n = 2668]) and lower in White (39 % [n = 4748]) and male (40 % [n = 3439]) patients. Compared with White patients, unadjusted and adjusted odds ratios of receiving non-optimal anticoagulant therapy for Black patients were 1.13; 95 % CI, 1.02-1.30, p = 0.02; and 1.17; 95%CI, 1.04-1.31, p = 0.01; respectively, and 1.10; 95 % CI 1.03-1.18, p = 0.005; and 1.36; 95 % CI, 1.25-1.47, p < 0.001; for females compared with males. Conclusions and relevance: In patients with atrial fibrillation in the University of Cincinnati Health system, Black race and female sex were independently associated with an increased odds of receiving non-optimal anticoagulant therapy.

Shared decision-making tool for thromboprophylaxis in atrial fibrillation - A feasibility study.

BACKGROUND: Appropriate thromboprophylaxis for patients with atrial fibrillation or atrial flutter (AF) remains a national challenge. METHODS: We hypothesized that a shared decision-making interaction facilitated by an Atrial Fibrillation Shared Decision Making Tool (AFSDM) would improve patient knowledge about atrial fibrillation, and the risks and benefits of various treatment options for stroke prevention; increase satisfaction with the decision-making process; improve the therapeutic alliance between patient and the clinical care team; and increase medication adherence. Using a pre- and post-visit study design, we enrolled 76 patients and completed 2 office visits and 1-month telephone follow-up for 65 patients being seen in our Arrhythmia Clinic over the 1-year period (July 2016 through June 2017). Our primary outcome measure was change in decisional conflict between the first and second clinical visit. RESULTS: Decisional conflict decreased from an average of 31 to 9. Mean change was 22.3 (95% CI, 25.7 - 37.1), corresponding to an effect size of 0.94 standard deviations. Satisfaction with decision increased from 4.0 to 4.5, measures of therapeutic alliance with the care team (Kim Alliance scale) increased from 100.1 to 103.1, and satisfaction with provider increased from 4.2 to 4.5 (P < .0001 for all measures). AF knowledge assessment scores increased from 8.4 to 9.1, and knowledge about personal stroke and bleeding risk increased from 1 to 1.5 (P < .0001). Finally, medication adherence improved as reflected by an increase in the Morisky Medication Adherence scale from 5.9 to 6.4 (P < .0001). CONCLUSIONS: A shared decision-making interaction, facilitated by an AFSDM can significantly improve multiple measures of decision-making quality, leading to improved medication adherence and patient satisfaction.

Atrial fibrillation decision support tool: Population perspective.

BACKGROUND: Appropriate thromboprophylaxis for patients with atrial fibrillation or atrial flutter (AF) remains a national challenge. The recent availability of direct oral anticoagulants (DOACs) with comparable efficacy and improved safety compared with warfarin alters the balance between risk factors for stroke and benefit of anticoagulation. Our objective was to examine the impact of DOACs as an alternative to warfarin on the net benefit of oral anticoagulant therapy (OAT) in a real-world population of AF patients. METHODS: This is a retrospective cohort study of patients with paroxysmal or persistent nonvalvular AF. We updated an Atrial Fibrillation Decision Support Tool (AFDST) to include DOACs as treatment options. The tool generates patient-specific recommendations based upon individual patient risk factor profiles for stroke and major bleeding using quality-adjusted life-years (QALYs) calculated for each treatment strategy by a decision analytic model. The setting included inpatient and ambulatory sites in an academic health center in the midwestern United States. The study involved 5,121 adults with nonvalvular AF seen for any ambulatory visit or inpatient hospitalization over the 1-year period (January through December 2016). Outcome measure was net clinical benefit in QALYs. RESULTS: When DOACs are a therapeutic option, the AFDST recommends OAT for 4,134 (81%) patients and no antithrombotic therapy or aspirin for 489 (9%). A strong recommendation for OAT could not be made in 498 (10%) patients. When warfarin is the only option, OAT is recommended for 3,228 (63%) patients and no antithrombotic therapy or aspirin for 973 (19%). A strong recommendation for OAT could not be made in 920 (18%) patients. In total, 1,508 QALYs could be gained if treatment were changed to that recommended by the AFDST. CONCLUSIONS: Availability of DOACs increases the proportion of patients for whom oral anticoagulation therapy is recommended in a real-world cohort of AF patients and increased projected QALYs by more than 1,500 when all patients are receiving thromboprophylaxis as recommended by the AFDST compared with current treatment.

Pilot Integration of HIV Screening and Healthcare Settings with Multi- Component Social Network and Partner Testing for HIV Detection.

BACKGROUND: Healthcare settings screen broadly for HIV. Public health settings use social network and partner testing ("Transmission Network Targeting (TNT)") to select high-risk individuals based on their contacts. HIV screening and TNT systems are not integrated, and healthcare settings have not implemented TNT. OBJECTIVE: The study aimed to evaluate pilot implementation of multi-component, multi-venue TNT in conjunction with HIV screening by a healthcare setting. METHODS: Our urban, academic health center implemented a TNT program in collaboration with the local health department for five months during 2011. High-risk or HIV positive patients of the infectious diseases clinic and emergency department HIV screening program were recruited to access social and partner networks via compensated peer-referral, testing of companions present with them, and partner notification services. Contacts became the next-generation index cases in a snowball recruitment strategy. RESULTS: The pilot TNT program yielded 485 HIV tests for 482 individuals through eight generations of recruitment with five (1.0%; 95% CI = 0.4%, 2.3%) new diagnoses. Of these, 246 (51.0%; 95% CI = 46.6%, 55.5%) reported that they had not been tested for HIV within the last 12 months and 383 (79.5%; 95% CI = 75.7%, 82.9%) had not been tested by the existing ED screening program within the last five years. CONCLUSION: TNT complements population screening by more directly targeting high-risk individuals and by expanding the population receiving testing. Information from existing healthcare services could be used to seed TNT programs, or TNT could be implemented within healthcare settings. Research evaluating multi-component, multi-venue HIV detection is necessary to maximize complementary approaches while minimizing redundancy.

Impact of an Atrial Fibrillation Decision Support Tool on thromboprophylaxis for atrial fibrillation.

BACKGROUND: Appropriate thromboprophylaxis for patients with atrial fibrillation (AF) remains a national challenge. METHODS: We hypothesized that provision of decision support in the form of an Atrial Fibrillation Decision Support Tool (AFDST) would improve thromboprophylaxis for AF patients. We conducted a cluster randomized trial involving 15 primary care practices and 1,493 adults with nonvalvular AF in an integrated health care system between April 2014 and February 2015. Physicians in the intervention group received patient-level treatment recommendations made by the AFDST. Our primary outcome was the proportion of patients with antithrombotic therapy that was discordant from AFDST recommendation. RESULTS: Treatment was discordant in 42% of 801 patients in the intervention group. Physicians reviewed reports for 240 patients. Among these patients, thromboprophylaxis was discordant in 63%, decreasing to 59% 1 year later (P = .02). In nonstratified analyses, changes in discordant care were not significantly different between the intervention group and control groups. In multivariate regression models, assignment to the intervention group resulted in a nonsignificant trend toward decreased discordance (P = .29), and being a patient of a resident physician (P = .02) and a higher HAS-BLED score predicted decreased discordance (P = .03), whereas female gender (P = .01) and a higher CHADSVASc score (P = .10) predicted increased discordance. CONCLUSIONS: Among patients whose physicians reviewed recommendations of the decision support tool discordant therapy decreased significantly over 1 year. However, in nonstratified analyses, the intervention did not result in significant improvements in discordant antithrombotic therapy.

Dissemination of Evidence From Systematic Reviews Through Academic CME Providers: A Feasibility Study.

INTRODUCTION: Although systematic reviews represent a source of best evidence to support clinical decision-making, reviews are underutilized by clinicians. Barriers include lack of awareness, familiarity, and access. Efforts to promote utilization have focused on reaching practicing clinicians, leaving unexplored the roles of continuing medical education (CME) directors and faculty in promoting systematic review use. This study explored the feasibility of working with CME directors and faculty for that purpose. METHODS: A convenience sample of five academic CME directors and faculty agreed to participate in a feasibility study exploring use in CME courses of systematic reviews from the Agency for Healthcare Research and Quality (AHRQ-SRs). AHRQ-SR topics addressed the comparative effectiveness of health care options. Participants received access to AHRQ-SR reports, associated summary products, and instructional resources. The feasibility study used mixed methods to assess 1) implementation of courses incorporating SR evidence, 2) identification of facilitators and barriers to integration, and 3) acceptability to CME directors, faculty, and learners. RESULTS: Faculty implemented 14 CME courses of varying formats serving 1700 learners in urban, suburban, and rural settings. Facilitators included credibility, conciseness of messages, and availability of supporting materials; potential barriers included faculty unfamiliarity with SRs, challenges in maintaining review currency, and review scope. SR evidence and summary products proved acceptable to CME directors, course faculty, and learners by multiple measures. DISCUSSION: This study demonstrates the feasibility of approaches to use AHRQ-SRs in CME courses/programming. Further research is needed to demonstrate generalizability to other types of CME providers and other systemic reviews.

Using an Atrial Fibrillation Decision Support Tool for Thromboprophylaxis in Atrial Fibrillation: Effect of Sex and Age.

OBJECTIVES: To assess the appropriateness of oral anticoagulant therapy (OAT) in women and elderly adults, looking for patterns of undertreatment or unnecessary treatment. DESIGN: Retrospective cohort study. SETTING: Primary care practices of an academic healthcare system. PARTICIPANTS: Adults (aged 28-93) with nonvalvular atrial fibrillation (AF) seen between March 2013 and February 2014 (N = 1,585). MEASUREMENTS: Treatment recommendations were made using an AF decision support tool (AFDST) based on projections of quality-adjusted life expectancy calculated using a decision analytical model that integrates individual-specific risk factors for stroke and hemorrhage. RESULTS: Treatment was discordant from AFDST-recommended treatment in 45% (326/725) of women and 39% (338/860) of men (P = .02). Although current treatment was discordant from recommended in 35% (89/258) of participants aged 85 and older and in 43% (575/1,328) of those younger than 85 (P = .01), many undertreated elderly adults were receiving aspirin as the sole antithrombotic agent. CONCLUSION: Physicians should understand that female sex is a significant risk factor for AF-related stroke and incorporate this into decision-making about thromboprophylaxis. Treating older adults with aspirin instead of OAT exposes them to significant risk of bleeding with little to no reduction in AF-related stroke risk.

Developing an Atrial Fibrillation Guideline Support Tool (AFGuST) for shared decision making.

OBJECTIVE: Patient values and preferences are an important component to decision making when tradeoffs exist that impact quality of life, such as tradeoffs between stroke prevention and hemorrhage in patients with atrial fibrillation (AF) contemplating anticoagulant therapy. Our objective is to describe the development of an Atrial Fibrillation Guideline Support Tool (AFGuST) to assist the process of integrating patients' preferences into this decision. MATERIALS AND METHODS: CHA2DS2VASc and HAS-BLED were used to calculate risks for stroke and hemorrhage. We developed a Markov decision analytic model as a computational engine to integrate patient-specific risk for stroke and hemorrhage and individual patient values for relevant outcomes in decisions about anticoagulant therapy. RESULTS: Individual patient preferences for health-related outcomes may have greater or lesser impact on the choice of optimal antithrombotic therapy, depending upon the balance of patient-specific risks for ischemic stroke and major bleeding. These factors have been incorporated into patient-tailored booklets which, along with an informational video, were developed through an iterative process with clinicians and patient focus groups. KEY LIMITATIONS: Current risk prediction models for hemorrhage, such as the HAS-BLED, used in the AFGuST, do not incorporate all potentially significant risk factors. Novel oral anticoagulant agents recently approved for use in the United States, Canada, and Europe have not been included in the AFGuST. Rather, warfarin has been used as a conservative proxy for all oral anticoagulant therapy. CONCLUSIONS: We present a proof of concept that a patient-tailored decision-support tool could bridge the gap between guidelines and practice by incorporating individual patient's stroke and bleeding risks and their values for major bleeding events and stroke to facilitate a shared decision making process. If effective, the AFGuST could be used as an adjunct to published guidelines to enhance patient-centered conversations about the anticoagulation management.

Integrating real-time clinical information to provide estimates of net clinical benefit of antithrombotic therapy for patients with atrial fibrillation.

BACKGROUND: Guidelines for anticoagulant therapy in patients with atrial fibrillation are based on stroke risk as calculated by either the CHADS2 or the CHA2DS2VASc scores and do not integrate bleeding risk in an explicit, quantitative manner. Our objective was to quantify the net clinical benefit resulting from improved decision making about antithrombotic therapy. METHODS AND RESULTS: This study is a retrospective cohort study of 1876 adults with nonvalvular atrial fibrillation or flutter seen in primary care settings of an integrated healthcare delivery system between December 2012 and January 2014. Projections for quality-adjusted life expectancy reported as quality-adjusted life-years were calculated by a decision analytic model that integrates patient-specific risk factors for stroke and hemorrhage and examines strategies of no antithrombotic therapy, aspirin, or oral anticoagulation with warfarin. Net clinical benefit was defined by the gain or loss in quality-adjusted life expectancy between current treatment and treatment recommended by an Atrial Fibrillation Decision Support Tool. Current treatment was discordant from treatment recommended by the Atrial Fibrillation Decision Support Tool in 931 patients. A clinically significant gain in quality-adjusted life expectancy (defined as ≥0.1 quality-adjusted life-years) was projected in 832 patients. Subgroups were examined. For example, oral anticoagulant therapy was recommended for 188 who currently were receiving no antithrombotic therapy. For the entire cohort, a total of 736 quality-adjusted life-years could be gained were treatment changed to that recommended by the Atrial Fibrillation Decision Support Tool. CONCLUSIONS: Use of a decision support tool that integrates patient-specific stroke and bleeding risk could result in significant gains in quality-adjusted life expectancy for a primary care population of patients with atrial fibrillation.

The long-term impact of a performance improvement continuing medical education intervention on osteoporosis screening.

INTRODUCTION: The purpose of this study is to determine whether a performance improvement continuing medical education (PI CME) initiative that utilizes quality improvement (QI) principles is effective in producing sustainable change in practice to improve the screening of patients at risk for osteoporosis. METHODOLOGY: A health care center participated in a PI CME program designed to increase appropriate osteoporosis screening. There were eight 1-hour educational sessions for this activity over a 9-month period. Thirteen providers completed all 3 stages of the PI CME program. A variety of other clinicians, in addition to the 13 providers, participated in the educational sessions. Data were collected at the beginning and end of the PI CME activity and at three intervals during the 5 years after the completion of the activity. RESULTS: The percentage of tests for osteoporosis ordered and performed increased significantly from Stage A to Stage C of the PI CME activity and continued to increase after the completion of the PI CME activity. Follow-up data at 4 and 40 months (for ordering and performing osteoporosis screening) and 49 months (for performing the screening only) reflect the impact of the PI CME activity plus the continuing QI interventions. The percentage of BMD tests ordered continued to increase substantially over the post-PI CME periods: 4 and 40 months (F(3,46) = 4.04, p < .05). Similarly, the percentage of BMD tests performed continued to increase at 4, 40, and 49 months after the conclusion of the PI CME activity (F(4,55) = 12.55, p < .0001). DISCUSSION: The data indicate that PI CME utilizing QI principles can be effective in producing sustainable change in practice to improve the screening of patients at risk for osteoporosis. Further research is needed to determine the extent to which such changes can be directly attributed to this type of intervention.