Early Diagnosis and Treatment of COPD and Asthma - A Randomized, Controlled Trial.

BACKGROUND: Many persons with chronic obstructive pulmonary disease (COPD) or asthma have not received a diagnosis, so their respiratory symptoms remain largely untreated. METHODS: We used a case-finding method to identify adults in the community with respiratory symptoms without diagnosed lung disease. Participants who were found to have undiagnosed COPD or asthma on spirometry were enrolled in a multicenter, randomized, controlled trial to determine whether early diagnosis and treatment reduces health care utilization for respiratory illness and improves health outcomes. Participants were assigned to receive the intervention (evaluation by a pulmonologist and an asthma-COPD educator who were instructed to initiate guideline-based care) or usual care by their primary care practitioner. The primary outcome was the annualized rate of participant-initiated health care utilization for respiratory illness. Secondary outcomes included changes from baseline to 1 year in disease-specific quality of life, as assessed with the St. George Respiratory Questionnaire (SGRQ; scores range from 0 to 100, with lower scores indicating better health status); symptom burden, as assessed with the COPD Assessment Test (CAT; scores range from 0 to 40, with lower scores indicating better health status); and forced expiratory volume in 1 second (FEV1). RESULTS: Of 38,353 persons interviewed, 595 were found to have undiagnosed COPD or asthma and 508 underwent randomization: 253 were assigned to the intervention group and 255 to the usual-care group. The annualized rate of a primary-outcome event was lower in the intervention group than in the usual-care group (0.53 vs. 1.12 events per person-year; incidence rate ratio, 0.48; 95% confidence interval [CI], 0.36 to 0.63; P<0.001). At 12 months, the SGRQ score was lower than the baseline score by 10.2 points in the intervention group and by 6.8 points in the usual-care group (difference, -3.5 points; 95% CI, -6.0 to -0.9), and the CAT score was lower than the baseline score by 3.8 points and 2.6 points, respectively (difference, -1.3 points; 95% CI, -2.4 to -0.1). The FEV1 increased by 119 ml in the intervention group and by 22 ml in the usual-care group (difference, 94 ml; 95% CI, 50 to 138). The incidence of adverse events was similar in the trial groups. CONCLUSIONS: In this trial in which a strategy was used to identify adults in the community with undiagnosed asthma or COPD, those who received pulmonologist-directed treatment had less subsequent health care utilization for respiratory illness than those who received usual care. (Funded by Canadian Institutes of Health Research; UCAP ClinicalTrials.gov number, NCT03148210.).

Impact of Undiagnosed Chronic Obstructive Pulmonary Disease and Asthma on Symptoms, Quality of Life, Healthcare Use, and Work Productivity.

Rationale: A significant proportion of individuals with chronic obstructive pulmonary disease (COPD) and asthma remain undiagnosed. Objectives: The objective of this study was to evaluate symptoms, quality of life, healthcare use, and work productivity in subjects with undiagnosed COPD or asthma compared with those previously diagnosed, as well as healthy control subjects. Methods: This multicenter population-based case-finding study randomly recruited adults with respiratory symptoms who had no previous history of diagnosed lung disease from 17 Canadian centers using random digit dialing. Participants who exceeded symptom thresholds on the Asthma Screening Questionnaire or the COPD Diagnostic Questionnaire underwent pre- and post-bronchodilator spirometry to determine if they met diagnostic criteria for COPD or asthma. Two control groups, a healthy group without respiratory symptoms and a symptomatic group with previously diagnosed COPD or asthma, were similarly recruited. Measurements and Main Results: A total of 26,905 symptomatic individuals were interviewed, and 4,272 subjects were eligible. Of these, 2,857 completed pre- and post-bronchodilator spirometry, and 595 (21%) met diagnostic criteria for COPD or asthma. Individuals with undiagnosed COPD or asthma reported greater impact of symptoms on health status and daily activities, worse disease-specific and general quality of life, greater healthcare use, and poorer work productivity than healthy control subjects. Individuals with undiagnosed asthma had symptoms, quality of life, and healthcare use burden similar to those of individuals with previously diagnosed asthma, whereas subjects with undiagnosed COPD were less disabled than those with previously diagnosed COPD. Conclusions: Undiagnosed COPD or asthma imposes important, unmeasured burdens on the healthcare system and is associated with poor health status and negative effects on work productivity.

Patient and physician factors associated with symptomatic undiagnosed asthma or COPD.

BACKGROUND: It remains unclear why some symptomatic individuals with asthma or COPD remain undiagnosed. Here, we compare patient and physician characteristics between symptomatic individuals with obstructive lung disease (OLD) who are undiagnosed and individuals with physician-diagnosed OLD. METHODS: Using random-digit dialling and population-based case finding, we recruited 451 participants with symptomatic undiagnosed OLD and 205 symptomatic control participants with physician-diagnosed OLD. Data on symptoms, quality of life and healthcare utilisation were analysed. We surveyed family physicians of participants in both groups to elucidate differences in physician practices that could contribute to undiagnosed OLD. RESULTS: Participants with undiagnosed OLD had lower mean pre-bronchodilator forced expiratory volume in 1 s percentage predicted compared with those who were diagnosed (75.2% versus 80.8%; OR 0.975, 95% CI 0.963-0.987). They reported greater psychosocial impacts due to symptoms and worse energy and fatigue than those with diagnosed OLD. Undiagnosed OLD was more common in participants whose family physicians were practising for >15 years and in those whose physicians reported that they were likely to prescribe respiratory medications without doing spirometry. Undiagnosed OLD was more common among participants who had never undergone spirometry (OR 10.83, 95% CI 6.18-18.98) or who were never referred to a specialist (OR 5.92, 95% CI 3.58-9.77). Undiagnosed OLD was less common among participants who had required emergency department care (OR 0.44, 95% CI 0.20-0.97). CONCLUSIONS: Individuals with symptomatic undiagnosed OLD have worse pre-bronchodilator lung function and present with greater psychosocial impacts on quality of life compared with their diagnosed counterparts. They were less likely to have received appropriate investigations and specialist referral for their respiratory symptoms.

Disease burden in individuals with symptomatic undiagnosed asthma or COPD.

BACKGROUND: The actual burden of COPD and asthma may be much higher than appreciated, since a large proportion of individuals are not diagnosed. Our study objective was to compare health care utilization, burden of symptoms and quality of life in subjects with self-reported respiratory symptoms who were subsequently found to have undiagnosed airflow obstruction compared to those having no airflow obstruction. METHODS: This cross-sectional case-finding study used data from the Undiagnosed COPD and Asthma Population (UCAP) study. Adult subjects with respiratory symptoms who had no history of diagnosed lung disease were recruited in a two-step case-finding process using random digit-dialling of land lines and cell phones located within a 90-min radius of 16 Canadian study sites. Participants were assessed for COPD, asthma or no airflow obstruction using pre- and post-bronchodilator spirometry based on American Thoracic Society diagnostic criteria. RESULTS: 1660 participants were recruited, of these 1615 had adequate spirometry and 331 (20.5%) subjects met spirometry criteria for undiagnosed asthma or COPD. Subjects with undiagnosed asthma or COPD had increased respiratory symptoms as assessed by the COPD Assessment Test (CAT), and higher St. George's Respiratory Questionnaire (SGRQ) scores indicating worse health-related quality of life, compared to subjects with no airflow obstruction. No between-group differences were found in health care utilization or work or school absenteeism. CONCLUSION: Undiagnosed asthma and COPD are common in Canadian adults experiencing breathing problems and are associated with a greater burden of symptoms and poorer health-related quality of life. These results suggest that patients may benefit from early identification and treatment of undiagnosed asthma and COPD.

Derivation and validation of the UCAP-Q case-finding questionnaire to detect undiagnosed asthma and COPD.

BACKGROUND: Many people with asthma and COPD remain undiagnosed. We developed and validated a new case-finding questionnaire to identify symptomatic adults with undiagnosed obstructive lung disease. METHODS: Adults in the community with no prior history of physician-diagnosed lung disease who self-reported respiratory symptoms were contacted via random-digit dialling. Pre- and post-bronchodilator spirometry was used to confirm asthma or COPD. Predictive questions were selected using multinomial logistic regression with backward elimination. Questionnaire performance was assessed using sensitivity, predictive values and area under the receiver operating characteristic curve (AUC). The questionnaire was assessed for test-retest reliability, acceptability and readability. External validation was prospectively conducted in an independent sample and predictive performance re-evaluated. RESULTS: A 13-item Undiagnosed COPD and Asthma Population Questionnaire (UCAP-Q) case-finding questionnaire to predict undiagnosed asthma or COPD was developed. The most appropriate risk cut-off was determined to be 6% for either disease. Applied to the derivation sample (n=1615), the questionnaire yielded a sensitivity of 92% for asthma and 97% for COPD; specificity of 17%; and an AUC of 0.69 (95% CI 0.64-0.74) for asthma and 0.82 (95% CI 0.78-0.86) for COPD. Prospective validation using an independent sample (n=471) showed sensitivities of 93% and 92% for asthma and COPD, respectively; specificity of 19%; with AUCs of 0.70 (95% CI 0.62-0.79) for asthma and 0.81 (95% CI 0.74-0.87) for COPD. AUCs for UCAP-Q were higher compared to AUCs for currently recommended case-finding questionnaires for asthma or COPD. CONCLUSIONS: The UCAP-Q demonstrated high sensitivities and AUCs for identifying undiagnosed asthma or COPD. A web-based calculator allows for easy calculation of risk probabilities for each disease.

Performance of the Ebel standard-setting method in spring 2019 Royal College of Physicians and Surgeons of Canada internal medicine certification examination consisted of multiple-choice questions.

PURPOSE: It aimed to know the performance of the Ebel standard-setting method in in spring 2019 Royal College of Physicians and Surgeons of Canada internal medicine certification examination consisted of multiple-choice questions. Specifically followings were searched: the inter-rater agreement; the correlation between Ebel scores and item facility indices; raters' knowledge of correct answers' impact on the Ebel score; and affection of rater's specialty on theinter-rater agreement and Ebel scores. METHODS: Data were drawn from a Royal College of Physicians and Surgeons of Canada certification exam. Ebel's method was applied to 203 MCQs by 49 raters. Facility indices came from 194 candidates. We computed Fleiss' kappa and the Pearson correlation between Ebel scores and item facility indices. We investigated differences in the Ebel score (correct answers provided or not) and differences between internists and other specialists with t-tests. RESULTS: Kappa was below 0.15 for facility and relevance. The correlation between Ebel scores and facility indices was low when correct answers were provided and negligible when they were not. The Ebel score was the same, whether the correct answers were provided or not. Inter-rater agreement and Ebel scores was not differentbetween internists and other specialists. CONCLUSION: Inter-rater agreement and correlations between item Ebel scores and facility indices wee consistently low; furthermore, raters' knowledge of correct answer and rater specialty had no effect on Ebel scores in the present setting.

Population-based case-finding to identify subjects with undiagnosed asthma or COPD.

BACKGROUND: ∼5-10% of adults may have undiagnosed airflow obstruction. The objective of this study was to develop a population-based case-finding strategy to assess the prevalence of undiagnosed airflow obstruction (asthma or COPD) amongst adults with respiratory symptoms in Canada. METHODS: Adults without a previous history of asthma, COPD or lung disease were recruited using random digit-dialling and asked if they had symptoms of dyspnoea, cough, sputum or wheeze within the past 6 months. Those who answered affirmatively completed the Asthma Screening Questionnaire (ASQ), COPD-Diagnostic Questionnaire (COPD-DQ) and COPD Assessment Test (CAT). Those with an ASQ score of ≥6 or a COPD-DQ score of ≥20 underwent pre- and post-bronchodilator spirometry to diagnose asthma or COPD. RESULTS: 12 117 individuals were contacted at home and assessed for study eligibility. Of the 1260 eligible individuals, 910 (72%) enrolled and underwent spirometry. Ultimately, 184 subjects (20% of those enrolled) had obstructive lung disease (73 asthma and 111 COPD). Individuals found to have undiagnosed asthma or COPD had more severe respiratory symptoms and impaired quality of life compared with those without airflow obstruction. The ASQ, COPD-DQ, and CAT had ROC areas for predicting undiagnosed asthma or COPD of 0.49, 0.64 and 0.56, respectively. Four descriptive variables (age, BMI, sex and pack-years smoked) produced better receiver operating characteristic (ROC) values than the questionnaires (ROC area=0.68). CONCLUSION: 20% of randomly selected individuals who report respiratory symptoms in Canada have undiagnosed airflow obstruction due to asthma or COPD. Questionnaires could exclude subjects at low risk but lack the ability to accurately find subjects with undiagnosed disease.

Performance Characteristics of Spirometry With Negative Bronchodilator Response and Methacholine Challenge Testing and Implications for Asthma Diagnosis.

BACKGROUND: In patients with a history suggestive of asthma, diagnosis is usually confirmed by spirometry with bronchodilator response (BDR) or confirmatory methacholine challenge testing (MCT). RESEARCH QUESTION: We examined the proportion of participants with negative BDR testing who had a positive MCT (and its predictors) result and characteristics of MCT, including effects of controller medication tapering and temporal variability (and predictors of MCT result change), and concordance between MCT and pulmonologist asthma diagnosis. STUDY DESIGN AND METHODS: Adults with self-reported physician-diagnosed asthma were recruited by random-digit dialing across Canada. Subjects performed spirometry with BDR testing and returned for MCT if testing was nondiagnostic for asthma. Subjects on controllers underwent medication tapering with serial MCTs over 3 to 6 weeks. Subjects with a negative MCT (the provocative concentration of methacholine that results in a 20% drop in FEV1 [PC20] > 8 mg/mL) off medications were examined by a pulmonologist and had serial MCTs after 6 and 12 months. RESULTS: Of 500 subjects (50.5 ± 16.6 years old, 68.0% female) with a negative BDR test for asthma, 215 (43.0%) had a positive MCT. Subjects with prebronchodilator airflow limitation were more likely to have a positive MCT (OR, 1.90; 95% CI, 1.17-3.04). MCT converted from negative to positive, with medication tapering in 18 of 94 (19.1%) participants, and spontaneously over time in 25 of 165 (15.2%) participants. Of 231 subjects with negative MCT, 28 (12.1%) subsequently received an asthma diagnosis from a pulmonologist. INTERPRETATION: In subjects with a self-reported physician diagnosis of asthma, absence of bronchodilator reversibility had a negative predictive value of only 57% to exclude asthma. A finding of spirometric airflow limitation significantly increased chances of asthma. MCT results varied with medication taper and over time, and pulmonologists were sometimes prepared to give a clinical diagnosis of asthma despite negative MCT. Correspondingly, in patients for whom a high clinical suspicion of asthma exists, repeat testing appears to be warranted.

Between-Visit Variability in FEV1 as a Diagnostic Test for Asthma in Adults.

RATIONALE: The reliability of using between-visit variation in forced expiratory volume in 1 second (FEV1) to diagnose asthma is understudied, and hence uncertain. OBJECTIVE: To determine whether FEV1 variability measured over recurrent visits is significantly associated with a diagnosis of current asthma. METHODS: Randomly selected adults (N = 964) with a history of physician-diagnosed asthma were studied from 2005 to 2007 and from 2012 to 2016. A diagnosis of current asthma was confirmed in those participants who exhibited bronchial hyperresponsiveness to methacholine and/or acute worsening of asthma symptoms while being weaned off asthma medications. Regression analyses and receiver operating curves were used to evaluate the ability of between-visit FEV1 variability to diagnose asthma. RESULTS: A current diagnosis of asthma was confirmed in 584 of 964 participants (60%). Between-visit absolute variability in FEV1 was significantly greater in those in whom current asthma was confirmed, compared with those in whom current asthma was ruled out (7.3% vs. 4.8%; mean difference between the two groups, 2.5%; 95% confidence interval, 1.7-3.3%). However, a 12% and 200-ml between-visit variation in FEV1, which is the diagnostic threshold recommended by Global Initiative for Asthma, exhibited a sensitivity of only 0.17 and a specificity of 0.94 for confirming current asthma. A between-visit absolute variability in FEV1 ≥ 12% and 200 ml increased the pretest probability of asthma from 60% to a posttest probability of 81%. CONCLUSIONS: A 12% and 200-ml between-visit variation in FEV1, if present, has reasonably good specificity for diagnosing asthma, but has poor sensitivity compared with bronchial challenge testing. Between-visit variability in FEV1 is a relatively unhelpful test to establish a diagnosis of asthma.

Reevaluation of Diagnosis in Adults With Physician-Diagnosed Asthma.

Importance: Although asthma is a chronic disease, the expected rate of spontaneous remissions of adult asthma and the stability of diagnosis are unknown. Objective: To determine whether a diagnosis of current asthma could be ruled out and asthma medications safely stopped in randomly selected adults with physician-diagnosed asthma. Design, Setting, and Participants: A prospective, multicenter cohort study was conducted in 10 Canadian cities from January 2012 to February 2016. Random digit dialing was used to recruit adult participants who reported a history of physician-diagnosed asthma established within the past 5 years. Participants using long-term oral steroids and participants unable to be tested using spirometry were excluded. Information from the diagnosing physician was obtained to determine how the diagnosis of asthma was originally made in the community. Of 1026 potential participants who fulfilled eligibility criteria during telephone screening, 701 (68.3%) agreed to enter into the study. All participants were assessed with home peak flow and symptom monitoring, spirometry, and serial bronchial challenge tests, and those participants using daily asthma medications had their medications gradually tapered off over 4 study visits. Participants in whom a diagnosis of current asthma was ultimately ruled out were followed up clinically with repeated bronchial challenge tests over 1 year. Exposure: Physician-diagnosed asthma established within the past 5 years. Main Outcomes and Measures: The primary outcome was the proportion of participants in whom a diagnosis of current asthma was ruled out, defined as participants who exhibited no evidence of acute worsening of asthma symptoms, reversible airflow obstruction, or bronchial hyperresponsiveness after having all asthma medications tapered off and after a study pulmonologist established an alternative diagnosis. Secondary outcomes included the proportion with asthma ruled out after 12 months and the proportion who underwent an appropriate initial diagnostic workup for asthma in the community. Results: Of 701 participants (mean [SD] age, 51 [16] years; 467 women [67%]), 613 completed the study and could be conclusively evaluated for a diagnosis of current asthma. Current asthma was ruled out in 203 of 613 study participants (33.1%; 95% CI, 29.4%-36.8%). Twelve participants (2.0%) were found to have serious cardiorespiratory conditions that had been previously misdiagnosed as asthma in the community. After an additional 12 months of follow-up, 181 participants (29.5%; 95% CI, 25.9%-33.1%) continued to exhibit no clinical or laboratory evidence of asthma. Participants in whom current asthma was ruled out, compared with those in whom it was confirmed, were less likely to have undergone testing for airflow limitation in the community at the time of initial diagnosis (43.8% vs 55.6%, respectively; absolute difference, 11.8%; 95% CI, 2.1%-21.5%). Conclusions and Relevance: Among adults with physician-diagnosed asthma, a current diagnosis of asthma could not be established in 33.1% who were not using daily asthma medications or had medications weaned. In patients such as these, reassessing the asthma diagnosis may be warranted.

Marked disparity in the epidemiology of tuberculosis among Aboriginal peoples on the Canadian prairies: the challenges and opportunities.

BACKGROUND: While it is established that Aboriginal peoples in the prairie provinces of Canada are disproportionately affected by tuberculosis (TB), little is known about the epidemiology of TB either within or across provincial borders. METHODS: Provincial reporting systems for TB, Statistics Canada censuses and population estimates of Registered Indians provided by Aboriginal Affairs and Northern Development Canada were used to estimate the overall (2004 to 2008) and pulmonary (2007 to 2008) TB rates in the prairie provinces. The place of residence at diagnosis of pulmonary TB cases in 2007 to 2008 was also documented. RESULTS: The age- and sex-adjusted incidence of TB in Registered Indians was 52.6 per 100,000 person-years, 38 times higher than in Canadian-born 'others'. Incidence rates in Registered Indians were highest in Manitoba and lowest in Alberta. In Alberta and Saskatchewan, on-reserve rates were more than twice that of off-reserve rates. Rates in the Métis and Registered Indians were similar in Saskatchewan (50.0 and 52.2 per 100,000 person-years, respectively). In 2007 to 2008, approximately 90% of Canadian-born pulmonary TB cases in the prairie provinces were Aboriginal. Outside of one metropolitan area (Winnipeg, Manitoba), most Registered Indian and Métis pulmonary TB cases were concentrated in a relatively small number of communities north of the 53rd parallel. Rates of pulmonary TB in 11 of these communities were >300 per 100,000 person-years. In Manitoba, 49% of off-reserve Registered Indian pulmonary cases were linked to high-incidence reserve communities. INTERPRETATION: The epidemiology of TB among Aboriginal peoples on the Canadian prairies is markedly disparate. Pulmonary TB is highly focal, which is both a concern and an opportunity.

Granulomatous Pneumocystis jiroveci pneumonia associated with immune reconstituted HIV.

Pneumocystis jiroveci pneumonia uncommonly presents with pulmonary nodules and granulomatous inflammation. An unusual case of granulomatous P jiroveci pneumonia in an HIV patient with a CD4(+) lymphocyte count of greater than 200 cells/mm(3), occurring in the context of immune reconstitution with highly active antiretroviral therapy, is described. The case highlights the importance of establishing this diagnosis to institute appropriate therapy.

Acute respiratory distress following intravenous injection of an oil-steroid solution.

A case of acute respiratory distress and hypoxemia following accidental intravenous injection of an oil-steroid solution in a body builder is presented. Chest roentography at the time of presentation showed diffuse bilateral opacities, and computed tomography revealed predominantly peripheral ground-glass opacifications. The patient's symptoms gradually improved over 48 h and imaging of the chest was unremarkable one week later. The pathophysiology, diagnosis and treatment of this rare but potentially lifethreatening complication of intravenous oil injection are discussed.

Two models of raters in a structured oral examination: does it make a difference?

Oral examinations have become more standardized over recent years. Traditionally a small number of raters were used for this type of examination. Past studies suggested that more raters should improve reliability. We compared the results of a multi-station structured oral examination using two different rater models, those based in a station, (station-specific raters), and those who follow a candidate throughout the entire examination, (candidate-specific raters).Two station-specific and two candidate-specific raters simultaneously evaluated internal medicine residents' performance at each station. No significant differences were found in examination scores. Reliability was higher for the candidate-specific raters. Inter-rater reliability, internal consistency and a study of station inter-correlations suggested that a halo effect may be present for candidates examined by candidate-specific raters. This study suggests that although the model of candidate-specific raters was more reliable than the model of station-specific raters for the overall examination, the presence of a halo effect may influence individual examination outcomes.

The effect of differential rater function over time (DRIFT) on objective structured clinical examination ratings.

CONTEXT: Despite the impartiality implied in its title, the objective structured clinical examination (OSCE) is vulnerable to systematic biases, particularly those affecting raters' performance. In this study our aim was to examine OSCE ratings for evidence of differential rater function over time (DRIFT), and to explore potential causes of DRIFT. METHODS: We studied ratings for 14 internal medicine resident doctors over the course of a single formative OSCE, comprising 10 12-minute stations, each with a single rater. We evaluated the association between time-slot and rating for a station. We also explored a possible interaction between time-slot and station difficulty, which would support the hypothesis that rater fatigue causes DRIFT, and considered 'warm-up' as an alternative explanation for DRIFT by repeating our analysis after excluding the first two OSCE stations. RESULTS: Time-slot was positively associated with rating on a station (regression coefficient 0.88, 95% confidence interval [CI] 0.38-1.38; P = 0.001). There was an interaction between time-slot and station difficulty: for the more difficult stations the regression coefficient for time-slot was 1.24 (95% CI 0.55-1.93; P = 0.001) compared with 0.52 (95% CI - 0.08 to 1.13; P = 0.09) for the less difficult stations. Removing the first two stations from our analyses did not correct DRIFT. CONCLUSIONS: Systematic biases, such as DRIFT, may compromise internal validity in an OSCE. Further work is needed to confirm this finding and to explore whether DRIFT also affects ratings on summative OSCEs. If confirmed, the factors contributing to DRIFT, and ways to reduce these, should then be explored.

Initial diagnostic hypotheses bias analytic information processing in non-visual domains.

CONTEXT: Previous studies have shown that an initial diagnostic hypothesis biases automatic information processing. It is unclear if an initial hypothesis has a similar effect on analytic information processing. Our first objective was to study the effect of an initial diagnostic hypothesis on analytic processing. Our second objective was to assess the effect of clinical experience on analytic processing by evaluating the effect of clinical frequency and urgency of an alternative diagnosis on diagnosis selection. METHODS: During a 12-minute objective structured clinical examination station, 19 subspecialty medical residents diagnosed the cause of 3 clinical presentations: dyspnoea; headache, and chest pain. Subjects were randomly allocated cases for which the suggested initial hypothesis was either correct or incorrect. For cases with an incorrect initial hypothesis, the alternative diagnoses varied in the frequency with which they are encountered in clinical practice, and their clinical urgency, relative to the initial diagnostic hypothesis. RESULTS: All correct initial hypotheses were retained, compared with 10.9% of incorrect hypotheses. All cases with a correct initial hypothesis were diagnosed correctly, compared with 65.2% of cases with an incorrect hypothesis (risk ratio 1.5 [95% confidence interval 1.2-1.9], P = 0.02). Clinical frequency and urgency were not associated with alternative diagnosis selection. DISCUSSION: Our results suggest that an initial diagnostic hypothesis biases analytic processing. The data used to reject an initial hypothesis appear to drive selection of an alternative hypothesis. Further studies aimed at finding strategies for increasing the likelihood of generating a correct initial hypothesis or debiasing an initial hypothesis are needed.

Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination.

PURPOSE: To evaluate the reliability and validity of the Mini-Clinical Evaluation Exercise (mini-CEX) for postgraduate year 4 (PGY-4) internal medicine trainees compared to a high-stakes assessment of clinical competence, the Royal College of Physicians and Surgeons of Canada Comprehensive Examination in Internal Medicine (RCPSC IM examination). METHODS: Twenty-two PGY-4 residents at the University of British Columbia and the University of Calgary were evaluated, during the 6 months preceding their 2004 RCPSC IM examination, with a mean of 5.5 mini-CEX encounters (range 3-6). Experienced Royal College examiners from each site travelled to the alternate university to assess the encounters. RESULTS: The mini-CEX encounters assessed a broad range of internal medicine patient problems. The inter-encounter reliability for the residents' mean mini-CEX overall clinical competence score was 0.74. The attenuated correlation between residents' mini-CEX overall clinical competence score and their 2004 RCPSC IM oral examination score was 0.59 (P = 0.01). CONCLUSION: By examining multiple sources of validity evidence, this study suggests that the mini-CEX provides a reliable and valid assessment of clinical competence for PGY-4 trainees in internal medicine.