First-year medical students' calibration bias and accuracy across clinical reasoning activities.

To be safe and effective practitioners and learners, medical professionals must be able to accurately assess their own performance to know when they need additional help. This study explored the metacognitive judgments of 157 first-year medical students; in particular, the study examined students' self-assessments or calibration as they engaged in a virtual-patient simulation targeting clinical reasoning practices. Examining two key subtasks of a patient encounter, history (Hx) and physical exam (PE), the authors assessed the level of variation in students' behavioral performance (i.e., effectiveness and efficiency) and judgments of performance (i.e., calibration bias and accuracy) across the two subtasks. Paired t tests revealed that the Hx subtask was deemed to be more challenging than the PE subtask when viewed in terms of both actual and perceived performance. In addition to students performing worse on the Hx subtask than PE, they also perceived that they performed less well for Hx. Interestingly, across both subtasks, the majority of participants overestimated their performance (98% of participants for Hx and 95% for PE). Correlation analyses revealed that the participants' overall level of accuracy in metacognitive judgments was moderately stable across the Hx and PE subtasks. Taken together, findings underscore the importance of assessing medical students' metacognitive judgments at different points during a clinical encounter.

Use of Standard Guidelines for Department of Medicine Summary Letters.

Phenomenon: Fourth-year medical students obtain Department of Medicine (DOM) letters ("Chair" letters) to support their residency applications. Writing and interpreting DOM letters are challenging. There is heterogeneity in the letters that makes it difficult to both write and read these letters. APPROACH: The purpose of this study is to determine the value of new guidelines developed by a task force of clerkship directors and program directors in internal medicine and assess the implementation of these guidelines. The Clerkship Directors in Internal Medicine performed a cross-sectional survey of internal medicine clerkship directors at U.S. and Canadian medical schools in 2014. In addition, the primary author's institution reviewed 1,347 DOM letters between 2012 and 2014 to assess the implementation of these guidelines. FINDINGS: The survey response rate was 78%. DOM letter writers reported the guidelines were better, easier to implement, and more compatible with the purpose of DOM letters than previously. Most letter readers reported that letters using the guidelines were more credible. Writers of DOM letters in lower academic ranks rated the letters with guidelines higher in several domains than those in higher academic ranks. Readers of DOM letters in higher academic ranks rated the letters with guidelines higher in several domains than those in lower academic ranks. In the DOM letters examined, the odds of meeting each guideline increased with each additional year. However, for 3 guidelines there was an initial decline in adherence from 2012 to 2013 before increasing again in 2014-the recommended length, clerkship description, and detailed narrative guidelines. Letters solely written by a chair were less likely to incorporate the guidelines. Insights: Clerkship directors often write the DOM letters and identify with the purpose of the guidelines. As writers, lower ranking academic faculty value the guidelines more than higher ranking academic faculty. As readers of DOM letters, higher academic ranking faculty value letters that incorporate the guidelines more than lower academic ranking faculty. DOM letters implemented more guideline criteria since the guidelines were released. If implementing the guidelines, chairs should solicit the help of their clerkship director or educational representative when writing DOM letters. Although many clerkship directors read letters for their residency programs, additional program directors' opinions are needed.

Prophylactic antibiotics following radical cystectomy reduces urinary tract infections and readmission for sepsis from a urinary source.

INTRODUCTION: Urinary tract infections (UTI) and sepsis contribute significantly to the morbidity associated with cystectomy and urinary diversion in the first 30 days. We hypothesized that continuous antibiotic prophylaxis decreased UTIs in the first 30 days following radical cystectomy. METHODS: Patients with urothelial carcinoma of the bladder who underwent a radical cystectomy with urinary diversion for bladder cancer at Oregon Health and Science University from January 2014 to May 2015 were included in the study. The ureteral stents were kept for 3 weeks in both groups. In October 2014, we enacted a Department Quality Initiative to reduce UTIs. Following the initiative, all radical cystectomy patients were discharged home on antibiotic prophylaxis following a postoperative urine culture obtained during hospitalization. To evaluate the effectiveness of the initiative, the last 42 patients before the initiative were compared to the first 42 patients after the initiative with regard to the rate of UTI in the first 30 days following surgery. We used a combination of comprehensive chart review and the American College of Surgeons' National Surgical Quality Improvement Program (NSQIP) to determine UTI and readmission for urosepsis in the first 30 days following surgery. This ensured accurate capture of all patients developing a UTI. RESULTS: A total of 12% in the prophylactic antibiotic group had a documented UTI, whereas 36% in the no antibiotic group had a urinary tract infection (P<0.004). A total of 1 (2%) patient in the antibiotic group was readmitted for urosepsis whereas 7 (17%) patients in the no antibiotic group were admitted for urosepsis (P = 0.02). There was no association noted between urine culture at discharge and the development of UTI in the 30-day postdischarge period (P = 0.75). The median time to UTI was 19 days and the most common organism was Enterococcus (32%). Thirty-percent of patients not receiving prophylaxis developed a UTI 1 day after ureteral stent removal. No patients had a UTI following stent removal in the prophylaxis group. No adverse antibiotic related events were noted. CONCLUSION: Prophylactic antibiotics in the 30 days following radical cystectomy is associated with a significant decrease in urinary tract infections and readmission from urosepsis after surgery.

Cultivating Medical Education Research Mentorship as a Pathway Towards High Quality Medical Education Research.

The lack of effective and consistent research mentorship and research mentor training in both undergraduate medical education (UME) and graduate medical education (GME) is a critical constraint on the development of innovative and high quality medical education research. Clinical research mentors are often not familiar with the nuances and context of conducting education research. Clinician-educators, meanwhile, often lack the skills in developing and conducting rigorous research. Mentors who are not prepared to articulate potential scholarship pathways for their mentees risk limiting the mentee's progress in early stages of their career. In fact, the relative paucity of experienced medical education research mentors arguably contributes to the perpetuation of a cycle leading to fewer well-trained researchers in medical education, a lack of high quality medical education research, and relative stagnation in medical education innovation. There is a path forward, however. Integration of doctoral-level educators, structured inter-departmental efforts, and external mentorship provide opportunities for faculty to gain traction in their medical education research efforts. An investment in medical education research mentors will ensure rigorous research for high quality innovation in medical education and patient care.

Overnight Hospital Experiences for Medical Students: Results of the 2014 Clerkship Directors in Internal Medicine National Survey.

BACKGROUND: Since the 2011 Accreditation Council of Graduate Medical Education (ACGME) work hour rules for residents were implemented, 24-30 h call for interns has been replaced by shift work, including night-float. The impact of these changes on undergraduate medical education experiences in internal medicine has not been described. OBJECTIVE: We aimed to determine the current status of medical students' overnight experiences in Internal Medicine clerkships and sub-internships, and to assess internal medicine educators' perceptions of the importance of overnight work during internal medicine rotations. DESIGN AND PARTICIPANTS: In May 2014, the Clerkship Directors in Internal Medicine (CDIM) conducted its annual survey. Twenty-eight questions about student participation in overnight work and perceptions of the importance of overnight work (rated on 1-5 Likert scale, 1 = very unimportant and 5 = ery important) were included. Descriptive statistics were used to summarize responses. Free text results were analyzed qualitatively. KEY RESULTS: The response rate was 78 %. A minority of respondents reported students having any overnight experience during the clerkship (38.7 %) or the sub-internship (40.7 %). Only 5 % of respondents reported having students assigned to night-float rotations outside of clerkships or sub-internships. Respondents agreed that overnight experiences were more important during the sub-internship than the clerkship, 4.0 ± 1.1 vs. 3.2 ± 1.2, p < 0.001. Admitting new patients, following their course and responding to emergencies were rated as important overnight tasks for both clerkship and sub-internship students. CONCLUSIONS: Overnight experiences offer students additional educational opportunities. Clerkship directors felt that the overnight experience for the sub-intern in particular was an important chance to practice providing emergency cross coverage and other intern roles. In the era of ACGME duty hours, there is a need to further examine whether there is a role for increased overnight hospital experiences for medical students.

Developing questionnaires for educational research: AMEE Guide No. 87.

In this AMEE Guide, we consider the design and development of self-administered surveys, commonly called questionnaires. Questionnaires are widely employed in medical education research. Unfortunately, the processes used to develop such questionnaires vary in quality and lack consistent, rigorous standards. Consequently, the quality of the questionnaires used in medical education research is highly variable. To address this problem, this AMEE Guide presents a systematic, seven-step process for designing high-quality questionnaires, with particular emphasis on developing survey scales. These seven steps do not address all aspects of survey design, nor do they represent the only way to develop a high-quality questionnaire. Instead, these steps synthesize multiple survey design techniques and organize them into a cohesive process for questionnaire developers of all levels. Addressing each of these steps systematically will improve the probabilities that survey designers will accurately measure what they intend to measure.

Timing, incidence and risk factors for venous thromboembolism in patients undergoing radical cystectomy for malignancy: a case for extended duration pharmacological prophylaxis.

PURPOSE: Patients undergoing radical cystectomy for bladder cancer are at high risk for venous thromboembolism. Recent data have demonstrated that the risk of venous thromboembolism often extends beyond hospital discharge in nonurological surgical populations. To our knowledge the timing of venous thromboembolism in patients who have undergone radical cystectomy during a 30-day postoperative period has not been assessed. Therefore, we evaluated the timing, incidence and risk factors for venous thromboembolism for patients undergoing radical cystectomy for malignancy. MATERIALS AND METHODS: In this descriptive, observational, retrospective study data from 1,307 patients who underwent radical cystectomy for malignancy from 2005 to 2011 were collected using the American College of Surgeons NSQIP (National Surgical Quality Improvement Program) database. Venous thromboembolism occurrences were evaluated by postoperative day and whether they occurred while an inpatient or after discharge home. Univariate and multivariate Cox regression and logistic regression models were used to evaluate risk factors associated with venous thromboembolism. RESULTS: Of 1,307 patients 78 (6%) were diagnosed with venous thromboembolism. The mean time to venous thromboembolism diagnosis was 15.2 days postoperatively. Of all venous thromboembolism events 55% were diagnosed after patient discharge home. The 30-day mortality rate from venous thromboembolism was 6.4%. Risk factors for the development of venous thromboembolism on multivariate analysis were age (p = 0.024), operative time (p = 0.004) and sepsis or septic shock (p = 0.0001). CONCLUSIONS: More than half of all venous thromboembolisms (55%) in patients undergoing radical cystectomy for malignancy occurred after discharge home and the mean time to venous thromboembolism diagnosis was 15.2 days postoperatively. It is reasonable to consider extended duration pharmacological prophylaxis (4 weeks) in this high risk surgical population.

Refining the use of cytoreductive nephrectomy in metastatic renal cell carcinoma.

Cytoreductive nephrectomy (CN) was regarded standard of care for patients with metastatic renal cellcarcinoma (mRCC) in the cytokine era. After the introduction of therapies targeting the vascular endothelial growth factor (VEGF) and mammalian target of rapamycin (mTOR) pathways, improved median survival and primary tumor responses are observed. Prognostic models have been validated and the clinical significance of tumor heterogeneity and histological subtypes has been recognized. These changes in the understanding and treatment of mRCC require assessment of CN. This review discusses the original context in which the efficacy of CN was established and the advances in treatment that have changed that context. Potential refinements in the use of CN that may reduce overall morbidity by limiting its use to those most likely to benefit are reviewed.

The feasibility, reliability, and validity of a post-encounter form for evaluating clinical reasoning.

BACKGROUND: Developing feasible, reliable and valid methods for the evaluation of clinical reasoning is challenging. AIM: To explore feasibility, reliability, and validity evidence for a post-encounter form assessing clinical reasoning. METHOD: A free-text, post-encounter form was used in an Objective Structured Clinical Examination (OSCE) station to assess clinical reasoning for end-of-second-year medical students. Feasibility was assessed by time to complete form. Inter-rater reliability was assessed by kappa. Validity evidence was obtained by comparing scores from individual items on the post-encounter form and other components in this OSCE station (i.e., standardized patient checklist and oral presentation rating form). Additional validity evidence was gathered by comparing scores on this station with other course performance graded events. RESULTS: Feasibility and estimated reliability were high, and several lines of validity evidence were supported. CONCLUSIONS: The scores from an end-of-second-year, medical school, post-encounter form yielded adequate psychometric properties and can be used for the evaluation of clinical reasoning. Moreover, this form of assessment and its scoring could translate to other venues.

Urological manifestations of sarcoidosis.

PURPOSE: We describe the urological manifestations of sarcoidosis and how the disease may affect the management of multiple urological conditions. MATERIALS AND METHODS: We performed a PubMed® search using the query sarcoidosis and multiple urological terms. RESULTS: Sarcoidosis is a disease that has variable manifestations. There is often genitourinary involvement that is clinically silent. However, sarcoidosis may cause symptoms, such as nephrolithiasis, which are sometimes the first manifestation of the disease. Renal function may be affected, and appropriate recognition and treatment may avert progressive functional decline. The presence of sarcoidosis may also confound the diagnosis and staging of various urological malignancies, particularly renal and testicular carcinoma. CONCLUSIONS: Urologists should be aware of the urological manifestations of sarcoidosis to avoid misdiagnoses and the over staging of urological cancers, and to identify when it is an underlying cause of nephrolithiasis or obstructive uropathy.

Role of lymphadenectomy for prostate cancer: indications and controversies.

Pelvic lymph node dissection is the only reliable technique to detect low-volume lymph node involvement in prostate cancer. Extended lymph node dissections that include the internal iliac chain in addition to the external iliac and obturator packets have shown a significantly higher proportion of patients to have lymphatic involvement than previously recognized. The improved staging afforded by a more extended dissection raises several questions. Addressing these questions is the focus of this review.

Authenticity of instruction and student performance: a prospective randomised trial.

OBJECTIVES: This study aimed to investigate the relationship between the authenticity of instructional formats and outcome measures within a pre-clerkship clinical reasoning course. METHODS: We conducted a randomised, prospective, crossover study with Year 2 medical students taking a pre-clerkship clinical reasoning course. Students were randomised to small groups and exposed to three formats of differing instructional authenticity (paper case, DVD presentation, standardised patient [SP] presentation) across three subject areas (abdominal pain, anaemia, polyuria). Three student cohorts were taught using one instructional format per subject area so that each cohort received a different instructional format for each of the three subject areas. Outcome measures (objective structured clinical examination, video quiz, written examination) were selected to determine the effect of each instructional format on the clinical reasoning of students. RESULTS: Increasingly authentic instructional formats did not significantly improve clinical reasoning performance across all outcome measures and subject areas. However, the results of the video quiz showed significant differences in the anaemia subject area between students who had been instructed using the paper case and live SP-based formats (scores of 47.4 and 57.6, respectively; p = 0.01) and in the abdominal pain subject area, in which students instructed using the DVD format scored higher than students instructed using either the paper case or SP-based formats (scores of 41.6, 34.9 and 31.2, respectively; p=0.002). CONCLUSIONS: Increasing the authenticity of instructional formats does not appear to significantly improve clinical reasoning performance in a pre-clerkship course. Medical educators should balance increases in authenticity with factors such as cognitive load, subject area and learner experience when designing new instructional formats.

Making use of contrasting participant views of the same encounter.

CONTEXT: The practice of medicine involves many stakeholders (or participant groups such as patients, doctors and trainees). Based on their respective goals, perceptions and understandings, and on what is being measured, these stakeholders may have dramatically different viewpoints of the same event. There are many ways to characterise what occurred in a clinical encounter; these include an oral presentation (faculty perspective), a written note (trainee perspective), and the patient's perspective. In the present study, we employed two established theories as frameworks with the purpose of assessing the extent to which different views of the same clinical encounter (a three-component, Year 2 medical student objective structured clinical examination [OSCE] station) are similar to or differ from one another. METHODS: We performed univariate comparisons between the individual items on each of the three components of the OSCE: the standardised patient (SP) checklist (patient perspective); the post-encounter form (trainee perspective), and the oral presentation rating form (faculty perspective). Confirmatory factor analysis (CFA) of the three-component station was used to assess the fit of the three-factor (three-viewpoint) model. We also compared tercile performance across these three views as a form of extreme groups analysis. RESULTS: Results from the CFA yielded a measurement model with reasonable fit. Moderate correlations between the three components of the station were observed. Individual trainee performance, as measured by tercile score, varied across components of the station. CONCLUSIONS: Our work builds on research in fields outside medicine, with results yielding small to moderate correlations between different perspectives (and measurements) of the same event (SP checklist, post-encounter form and oral presentation rating form). We believe obtaining multiple perspectives of the same encounter provides a more valid measure of a student's clinical performance.

Chromosome 9p deletions identify an aggressive phenotype of clear cell renal cell carcinoma.

BACKGROUND: The authors investigated whether deletion of chromosome 9p in clear cell renal cell carcinoma (ccRCC) predicted worse disease-specific survival (DSS) and recurrence-free survival (RFS) and whether it was associated with more aggressive behavior in small renal masses. METHODS: In total, 703 ccRCC tumors were analyzed using fluorescence in situ hybridization (316 tumors) and cytogenetics (388 tumors). Tumor grade, classification, and size; 9p status; Eastern Cooperative Oncology Group performance status (ECOG PS); lymph node involvement; and the presence of metastasis were recorded. Outcomes were stratified by 9p status, and a Cox proportional hazards models was constructed using TNM staging, ECOG PS, tumor size, tumor grade, and 9p status. RESULTS: Deletions of 9p were detected in 97 tumors (13.8%). At presentation, 9p-deleted tumors were larger and were more likely to be high grade (grade 3 or 4), to have a high tumor (T) classification (T3-T4), and to have lymph node or distant metastases (P < .01). The median DSS for patients with and without 9p deletions was 37 months and 82 months, respectively (P < .01). In patients with localized disease, the median RFS in those who had 9p deletions was 53 months and was not reached in those without 9p deletions (P < .01). In patients who had localized lesions that measured ≤4 cm in greatest dimension, 9p-deleted tumors were more likely to recur (19% vs 2%; P = .01). CONCLUSIONS: Deletion of chromosome 9p in ccRCC occurred in 14% of patients and was associated with higher grade and T classification, and the presence of lymph node and distant metastases. In addition, 9p deletion independently conferred a worse prognosis for patients with localized ccRCC, and most noteworthy, in patients with localized, small renal masses. Preoperatively identifying patients with 9p deletions will improve risk stratification and will help to select appropriate patients for surveillance protocols or aggressive treatment.

Prostate cancer screening: what we have learned from the PLCO and ERSPC trials.

Two large randomized trials on prostate cancer screening have recently reported their 10-year results with somewhat differing conclusions. The Prostate, Lung, Colorectal, and Ovarian Cancer Screening (PLCO) study found a slightly higher risk of a prostate cancer diagnosis in the screening cohort, but no cancer-specific survival advantage was seen for this group. However, the study had widespread screening contamination in the control arm that significantly weakens the study's ability to reach a valid conclusion about the benefits of screening. The European Randomized Study of Screening in Prostate Cancer (ERSPC) was less affected by screening contamination of the control arm, and a cancer-specific survival benefit for the screening arm was seen by 7-8 years (RR, 0.70-0.80). Based on these studies, it is reasonable to conclude that there is a survival benefit for screening, but it may not extend to older men (>75 years) who have undergone prior screening.

Functional and oncological outcomes of partial nephrectomy of solitary kidneys.

PURPOSE: We examined outcomes after partial nephrectomy in patients with tumors in a solitary kidney to determine the extent to which patient, surgery and tumor specific variables influenced the glomerular filtration rate and local recurrence postoperatively. MATERIALS AND METHODS: Demographics, renal function, comorbidities, renal cell carcinoma history, and operative and pathological data were recorded. The effect on changes in early and late postoperative glomerular filtration rate and local recurrence were analyzed. RESULTS: In 84 patients undergoing a total of 89 partial nephrectomies the mean immediate postoperative decrease in the glomerular filtration rate in those with no ischemia, warm ischemia (mean 12 minutes) and cold ischemia (mean 33 minutes) was 29%, 37% and 45%, respectively (p <0.01). Late glomerular filtration rate decreases were 12%, 6% and 16%, respectively (p = 0.17). Cold ischemia and multiple vascular risk factors were associated with immediate glomerular filtration rate decreases (p = 0.008 and 0.04, respectively). Local recurrence, which developed in 13 patients (18%), was associated with positive margins and T stage (p = 0.01 and 0.02, respectively). End stage renal disease developed in 3 patients (4%) and an additional 5 (6%) required nephrectomy for local recurrence. CONCLUSIONS: Partial nephrectomy generally results in a small decrease in the glomerular filtration rate, and limited warm and cold ischemia does not appear to adversely affect long-term renal function. Positive margins and T stage greater than 2 are the most important predictors of local recurrence in a solitary kidney. They pose a significant risk to end stage renal disease-free survival due to the need for completion nephrectomy in many of these patients. Partial nephrectomy should be considered the standard of care in all patients with tumor in the solitary kidney.

Changes in clinical skills education resulting from the introduction of the USMLE step 2 clinical skills (CS) examination.

BACKGROUND: Step 2 Clinical Skills (CS) was recently introduced into the United States Medical Licensing Examination (USMLE) to ensure that successful candidates for licensure possess the clinical skills to provide safe and effective patient care. AIMS: To explore if medical schools had changed the objectives, content, or emphasis in their pre-clinical curriculum in response to its implementation. METHODS: In April 2005, the Clerkship Directors in Internal Medicine (CDIM) sent an electronic survey to a single member from each medical school with a CDIM member. The survey instrument included 26 pre-clinical curricular questions with nine questions specifically addressing changes in response to implementation of the Step 2 CS. RESULTS: Forty-five percent of respondents reported changes to the Introduction to Clinical Medicine (ICM) course objectives while 39% and 40% reported changes in content and emphasis. Seventy-four percent felt their students were adequately prepared for the Step 2 CS and 18% were unsure. CONCLUSIONS: Over a third of medical schools are implementing changes to the objectives, content, and/or emphasis of their curriculum, at least partially in response to the institution of Step 2 CS.