Radiologist age and diagnostic errors.

PURPOSE: Previous investigations into the causes of error by radiologists have addressed work schedule, volume, shift length, and sub-specialization. Studies regarding possible associations between radiologist errors and radiologist age and timing of residency training are lacking in the literature, to our knowledge. The aim of our study was to determine if radiologist age and residency graduation date is associated with diagnostic errors. METHODS: Our retrospective analysis included 1.9 million preliminary interpretations (out of a total of 5.2 million preliminary and final interpretations) of imaging examinations by 361 radiologists in a US-based national teleradiology practice between 1/1/2019 and 1/1/2020. Quality assurance data regarding the number of radiologist errors was generated through client facility feedback to the teleradiology practice. With input from both the client radiologist and the teleradiologist, the final determination of the presence, absence, and severity of a teleradiologist error was determined by the quality assurance committee of radiologists within the teleradiology company using standardized criteria. Excluded were 3.2 million final examination interpretations and 93,963 (1.8%) of total examinations from facilities reporting less than one discrepancy in examination interpretation in 2019. Logistic regression with covariates radiologist age and residency graduation date was performed for calculation of relative risk of overall error rates and by major imaging modality. Major errors were separated from minor errors as those with a greater likelihood of affecting patient care. Logistic regression with covariates radiologist age, residency graduation date, and log total examinations interpreted was used to calculate odds of making a major error to that of making a minor error. RESULTS: Mean age of the 361 radiologists was 51.1 years, with a mean residency graduation date of 2001. Mean error rate for all examinations was 0.5%. Radiologist age at any residency graduation date was positively associated with major errors (p < 0.05), with a relative risk 1.021 for each 1-year increase in age and relative risk 1.235 for each decade as well as for minor errors (p < 0.05, relative risk 1.007 for each year, relative risk 1.082 for each decade). By major imaging modality, radiologist age at any residency graduation date was positively associated with computed tomography (CT) and X-ray (XR) major and minor error, magnetic resonance imaging (MRI) major error, and ultrasound (US) minor error (p < 0.05). Radiologist age was positively associated with odds of making a major vs. minor error (p < 0.05). CONCLUSIONS: The mean error rate for all radiologists was low. We observed that increasing age at any residency graduation date was associated with increasing relative risk of major and minor errors as well as increasing odds of a major vs. minor error among providers. Further study is needed to corroborate these results, determine clinical relevance, and highlight strategies to address these findings.

Daytime, evening, and overnight: the 24-h radiology cycle and impact on interpretative accuracy.

PURPOSE: To assess the influence of time of day when a study is interpreted on discrepancy rates for common and advanced studies performed in the acute community setting. METHODS: This retrospective study used the databank of a U.S. teleradiology company to retrieve studies between 2012 and 2016 with a preliminary report followed by a final report by the on-site client hospital. Neuroradiology, abdominal radiology, and musculoskeletal radiology studies were included. Teleradiologists were fellowship trained in one of these subspecialty areas. Daytime, evening, and overnight times were defined. Associations between major and minor discrepancies, time of day, and whether the study was common or advanced were tested with significance set at p = .05. RESULTS: A total of 5,883,980 studies were analyzed. There were 8444 major discrepancies (0.14%) and 17,208 minor discrepancies (0.29%). For common studies, daytime (0.13%) and evening (0.13%) had lower major discrepancy rates compared to overnight (0.14%) (daytime to overnight, RR = 0.57, 95%CI: 0.45, 0.72, p < 0.01 and evening to overnight, RR = 0.57, 95%CI: 0.49,0.67, p < 0.01). Minor discrepancy rates for common studies were decreased for evening (0.29%) compared to overnight (0.30%) (RR = 0.89, 95%CI: 0.80,0.99, p = 0.029). For advanced studies, daytime (.15%) had lower major discrepancy rates compared to evening (0.20%) and overnight (.23%) (daytime to evening, RR = 0.77, 95%CI: 0.61, 0.97, p = 0.028 and daytime to overnight, RR = 0.66, 95%CI: 0.50, 0.87, p ≤ 0.01). CONCLUSION: Significantly higher major discrepancy rates for studies interpreted overnight suggest the need for radiologists to exercise greater caution when interpreting studies overnight and may require practice management strategies to help optimize overnight work conditions. The lower major discrepancy rates on advanced studies interpreted during the daytime suggest the need for reserving advanced studies for interpretation during the day when possible.

Interpretations of Examinations Outside of Radiologists' Fellowship Training: Assessment of Discrepancy Rates Among 5.9 Million Examinations From a National Teleradiology Databank.

BACKGROUND. In community settings, radiologists commonly function as multispecialty radiologists, interpreting examinations outside of their area of fellowship training. OBJECTIVE. The purpose of this article was to compare discrepancy rates for preliminary interpretations of acute community-setting examinations that are concordant versus discordant with interpreting radiologists' area of fellowship training. METHODS. This retrospective study used the databank of a U.S. teleradiology company that provides preliminary interpretations for client community hospitals. The analysis included 5,883,980 acute examinations performed from 2012 to 2016 that were preliminarily interpreted by 269 teleradiologists with a fellowship of neuroradiology, abdominal radiology, or musculoskeletal radiology. When providing final interpretations, client on-site radiologists voluntarily submitted quality assurance (QA) requests if preliminary and final interpretations were discrepant; the teleradiology company's QA committee categorized discrepancies as major (n = 8444) or minor (n = 17,208). Associations among examination type (common vs advanced), relationship between examination subspecialty and the teleradiologist's fellowship (concordant vs discordant), and major and minor discrepancies were assessed using three-way conditional analyses with generalized estimating equations. RESULTS. For examinations with a concordant subspecialty, the major discrepancy rate was lower for common than for advanced examinations (0.13% vs 0.26%; relative risk [RR], 0.50, 95% CI, 0.42-0.60; p < .001). For examinations with a discordant subspecialty, the major discrepancy rate was lower for common than advanced examinations (0.14% vs 0.18%; RR, 0.81; 95% CI, 0.72-0.90; p < .001). For common examinations, the major discrepancy rate was not different between examinations with concordant versus discordant subspecialty (0.13% vs 0.14%; RR, 0.90; 95% CI, 0.81-1.01; p = .07). For advanced examinations, the major discrepancy rate was higher for examinations with concordant versus discordant subspecialty (0.26% vs 0.18%; RR, 1.45; 95% CI, 1.18-1.79; p < .001). The minor discrepancy rate was higher among advanced examinations for those with concordant versus discordant subspecialty (0.34% vs 0.29%; RR, 1.17; 95% CI, 1.00-1.36; p = .04), but not different for other comparisons (p > .05). CONCLUSION. Major and minor discrepancy rates were not higher for acute community-setting examinations outside of interpreting radiologists' fellowship training. Discrepancy rates increased for advanced examinations. CLINICAL IMPACT. The findings support multispecialty radiologist practice in acute community settings. Efforts to match examination and interpreting radiologist sub-specialty may not reduce diagnostic discrepancies.

Radiologist errors by modality, anatomic region, and pathology for 1.6 million exams: what we have learned.

PURPOSE: To evaluate the feasibility of adding pathology to recent radiologist error characterization schemes of modality and anatomic region and the potential of this data to more specifically inform peer review and peer learning. METHODS: Quality assurance data originating from 349 radiologists in a national teleradiology practice were collected for 2019. Interpretive errors were simply categorized as major or minor. Reporting or communication errors were classified as administrative errors. Interpretive errors were then divided by modality, anatomic region and placed into one of 64 pathologic categories. RESULTS: Out of 1,628,464 studies, the discrepancy rate was 0.5% (8181/1,634,201). The 8181 total errors consisted of 2992 major errors (0.18%) and 5189 minor errors (0.32%). Precisely, 3.1% (257/8181) of total errors were administrative. Of major interpretive errors, 75.5% occurred on CT, with CT abdomen and pelvis accounting for 40.4%. The most common pathologic discrepancy for all exams was in the category of mass, nodule, or adenopathy (1583/8181), the majority of which were minor (1315/1583). The most common pathologic discrepancy for the 2937 major interpretive errors was fracture or dislocation (27%; 793/2937), followed by bleed (10.7%; 315/2937). CONCLUSION: The addition of error-related pathology to peer review is both feasible and practical and provides a more detailed guide to targeted individual and practice-wide peer learning quality improvement efforts. Future research is needed to determine if there are measurable improvements in detection or interpretation of specific pathologies following error feedback and educational interventions.

Radiologist Opinions of a Quality Assurance Program: The Interaction Between Error, Emotion, and Preventative Action.

RATIONALE AND OBJECTIVES: To investigate inter-relationships between radiologist opinions of a quality assurance (QA) program, QA Committee communications, negative emotions, self-identified risk factors, and preventive actions taken following major errors. MATERIALS AND METHODS: A 48 question electronic survey was distributed to all 431 radiologists within the same teleradiology organization between June 15 and July 3, 2018. Two reminders were sent during the survey time period. Descriptive statistics were generated, and comparisons were made with Fisher exact test. Significance level was set at p < 0.05. RESULTS: Response rate was 67.5% (291/431), and 72.5% of respondents completed all survey questions. A total of 64.3% of respondents were male, and the highest proportion of radiologists (28.9%, 187/291) had been in practice >20 years. Preventative actions following an error were positively correlated to a higher opinion of the QA process, self-identification of personal risk factors for error, and greater negative emotions following an error (all p < 0.05). A higher opinion of communications with the QA committee was associated with a positive opinion of the QA process (p < 0.001). An inverse relationship existed between negative emotion and opinion of QA committee communications (p < 0.05) and negative emotion and opinion of the QA process (p < 0.05). Radiologist gender and full time versus part time status had a significant effect on perception of the QA process (p < 0.05). CONCLUSION: Radiologist opinions of their institutional QA process was related to the number of negative emotions experienced and preventative actions taken following major errors. Nurturing trust and incorporating more positive feedback in the QA process may improve interactions with QA Committees and mitigate future errors.

Effect of intravenous contrast for CT abdomen and pelvis on detection of urgent and non-urgent pathology: can repeat CT within 72 hours be avoided?

PURPOSE: To determine if administering IV contrast for CT abdomen and pelvis improves detection of urgent and clinically important non-urgent pathology in patients with urgent clinical symptoms compared to patients not receiving IV contrast, and in turn to determine whether repeat CT exams on the same patient within 72 h were of low diagnostic benefit if the first CT was performed with IV contrast. METHODS: We evaluated 400 consecutive patients who had CT abdomen and pelvis (CT AP) examinations repeated within 72 h. For each patient, demographic data, reason for examination, examination time stamps, and examination technique were documented. CT AP radiology reports were reviewed and both urgent and non-urgent pathology was extracted. RESULTS: Of 400 patients, 63% had their initial CT AP without contrast. Administration of IV contrast for the first CT AP was associated with increased detection of urgent findings compared with non-contrast CT (p = 0.004) and a contrast-enhanced CT AP following an initial non-contrast CT AP examination better characterized both urgent (p = 0.002) and non-urgent findings (p < 0.001). Adherence to ACR appropriateness criteria for IV contrast administration was associated with increased detection of urgent pathology on the first CT (p = 0.02), and the second CT was more likely to be performed with IV contrast if recommended by the radiologist reading the first CT (p = 0.0006). CONCLUSION: In the absence of contraindications, encouraging urgent care physicians to preferentially order IV contrast-enhanced CT AP examinations in adherence with ACR appropriateness criteria may increase detection of urgent pathology and avoid short-term repeat CT AP.

Effect of Shift, Schedule, and Volume on Interpretive Accuracy: A Retrospective Analysis of 2.9 Million Radiologic Examinations.

Purpose To determine whether there is an association between radiologist shift length, schedule, or examination volume and interpretive accuracy. Materials and Methods This study was institutional review board approved and HIPAA compliant. A retrospective analysis of all major discrepancies from a 2015 quality assurance database of a teleradiology practice was performed. Board-certified radiologists provided initial preliminary interpretations. Discrepancies were identified during a secondary review by a practicing radiologist or through an internal quality assurance process and were vetted through a consensus radiology quality assurance committee. Unique anonymous radiologist identifiers were used to link the discrepancies to radiologists' shifts and schedules. Data were analyzed by using analysis of variance, t test, or χ2 test. Results A total of 4294 major discrepancies resulted from 2 922 377 examinations (0.15%). There was a significant difference for shift length (P < .0001) and volume (P < .0001) for shifts with versus those without discrepancies. On average, errors occurred a mean (± standard deviation) of 8.97 hours ± 2.28 into the shift (median, 10 hours; interquartile range, 2.0 hours). Significantly more errors occurred late in shifts than early (P < .0001), peaking between 10 and 12 hours. The number of major discrepancies in a single shift ranged from one to four, with a significant difference in the number of discrepancies as a function of study volume (volume for all shifts, 67.60 ± 60.24; volume for shifts with major discrepancies, 118.96 ± 66.89; P < .001). Despite a trend for more discrepancies after more consecutive days worked, the difference was not significant (P = .0893). Conclusion Longer shifts and higher diagnostic examination volumes are associated with increased major interpretive discrepancies. These are more likely to occur later in a shift, peaking after the 10th hour of work. © RSNA, 2017.

The critical role of acute flaccid paralysis surveillance in the Global Polio Eradication Initiative.

Acute flaccid paralysis (AFP) surveillance is a key strategy used by the Global Polio Eradication Initiative (GPEI) to measure progress towards reaching the global eradication goal. Supported by a global polio laboratory network, AFP surveillance is conducted in 179 of 194 WHO member states. Active surveillance visits to priority health facilities are used to assure all children <15 years with AFP are detected, followed by stool specimen collection and testing for poliovirus in WHO-accredited polio laboratories. The quality of AFP surveillance is regularly monitored with standardized surveillance quality indicators. In highest risk countries and areas, the sensitivity of AFP surveillance is enhanced by environmental surveillance (testing of sewage samples). Genetic sequencing of detected poliovirus isolates yields programmatically important information on polio transmission pathways. AFP surveillance is one of the most valuable assets of the GPEI, with the potential to serve as a platform to build integrated disease surveillance systems. Continued support to maintain AFP surveillance systems will be essential, to reliably monitor the completion of global polio eradication, and to assure that a key resource for building surveillance capacity is transitioned post-eradication to support other health priorities.

An assessment of the geographical risks of wild and vaccine-derived poliomyelitis outbreaks in Africa and Asia.

BACKGROUND: The international spread of wild poliomyelitis outbreaks continues to threaten eradication of poliomyelitis and in 2014 a public health emergency of international concern was declared. Here we describe a risk scoring system that has been used to assess country-level risks of wild poliomyelitis outbreaks, to inform prioritisation of mass vaccination planning, and describe the change in risk from 2014 to 2016. The methods were also used to assess the risk of emergence of vaccine-derived poliomyelitis outbreaks. METHODS: Potential explanatory variables were tested against the reported outbreaks of wild poliomyelitis since 2003 using multivariable regression analysis. The regression analysis was translated to a risk score and used to classify countries as Low, Medium, Medium High and High risk, based on the predictive ability of the score. RESULTS: Indicators of population immunity, population displacement and diarrhoeal disease were associated with an increased risk of both wild and vaccine-derived outbreaks. High migration from countries with wild cases was associated with wild outbreaks. High birth numbers were associated with an increased risk of vaccine-derived outbreaks. CONCLUSIONS: Use of the scoring system is a transparent and rapid approach to assess country risk of wild and vaccine-derived poliomyelitis outbreaks. Since 2008 there has been a steep reduction in the number of wild poliomyelitis outbreaks and the reduction in countries classified as High and Medium High risk has reflected this. The risk of vaccine-derived poliomyelitis outbreaks has varied geographically. These findings highlight that many countries remain susceptible to poliomyelitis outbreaks and maintenance or improvement in routine immunisation is vital.

Emergency Radiology Practice Patterns: Shifts, Schedules, and Job Satisfaction.

PURPOSE: To assess the practice environment of emergency radiologists with a focus on schedule, job satisfaction, and self-perception of health, wellness, and diagnostic accuracy. METHODS: A survey drawing from prior radiology and health care shift-work literature was distributed via e-mail to national societies, teleradiology groups, and private practices. The survey remained open for 4 weeks in 2016, with one reminder. Data were analyzed using hypothesis testing and logistic regression modeling. RESULTS: Response rate was 29.6% (327/1106); 69.1% of respondents (n = 226) were greater than 40 years old, 73% (n = 240) were male, and 87% (n = 284) practiced full time. With regard to annual overnight shifts (NS): 36% (n = 118) did none, 24.9% (n = 81) did 182 or more, and 15.6% (n = 51) did 119. There was a significant association between average NS worked per year and both perceived negative health effects (P < .01) and negative impact on memory (P < .01). There was an inverse association between overall job enjoyment and number of annual NS (P < .05). The odds of agreeing to the statement "I enjoy my job" for radiologists who work no NS is 2.21 times greater than for radiologists who work at least 119 NS, when shift length is held constant. Radiologists with 11+ years of experience who work no NS or 1 to 100 NS annually have lower odds of feeling overwhelmed when compared with those working the same number of NS with <10 years' experience. CONCLUSION: There is significant variation in emergency radiology practice patterns. Annual NS burden is associated with lower job satisfaction and negative health self-perception.