Your browser doesn't support javascript.
Diagnostic accuracy and inter-observer agreement with the CO-RADS lexicon for CT chest reporting in COVID-19.
Nair, Anirudh Venugopalan; McInnes, Matthew; Jacob, Bamil; Kumar, Devendra; Soman, Deepak Kuttikatt; Subair, Hanee Subair Valiyakath; Mahajan, Parag Suresh; Shah, Mohammed Ameer Hamza; Sabawi, Mohammed Ali Saleh; Al-Heidous, Mahmoud.
  • Nair AV; Dept of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar. dranirudhnair@gmail.com.
  • McInnes M; The Ottawa Hospital, University of Ottawa, Ontario, Canada.
  • Jacob B; Dept of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar.
  • Kumar D; Dept of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar.
  • Soman DK; Dept of Community Medicine, Government Medical College, Palakkad, India.
  • Subair HSV; Dept of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar.
  • Mahajan PS; Dept of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar.
  • Shah MAH; Dept of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar.
  • Sabawi MAS; Dept of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar.
  • Al-Heidous M; Dept of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar.
Emerg Radiol ; 28(6): 1045-1054, 2021 Dec.
Article in English | MEDLINE | ID: covidwho-1321761
ABSTRACT

PURPOSE:

To measure the diagnostic accuracy and inter-observer agreement with the use of COVID-19 Reporting and Data System (CO-RADS) for detection of COVID-19 on CT chest imaging.

METHODS:

This retrospective study included 164 consecutive patients with clinical suspicion of COVID-19 in whom a CT chest examination was performed at a single institution between April 2020 and July 2020. Of them, 101 patients was RT-PCR positive for COVID-19. Six readers with varying radiological experience (two each of chest radiologists, general radiologists, and radiologists in training) independently assigned a CO-RADS assessment category for each CT chest study. The Fleiss' K was used to quantify inter-observer agreement. The inter-observer agreement was also assessed based on the duration of onset of symptoms to CT scan. ROC curve analysis was used to determine the diagnostic accuracy of CO-RADS. The area under curve was calculated to determine the reader accuracy for detection of COVID-19 lung involvement with RT-PCR as reference standards. The data sets were plotted in ROC space, and Youden's J statistic was calculated to determine the threshold cut-off CO-RADS category for COVID-19 positivity.

RESULTS:

There was overall moderate inter-observer agreement between all readers (Fleiss' K 0.54 [95% CI 0.54, 0.54]), with substantial agreement among chest radiologists (Fleiss' K 0.68 [95% CI 0.67, 0.68]), general radiologists (Fleiss' K 0.61 [95% CI 0.61, 0.61]), and moderate agreement among radiologists-in-training (Fleiss' K 0.56 [95% CI 0.56, 0.56]). There was overall moderate inter-observer agreement in early disease (stages 1 and 2), with cumulative Fleiss' K 0.45 [95% CI 0.45, 0.45]). The overall AUC for CO-RADS lexicon scheme to accurately diagnose COVID-19 yielded 0.92 (95% CI 0.91, 0.94) with strong concordance within and between groups, of chests radiologists with AUC of 0.91 (95% CI 0.88, 0.94), general radiologists with AUC 0.96 (95% CI 0.94, 0.98), and radiologists in training with AUC of 0.90 (95% CI 0.87, 0.94). For detecting COVID-19, ROC curve analysis yielded CO-RADS > 3 as the cut-off threshold with sensitivity 90% (95% CI 0.88, 0.93), and specificity of 87% (95% CI 0.83, 0.91).

CONCLUSION:

Readers across different levels of experience could accurately identify COVID-19 positive patients using the CO-RADS lexicon with moderate inter-observer agreement and high diagnostic accuracy.
Subject(s)
Keywords

Full text: Available Collection: International databases Database: MEDLINE Main subject: COVID-19 Type of study: Diagnostic study / Experimental Studies / Observational study / Prognostic study / Randomized controlled trials Limits: Humans Language: English Journal: Emerg Radiol Year: 2021 Document Type: Article Affiliation country: S10140-021-01967-6

Similar

MEDLINE

...
LILACS

LIS


Full text: Available Collection: International databases Database: MEDLINE Main subject: COVID-19 Type of study: Diagnostic study / Experimental Studies / Observational study / Prognostic study / Randomized controlled trials Limits: Humans Language: English Journal: Emerg Radiol Year: 2021 Document Type: Article Affiliation country: S10140-021-01967-6