Comparison of chest CT severity scoring systems for COVID-19

Purpose To compare the diagnostic performance and inter-observer agreement of five different CT chest severity scoring systems for COVID-19 to find the most precise one with the least interpretation time. Methods and materials This retrospective study included 85 patients (54 male and 31 female) with PCR-confirmed COVID-19. They underwent CT to assess the severity of pulmonary involvement. Three readers were asked to assess the pulmonary abnormalities and score the severity using five different systems, including chest CT severity score (CT-SS), chest CT score, total severity score (TSS), modified total severity score (m-TSS), and 3-level chest CT severity score. Time consumption on reporting of each system was calculated. Results Two hundred fifty-five observations were reported for each system. There was a statistically significant interobserver agreement in assessing qualitative lung involvement using the m-TSS and the other four quantitative systems. The ROC curves revealed excellent and very good diagnostic accuracy for all systems when cutoff values for detection severe cases were > 22, > 17,> 12, and > 26 for CT-SS, chest CT score, TSS, and 3-level CT severity score. The AUC was very good (0.86), excellent (0.90), very good (0.89), and very good (0.86), respectively. Chest CT score showed the highest specificity (95.2%) in discrimination of severe cases. Time consumption on reporting was significantly different (<0.001): CT-SS > 3L-CT-SS > chest CT score > TSS. Conclusion All chest CT severity scoring systems in this study demonstrated excellent inter-observer agreement and reasonable performance to assess COVID-19 in relation to the clinical severity. CT-SS and TSS had the highest specificity and least time for interpretation.