Taking PI-QUAL beyond the prostate: Towards a standardized radiological image quality score (RI-QUAL)

Purpose: To compare the interreader agreement of a novel quality score, called the Radiological Image Quality Score (RI-QUAL), to a slighly modified version of the existing Prostate Imaging Quality (mPI-QUAL) score for magnetic resonance imaging (MRI) of the prostate. Methods: A total of 43 consecutive scans were evaluated by two subspecialized radiologists who assigned scores using both the RI-QUAL and mPI-QUAL methods. The interreader agreement was analyzed using three statistical methods: concordance correlation coefficient (CCC), intraclass correlation coefficient (ICC), and Cohen's kappa. Time needed to arrive at a quality judgment was measured and compared using the Wilcoxon signed rank test. Results: The interreader agreement for RI-QUAL and mPI-QUAL scores was comparable, as evidenced by the high CCC (0.76 vs. 0.77, p = 0.93), ICC (0.86 vs. 0.87, p = 0.93), and moderate Cohen's kappa (0.61 vs. 0.64, p = 0.85) values. Moreover, RI-QUAL assessment was faster than mPI-QUAL (19 vs. 40 s, p = 0.001). Conclusion: RI-QUAL is a new quality score that has comparable interreader agreement to the mPI-QUAL score, but with the potential to be applied to different MRI protocols and even different modalities. Like PI-QUAL, RIQUAL may also facilitate communication about quality to referring physicians, as it provides a standardized and easily interpretable score. Further studies are warranted to validate the usefulness of RI-QUAL in larger patient cohorts and for other imaging modalities.