Utilization of artificial intelligence to triage patients with delayed follow-up of probably benign breast ultrasound findings

Purpose: This study aimed to evaluate our institution's experience in using artificial intelligence (AI) decision support (DS) as part of the clinical workflow to triage patients with Breast Imaging Reporting and Data System (BI-RADS) 3 sonographic lesions whose follow-up was delayed during the coronavirus disease 2019 (COVID-19) pandemic, against subsequent imaging and/or pathologic follow-up results. Methods: This retrospective study included patients with a BI-RADS category 3 (i.e., probably benign) breast ultrasound assessment from August 2019-December 2019 whose follow-up was delayed during the COVID-19 pandemic and whose breast ultrasounds were re-reviewed using Koios DS Breast AI as part of the clinical workflow for triaging these patients. The output of Koios DS was compared with the true outcome of a presence or absence of breast cancer defined by resolution/stability on imaging follow-up for at least 2 years or pathology results. Results: The study included 161 women (mean age, 52 years) with 221 BI-RADS category 3 sonographic lesions. Of the 221 lesions, there were two confirmed cancers (0.9% malignancy rate). Koios DS assessed 112/221 lesions (50.7%) as benign, 42/221 lesions (19.0%) as probably benign, 64/221 lesions (29.0%) as suspicious, and 3/221 lesions (1.4%) as probably malignant. Koios DS had a sensitivity of 100% (2/2; 95% confidence interval [CI], 16% to 100%), specificity of 70% (154/219; 95% CI, 64% to 76%), negative predictive value of 100% (154/154; 95% CI, 98% to 100%), and false-positive rate of 30% (65/219; 95% CI, 24% to 36%). Conclusion: When many follow-up appointments are delayed, e.g., natural disaster, or scenarios where resources are limited, breast ultrasound AI DS can help triage patients with probably benign breast ultrasounds.