Evaluation of a revised version of computer-assisted diagnosis system, BONENAVI version 2.1.7, for bone scintigraphy in cancer patients

BONENAVI is a computer-assisted diagnosis system that analyzes bone scintigraphy automatically. We experienced more than a few segmentation errors with the previous BONENAVI version (2.0.5). We have since obtained a revised version (2.1.7) and evaluate it. Bone scans of patients were analyzed by BONENAVI version 2.0.5 and a revised version 2.1.7 with regard to segmentation errors, sensitivity, and specificity. Patients with skeletal metastases from prostate cancer, lung cancer, breast cancer, and other cancers were included in the study as true-positive cases. Patients with no skeletal metastasis (regardless of hot spots), and patients with abnormal bone scans but no skeletal metastasis were included as negative cases. Bone-scan patients were subjected to artificial neural network (ANN) evaluation. Values equal to or above 0.5 were regarded as positive, and those below 0.5 as negative. The patients whose clinical status did not correspond to their ANN scores were assessed for any similarities. The frequency of segmentation errors was statistically significantly reduced when using BONENAVI version 2.1.7. The differences in sensitivity and specificity for the results of version 2.0.5 versus version 2.1.7 were not different, giving a high Cohen's kappa coefficient. In the patients who showed an increased ANN value with version 2.1.7, a few false-positive thoracic lesions were identified. Patients whose ANN value was significantly high with version 2.0.5 showed no tendencies. Revised BONENAVI version 2.1.7 for bone scintigraphy was superior with regard to segmentation errors. However, its sensitivity and specificity were similar to those of version 2.0.5. The false-positive identification of thoracic lesions in revised version 2.1.7 might be subject to remedy.