A real-time interpretable artificial intelligence model for the cholangioscopic diagnosis of malignant biliary stricture (with videos)

Background and Aims: It is crucial to accurately determine malignant biliary strictures (MBSs) for early curative treatment. This study aimed to develop a real-time interpretable artificial intelligence (AI) system to predict MBSs under digital single-operator cholangioscopy (DSOC). Methods: A novel interpretable AI system called MBSDeiT was developed consisting of 2 models to identify qualified images and then predict MBSs in real time. The overall efficiency of MBSDeiT was validated at the image level on internal, external, and prospective testing data sets and subgroup analyses, and at the video level on the prospective data sets; these findings were compared with those of the endoscopists. The association between AI predictions and endoscopic features was evaluated to increase the interpretability. Results: MBSDeiT can first automatically select qualified DSOC images with an area under the curve (AUC) of .963 and .968 to .973 on the internal testing data set and the external testing data sets, and then identify MBSs with an AUC of .971 on the internal testing data set, an AUC of .978 to .999 on the external testing data sets, and an AUC of .976 on the prospective testing data set, respectively. MBSDeiT accurately identified 92.3% of MBSs in prospective testing videos. Subgroup analyses confirmed the stability and robustness of MBSDeiT. The AI system achieved superior performance to that of expert and novice endoscopists. The AI predictions were significantly associated with 4 endoscopic features (nodular mass, friability, raised intraductal lesion, and abnormal vessels; P < .05) under DSOC, which is consistent with the endoscopists' predictions. Conclusions: The study findings suggest that MBSDeiT could be a promising approach for the accurate diagnosis of MBSs under DSOC.