Cycle-Consistent Adversarial Networks for Smoke Detection and Removal in Endoscopic Images

During endoscopic surgery, smoke removal is important and meaningful for increasing the visual quality of endoscopic images. However, unlike natural image dehaze, it is practical impossible to build a large paired endoscopic image training dataset with/without smoke. Therefore, in this paper, we propose a new approach, called Desmoke-CycleGAN, which combined detection and removal of smoke together, to improve the CycleGAN model for endoscopic image smoke removal. The detector can provide information about smoke locations and densities, which helps the GAN model to be more stable and efficient for smoke removal. Although some imperfections still exist, the experimental results have demonstrated that this method outperforms other state-of-the-art smoke removal approaches with unpaired real endoscopic images.