Bifurcated convolutional network for specular highlight removal

被引:2
|
作者
Xu, Jingting [1 ]
Liu, Sheng [1 ]
Chen, Guanzhou [1 ]
Liu, Qianxi [1 ]
机构
[1] Zhejiang Univ Technol, Coll Comp Sci & Technol, Hangzhou 310023, Peoples R China
关键词
A;
D O I
10.1007/s11801-023-3029-6
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Specular highlight usually causes serious information degradation, which leads to the failure of many computer vision algorithms. We have proposed a novel bifurcated convolution neural network to tackle the problem of high reflectivity image information degradation. A two-stage process is proposed for the extraction and elimination of the specular highlight features, with the procedure starting at a coarse level and progressing towards a finer level, to ensure the generated diffuse images are less affected by visual artifacts and information distortions. A bifurcated feature selection module is designed to remove the specular highlight features, thereby enhancing the detection capability of the network. The experiments on two types of challenging datasets demonstrate that our method outperforms state-of-the-art approaches for specular highlight detection and removal. The effectiveness of the proposed bifurcated feature selection module and the overall network is also verified.
引用
收藏
页码:756 / 761
页数:6
相关论文
共 50 条
  • [31] Accurate Image Specular Highlight Removal Based on Light Field Imaging
    Xu, Chenxue
    Wang, Xingzheng
    Wang, Haoqian
    Zhang, Yongbing
    2015 VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2015,
  • [32] SIHRNet: a fully convolutional network for single image highlight removal with a real-world dataset
    Wang, Xucheng
    Tao, Chenning
    Tao, Xiao
    Zheng, Zhenrong
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (03)
  • [33] Specular highlight removal and depth estimation based on polarization characteristics of light field
    Feng, Wei
    Cheng, Xionghao
    Sun, Jichen
    Xiong, Zhi
    Zhai, Zhongsheng
    OPTICS COMMUNICATIONS, 2023, 537
  • [34] Mask-Guided Joint Single Image Specular Highlight Detection and Removal
    Chen, Hao
    Li, Li
    Yu, Neng
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX, 2024, 14433 : 457 - 468
  • [35] Specular Highlight Removal Using Reflection Component Separation and Joint Bilateral Filtering
    Jung, Cheolkon
    Jiao, Licheng
    Qi, Hongtao
    INTELLIGENT SCIENCE AND INTELLIGENT DATA ENGINEERING, ISCIDE 2011, 2012, 7202 : 513 - 521
  • [36] Automatic and Robust Single-Camera Specular Highlight Removal in Cardiac Images
    Alsaleh, Samar M.
    Aviles, Angelica I.
    Sobrevilla, Pilar
    Casals, Alicia
    Hahn, James K.
    2015 37TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2015, : 675 - 678
  • [37] Joint network for specular highlight detection and adversarial generation of specular-free images trained with polarimetric data
    Anwer, Atif
    Ainouz, Samia
    Saad, Naufal M.
    Ali, Syed Saad Azhar
    Meriaudeau, Fabrice
    NEUROCOMPUTING, 2023, 559
  • [38] Joint specular highlight detection and removal in single images via Unet-Transformer
    Wu, Zhongqi
    Guo, Jianwei
    Zhuang, Chuanqing
    Xiao, Jun
    Yan, Dong-Ming
    Zhang, Xiaopeng
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (01) : 141 - 154
  • [39] SpecSeg Network for Specular Highlight Detection and Segmentation in Real-World Images
    Anwer, Atif
    Ainouz, Samia
    Saad, Mohamad Naufal Mohamad
    Ali, Syed Saad Azhar
    Meriaudeau, Fabrice
    SENSORS, 2022, 22 (17)
  • [40] Anti-noise light field depth measurement using specular highlight removal
    Wu, Wei
    Jin, Longxu
    Qi, Biao
    Li, Guoning
    Li, Jin
    OPTICS AND LASERS IN ENGINEERING, 2024, 176