Illumination-Guided progressive unsupervised domain adaptation for low-light instance segmentation

被引:0
|
作者
Zhang, Yi [1 ]
Guo, Jichang [1 ,2 ]
Yue, Huihui [3 ]
Zheng, Sida [1 ]
Liu, Chonghao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
[3] Nanyang Technol Univ, Sch Phys & Math Sci, Singapore, Singapore
基金
中国国家自然科学基金;
关键词
Instance segmentation; Unsupervised domain adaptation; Low-light image; Retinex;
D O I
10.1016/j.neunet.2024.106958
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to limited photons, low-light environments pose significant challenges for computer vision tasks. Unsupervised domain adaptation offers a potential solution, but struggles with domain misalignment caused by inadequate utilization of features at different stages. To address this, we propose an Illumination-Guided Progressive Unsupervised Domain Adaptation method, called IPULIS, for low-light instance segmentation by progressively exploring the alignment of features at image-, instance-, and pixel-levels between normal- and low-light conditions under illumination guidance. This is achieved through: (1) an Illumination-Guided Domain Discriminator (IGD) for image-level feature alignment using retinex-derived illumination maps, (2) a Foreground Focus Module (FFM) incorporating global information with local center features to facilitate instance-level feature alignment, and (3) a Contour-aware Domain Discriminator (CAD) for pixel-level feature alignment by matching contour vertex features from a contour-based model. By progressively deploying these modules, IPULIS achieves precise feature alignment, leading to high-quality instance segmentation. Experimental results demonstrate that our IPULIS achieves state-of-the-art performance on real-world low-light dataset LIS.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Unsupervised Camouflaged Object Segmentation as Domain Adaptation
    Zhang, Yi
    Wu, Chengyi
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 4336 - 4346
  • [32] Unsupervised Domain Adaptation for LiDAR Panoptic Segmentation
    Besic, Borna
    Gosala, Nikhil
    Cattaneo, Daniele
    Valada, Abhinav
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 3404 - 3411
  • [33] Rethinking unsupervised domain adaptation for semantic segmentation
    Wang, Zhijie
    Suganuma, Masanori
    Okatani, Takayuki
    PATTERN RECOGNITION LETTERS, 2024, 186 : 119 - 125
  • [34] Unsupervised Domain Adaptation for Referring Semantic Segmentation
    Shi, Haonan
    Pan, Wenwen
    Zhao, Zhou
    Zhang, Mingmin
    Wu, Fei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5807 - 5818
  • [35] Multichannel Semantic Segmentation with Unsupervised Domain Adaptation
    Watanabe, Kohei
    Saito, Kuniaki
    Ushiku, Yoshitaka
    Harada, Tatsuya
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 600 - 616
  • [36] Geometric Unsupervised Domain Adaptation for Semantic Segmentation
    Guizilini, Vitor
    Li, Jie
    Ambrus, Rares
    Gaidon, Adrien
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8517 - 8527
  • [37] A Versatile Framework for Unsupervised Domain Adaptation Based on Instance Weighting
    Zhu, Jinjing
    Ye, Feiyang
    Xiao, Qiao
    Guo, Pengxin
    Zhang, Yu
    Yang, Qiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6633 - 6646
  • [38] DOMAIN ADAPTATION FOR UNKNOWN IMAGE DISTORTIONS IN INSTANCE SEGMENTATION
    Gruber, Maximiliane
    Brand, Fabian
    Mosebach, Alina
    Seiler, Juergen
    Kaup, Andre
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1436 - 1440
  • [39] Independent Feature Decomposition and Instance Alignment for Unsupervised Domain Adaptation
    He, Qichen
    Xiao, Siying
    Ye, Mao
    Zhu, Xiatian
    Neri, Ferrante
    Hou, Dongde
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 819 - 827
  • [40] Prior Knowledge Guided Unsupervised Domain Adaptation
    Sun, Tao
    Lu, Cheng
    Ling, Haibin
    COMPUTER VISION - ECCV 2022, PT XXXIII, 2022, 13693 : 639 - 655