Illumination-Guided progressive unsupervised domain adaptation for low-light instance segmentation

被引:0
|
作者
Zhang, Yi [1 ]
Guo, Jichang [1 ,2 ]
Yue, Huihui [3 ]
Zheng, Sida [1 ]
Liu, Chonghao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
[3] Nanyang Technol Univ, Sch Phys & Math Sci, Singapore, Singapore
基金
中国国家自然科学基金;
关键词
Instance segmentation; Unsupervised domain adaptation; Low-light image; Retinex;
D O I
10.1016/j.neunet.2024.106958
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to limited photons, low-light environments pose significant challenges for computer vision tasks. Unsupervised domain adaptation offers a potential solution, but struggles with domain misalignment caused by inadequate utilization of features at different stages. To address this, we propose an Illumination-Guided Progressive Unsupervised Domain Adaptation method, called IPULIS, for low-light instance segmentation by progressively exploring the alignment of features at image-, instance-, and pixel-levels between normal- and low-light conditions under illumination guidance. This is achieved through: (1) an Illumination-Guided Domain Discriminator (IGD) for image-level feature alignment using retinex-derived illumination maps, (2) a Foreground Focus Module (FFM) incorporating global information with local center features to facilitate instance-level feature alignment, and (3) a Contour-aware Domain Discriminator (CAD) for pixel-level feature alignment by matching contour vertex features from a contour-based model. By progressively deploying these modules, IPULIS achieves precise feature alignment, leading to high-quality instance segmentation. Experimental results demonstrate that our IPULIS achieves state-of-the-art performance on real-world low-light dataset LIS.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Instance Segmentation of Neuronal Nuclei Leveraging Domain Adaptation
    Brady, Kevin
    Khorrami, Pooya
    Gjesteby, Lars
    Brattain, Laura
    2021 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2021,
  • [42] Weakly Supervised Method for Domain Adaptation in Instance Segmentation
    Sun, Jie
    Tian, Yan
    Wang, Jialei
    Xu, Zhaocheng
    Wang, Hao
    Jiang, Zhaoyi
    Wang, Xun
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT I, 2024, 14495 : 204 - 217
  • [43] Towards the Target: Self-regularized Progressive Learning for Unsupervised Domain Adaptation on Semantic Segmentation
    Chang, Jui
    Pang, Yu-Ting
    Hsu, Chiou-Ting
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 299 - 313
  • [44] Unsupervised Low-Light Image Enhancement via Virtual Diffraction Information in Frequency Domain
    Zhang, Xupei
    Qin, Hanlin
    Yu, Yue
    Yan, Xiang
    Yang, Shanglin
    Wang, Guanghao
    REMOTE SENSING, 2023, 15 (14)
  • [45] MaCo: efficient unsupervised low-light image enhancement via illumination-based magnitude control
    Shi, Yiqi
    Liu, Duo
    Zhang, Liguo
    Xia, Xuezhi
    Sun, Jianguo
    VISUAL COMPUTER, 2024, 40 (12): : 8481 - 8499
  • [46] Unsupervised Wasserstein Distance Guided Domain Adaptation for 3D Multi-domain Liver Segmentation
    You, Chenyu
    Yang, Junlin
    Chapiro, Julius
    Duncan, James S.
    INTERPRETABLE AND ANNOTATION-EFFICIENT LEARNING FOR MEDICAL IMAGE COMPUTING, IMIMIC 2020, MIL3ID 2020, LABELS 2020, 2020, 12446 : 155 - 163
  • [47] EDRL: Entropy-guided disentangled representation learning for unsupervised domain adaptation in semantic segmentation
    Wang, Runze
    Zhou, Qin
    Zheng, Guoyan
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 240
  • [48] Deep Unsupervised Progressive Learning for Distant Domain Adaptation
    Xiang, Suncheng
    Fu, Yuzhuo
    Liu, Ting
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 903 - 908
  • [49] Joint Progressive Knowledge Distillation and Unsupervised Domain Adaptation
    Nguyen-Meidine, Le Thanh
    Granger, Eric
    Kiran, Madhu
    Dolz, Jose
    Blais-Morin, Louis-Antoine
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [50] Progressive Decision Boundary Shifting for Unsupervised Domain Adaptation
    Li, Liang
    Lu, Tongyu
    Sun, Yaoqi
    Gao, Yuhan
    Yan, Chenggang
    Hu, Zhenghui
    Huang, Qingming
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 274 - 285