Illumination-Guided progressive unsupervised domain adaptation for low-light instance segmentation

被引:0
|
作者
Zhang, Yi [1 ]
Guo, Jichang [1 ,2 ]
Yue, Huihui [3 ]
Zheng, Sida [1 ]
Liu, Chonghao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
[3] Nanyang Technol Univ, Sch Phys & Math Sci, Singapore, Singapore
基金
中国国家自然科学基金;
关键词
Instance segmentation; Unsupervised domain adaptation; Low-light image; Retinex;
D O I
10.1016/j.neunet.2024.106958
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to limited photons, low-light environments pose significant challenges for computer vision tasks. Unsupervised domain adaptation offers a potential solution, but struggles with domain misalignment caused by inadequate utilization of features at different stages. To address this, we propose an Illumination-Guided Progressive Unsupervised Domain Adaptation method, called IPULIS, for low-light instance segmentation by progressively exploring the alignment of features at image-, instance-, and pixel-levels between normal- and low-light conditions under illumination guidance. This is achieved through: (1) an Illumination-Guided Domain Discriminator (IGD) for image-level feature alignment using retinex-derived illumination maps, (2) a Foreground Focus Module (FFM) incorporating global information with local center features to facilitate instance-level feature alignment, and (3) a Contour-aware Domain Discriminator (CAD) for pixel-level feature alignment by matching contour vertex features from a contour-based model. By progressively deploying these modules, IPULIS achieves precise feature alignment, leading to high-quality instance segmentation. Experimental results demonstrate that our IPULIS achieves state-of-the-art performance on real-world low-light dataset LIS.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] MAGAN: Unsupervised Low-Light Image Enhancement Guided by Mixed-Attention
    Wang, Renjun
    Jiang, Bin
    Yang, Chao
    Li, Qiao
    Zhang, Bolin
    BIG DATA MINING AND ANALYTICS, 2022, 5 (02) : 110 - 119
  • [22] MAGAN:Unsupervised Low-Light Image Enhancement Guided by Mixed-Attention
    Renjun Wang
    Bin Jiang
    Chao Yang
    Qiao Li
    Bolin Zhang
    Big Data Mining and Analytics, 2022, (02) : 110 - 119
  • [23] Low Category Uncertainty and High Training Potential Instance Learning for Unsupervised Domain Adaptation
    Zhang, Xinyu
    Kang, Meng
    Lu, Shuai
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16881 - 16889
  • [24] Instance Segmentation with Unsupervised Adaptation to Different Domains for Autonomous Vehicles
    Diaz-Zapata, Manuel
    Erkent, Ozgur
    Laugier, Christian
    16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 421 - 427
  • [25] Progressive Feature Alignment for Unsupervised Domain Adaptation
    Chen, Chaoqi
    Xie, Weiping
    Huang, Wenbing
    Rong, Yu
    Ding, Xinghao
    Huang, Yue
    Xu, Tingyang
    Huang, Junzhou
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 627 - 636
  • [26] Unsupervised Instance Segmentation in Microscopy Images via Panoptic Domain Adaptation and Task Re-weighting
    Liu, Dongnan
    Zhang, Donghao
    Song, Yang
    Zhang, Fan
    O'Donnell, Lauren
    Huang, Heng
    Chen, Mei
    Cai, Weidong
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4242 - 4251
  • [27] Unsupervised Domain Adaptation for Instance Segmentation: Extracting Dwellings in Temporary Settlements Across Various Geographical Settings
    Gella, Getachew Workineh
    Pelletier, Charlotte
    Lefevre, Sebastien
    Wendt, Lorenz
    Tiede, Dirk
    Lang, Stefan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 1701 - 1718
  • [28] Low-Light Image Enhancement by Refining Illumination Map with Self-guided Filtering
    Feng, Zhuang
    Hao, Shijie
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (IEEE ICBK 2017), 2017, : 183 - 187
  • [29] Illumination-aware and structure-guided transformer for low-light image enhancement
    Fan, Guodong
    Yao, Zishu
    Gan, Min
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2025, 252
  • [30] Unsupervised Domain Adaptation in Semantic Segmentation: A Review
    Toldo, Marco
    Maracani, Andrea
    Michieli, Umberto
    Zanuttigh, Pietro
    TECHNOLOGIES, 2020, 8 (02)