Illumination-Guided progressive unsupervised domain adaptation for low-light instance segmentation

被引:0
|
作者
Zhang, Yi [1 ]
Guo, Jichang [1 ,2 ]
Yue, Huihui [3 ]
Zheng, Sida [1 ]
Liu, Chonghao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
[3] Nanyang Technol Univ, Sch Phys & Math Sci, Singapore, Singapore
基金
中国国家自然科学基金;
关键词
Instance segmentation; Unsupervised domain adaptation; Low-light image; Retinex;
D O I
10.1016/j.neunet.2024.106958
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to limited photons, low-light environments pose significant challenges for computer vision tasks. Unsupervised domain adaptation offers a potential solution, but struggles with domain misalignment caused by inadequate utilization of features at different stages. To address this, we propose an Illumination-Guided Progressive Unsupervised Domain Adaptation method, called IPULIS, for low-light instance segmentation by progressively exploring the alignment of features at image-, instance-, and pixel-levels between normal- and low-light conditions under illumination guidance. This is achieved through: (1) an Illumination-Guided Domain Discriminator (IGD) for image-level feature alignment using retinex-derived illumination maps, (2) a Foreground Focus Module (FFM) incorporating global information with local center features to facilitate instance-level feature alignment, and (3) a Contour-aware Domain Discriminator (CAD) for pixel-level feature alignment by matching contour vertex features from a contour-based model. By progressively deploying these modules, IPULIS achieves precise feature alignment, leading to high-quality instance segmentation. Experimental results demonstrate that our IPULIS achieves state-of-the-art performance on real-world low-light dataset LIS.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Unsupervised Illumination Adaptation for Low-Light Vision
    Wang, Wenjing
    Luo, Rundong
    Yang, Wenhan
    Liu, Jiaying
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (09) : 5951 - 5966
  • [2] An illumination-guided dual attention vision transformer for low-light image enhancement
    Wen, Yanjie
    Xu, Ping
    Li, Zhihong
    Xu, Wangtu
    PATTERN RECOGNITION, 2025, 158
  • [3] Illumination-guided semi-supervised network for low-light image enhancement jointly with denoising
    Ouyang, Jingzhi
    Huang, Keya
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (11) : 7821 - 7831
  • [4] LIIS: Low-light image instance segmentation
    Li, Wei
    Huang, Ya
    Zhang, Xinyuan
    Han, Guijin
    Journal of Visual Communication and Image Representation, 2024, 100
  • [5] LIIS: Low-light image instance segmentation
    Li, Wei
    Huang, Ya
    Zhang, Xinyuan
    Han, Guijin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [6] ZERO-IG: Zero-Shot Illumination-Guided Joint Denoising and Adaptive Enhancement for Low-Light Images
    Shi, Yiqi
    Liu, Duo
    Zhang, Liguo
    Tian, Ye
    Xia, Xuezhi
    Fu, Xiaojing
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 3015 - 3024
  • [7] Low-light Image Enhancement with Domain Adaptation
    Zhang, Yunjie
    Gao, Bin
    2022 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY, HUMAN-COMPUTER INTERACTION AND ARTIFICIAL INTELLIGENCE, VRHCIAI, 2022, : 55 - 60
  • [8] Unsupervised domain adaptation for clinician pose estimation and instance segmentation in the operating room
    Srivastav, Vinkle
    Gangi, Afshin
    Padoy, Nicolas
    MEDICAL IMAGE ANALYSIS, 2022, 80
  • [9] Unsupervised Low-Light Image Enhancement in the Fourier Transform Domain
    Ming, Feng
    Wei, Zhihui
    Zhang, Jun
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [10] Unsupervised Domain Adaptation with Regularized Domain Instance Denoising
    Csurka, Gabriela
    Chidlowskii, Boris
    Clinchant, Stephane
    Michel, Sophia
    COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 458 - 466