SEMANTIC SEGMENTATION AND CHANGE DETECTION BY MULTI-TASK U-NET

被引:5
|
作者
Tsutsui, Shungo [1 ,2 ]
Hirakawa, Tsubasa [3 ]
Yamashita, Takayoshi [3 ]
Fujiyoshi, Hironobu [3 ]
机构
[1] Chubu Univ, Dept Comp Sci, Grad Sch Engn, Kasugai, Aichi, Japan
[2] Asia Air Survey Co Ltd, Kawasaki, Kanagawa, Japan
[3] Chubu Univ, Ctr Math Sci & Artificial Intelligence, Kasugai, Aichi, Japan
关键词
Change Detection; Semantic Segmentation; Multi-task Learning;
D O I
10.1109/ICIP42928.2021.9506560
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Change detection involves extracting the changed regions from images taken of the same place at different times. Potential applications are automatically updating of HD maps or identifying damages caused by natural disasters. However, conventional change detection methods merely detect changed regions without classifying them. In this paper, we propose a change detection method that can estimate the object class of a changed region. Our method extends a U-Net as a multi-task learning framework and estimates changed regions and semantic segmentation simultaneously. We propose using the pixel-wise classification probabilities of semantic segmentation for detecting changed regions rather than the conventional L2 norm-based difference of feature maps. In our experiments, we show that our method can improve change detection performance and estimate the classes of corresponding changed objects.
引用
收藏
页码:619 / 623
页数:5
相关论文
共 50 条
  • [1] Lesion attributes segmentation for melanoma detection with multi-task u-net
    Chen, Eric Z.
    Dong, Xu
    Li, Xiaoxiao
    Jiang, Hongda
    Rong, Ruichen
    Wu, Junyan
    Proceedings - International Symposium on Biomedical Imaging, 2019, 2019-April : 485 - 488
  • [2] LESION ATTRIBUTES SEGMENTATION FOR MELANOMA DETECTION WITH MULTI-TASK U-NET
    Chen, Eric Z.
    Dong, Xu
    Li, Xiaoxiao
    Jiang, Hongda
    Rong, Ruichen
    Wu, Junyan
    2019 IEEE 16TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2019), 2019, : 485 - 488
  • [3] Mirror U-Net: Marrying Multimodal Fission with Multi-task Learning for Semantic Segmentation in Medical Imaging
    Marinov, Zdravko
    Reiss, Simon
    Kersting, David
    Kleesiek, Jens
    Stiefelhagen, Rainer
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 2275 - 2285
  • [4] Multi-Task Learning U-Net for Functional Shoulder Sub-Task Segmentation
    Chu, En-Ping
    Liu, Kai-Chun
    Hsieh, Chia-Yeh
    Chang, Chih-Ya
    Tsao, Yu
    Chan, Chia-Tai
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [5] Segmentation of Remote Sensing Images Based on U-Net Multi-Task Learning
    Ni Ruiwen
    Mu Ye
    Li Ji
    Zhang Tong
    Luo Tianye
    Feng Ruilong
    Gong He
    Hu Tianli
    Sun Yu
    Guo Ying
    Li Shijun
    Tyasi, Thobela Louis
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (02): : 3263 - 3274
  • [6] Automatic calcaneus fracture identification and segmentation using a multi-task U-Net
    Mu, Yuxuan
    Xue, Dong
    Guo, Jia
    Xu, Hailin
    Wang, Wei
    Li, Huiqi
    2020 5TH INTERNATIONAL CONFERENCE ON COMMUNICATION, IMAGE AND SIGNAL PROCESSING (CCISP 2020), 2020, : 140 - 144
  • [7] Segmentation of Remote Sensing Images Based on U-Net Multi-Task Learning
    Ruiwen, Ni
    Ye, Mu
    Ji, Li
    Tong, Zhang
    Tianye, Luo
    Ruilong, Feng
    He, Gong
    Tianli, Hu
    Yu, Sun
    Ying, Guo
    Shijun, Li
    Tyasi, Thobela Louis
    Computers, Materials and Continua, 2022, 73 (02): : 3263 - 3274
  • [8] MULTI-TASK ATTENTIONAL U-NET FOR HYPERSPECTRAL IMAGE DENOISING
    Xiong, Fengchao
    Gu, Zhongyi
    Zheng, Wenbin
    Li, Tianhan
    Zhou, Jun
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7336 - 7339
  • [9] Multi-task Learning for Newspaper Image Segmentation and Baseline Detection Using Attention-Based U-Net Architecture
    Bansal, Anukriti
    Mukherjee, Prerana
    Joshi, Divyansh
    Tripathi, Devashish
    Singh, Arun Pratap
    DOCUMENT ANALYSIS AND RECOGNITION, ICDAR 2021, PT II, 2021, 12917 : 440 - 454
  • [10] TransAttention U-Net for Semantic Segmentation of Poppy
    Luo, Zifei
    Yang, Wenzhu
    Gou, Ruru
    Yuan, Yunfeng
    ELECTRONICS, 2023, 12 (03)