Domain-Incremental Semantic Segmentation for Traffic Scenes

被引:0
|
作者
Liu, Yazhou [1 ]
Chen, Haoqi [1 ]
Lasang, Pongsak [2 ]
Wu, Zheng
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Jiangsu, Peoples R China
[2] Panason Res & Dev Ctr Singapore, Singapore 469332, Singapore
基金
中国国家自然科学基金;
关键词
Autonomous driving; semantic segmentation; multi-domain learning; Incremental learning; incremental learning; NETWORK; INFORMATION;
D O I
10.1109/TITS.2024.3525005
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Traffic scene segmentation is an important visual perception process to provide strong support for the decision-making of autonomous driving systems. The traffic scene is an open environment that is constantly changing, and the segmentation model needs to have the ability of domain incremental learning to maintain stable performance in the changing environment. The main challenges include the diversity of the traffic scene and the accumulation of forgetting about the previous traffic scenes. In this work, an adapter-based network model is proposed to solve the domain-incremental traffic scene segmentation task. Specifically, the domain-aware adapter (DAA) module is proposed, which divides the model parameters into domain-shared and domain-specific, so that the model can handle the information of all learned domains by dynamically expanding parameters. To further alleviate catastrophic forgetting, the inter-class correlation enhancement (ICE) module is proposed, which utilizes inter-class correlation to improve segmentation accuracy for single domain and knowledge transfer between domains. Extensive experimental results show that the proposed method can achieve promising results for retaining the competitive performance for both new and old domains.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Sensor Fusion for Semantic Segmentation of Urban Scenes
    Zhang, Richard
    Candra, Stefan A.
    Vetter, Kai
    Zakhor, Avideh
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 1850 - 1857
  • [42] Image semantic segmentation of indoor scenes: A survey
    Velastegui, Ronny
    Tatarchenko, Maxim
    Karaoglu, Sezer
    Gevers, Theo
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 248
  • [43] Automatic Annotation for Semantic Segmentation in Indoor Scenes
    Reza, Md Alimoor
    Naik, Akshay U.
    Chen, Kai
    Crandall, David J.
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 4970 - 4976
  • [44] Semantic Segmentation of a Point Clouds of an Urban Scenes
    Dashkevich, Andrey
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT SYSTEMS (COLINS-2019), VOL I: MAIN CONFERENCE, 2019, 2362 : 208 - 217
  • [45] Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
    Churamani, Nikhil
    Kara, Ozgur
    Gunes, Hatice
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 3191 - 3206
  • [46] Self-Supervised Temporal Consistency applied to Domain Adaptation in Semantic Segmentation of Urban Scenes
    Barbosa, Felipe M.
    Osorio, Fernando S.
    2023 LATIN AMERICAN ROBOTICS SYMPOSIUM, LARS, 2023 BRAZILIAN SYMPOSIUM ON ROBOTICS, SBR, AND 2023 WORKSHOP ON ROBOTICS IN EDUCATION, WRE, 2023, : 555 - 560
  • [47] Domain-incremental learning without forgetting based on random vector functional link networks
    Liu, Chong
    Wang, Yi
    Li, Dong
    Wang, Xizhao
    PATTERN RECOGNITION, 2024, 151
  • [48] Deep Dual-Resolution Networks for Real-Time and Accurate Semantic Segmentation of Traffic Scenes
    Pan, Huihui
    Hong, Yuanduo
    Sun, Weichao
    Jia, Yisong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (03) : 3448 - 3460
  • [49] EndpointsWeight Fusion for Class Incremental Semantic Segmentation
    Xiao, Jia-Wen
    Zhang, Chang-Bin
    Feng, Jiekang
    Liu, Xialei
    van de Weijer, Joost
    Cheng, Ming-Ming
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 7204 - 7213
  • [50] Knowledge distillation for incremental learning in semantic segmentation
    Michieli, Umberto
    Zanuttigh, Pietro
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 205