Domain-Incremental Semantic Segmentation for Traffic Scenes

被引:0
|
作者
Liu, Yazhou [1 ]
Chen, Haoqi [1 ]
Lasang, Pongsak [2 ]
Wu, Zheng
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Jiangsu, Peoples R China
[2] Panason Res & Dev Ctr Singapore, Singapore 469332, Singapore
基金
中国国家自然科学基金;
关键词
Autonomous driving; semantic segmentation; multi-domain learning; Incremental learning; incremental learning; NETWORK; INFORMATION;
D O I
10.1109/TITS.2024.3525005
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Traffic scene segmentation is an important visual perception process to provide strong support for the decision-making of autonomous driving systems. The traffic scene is an open environment that is constantly changing, and the segmentation model needs to have the ability of domain incremental learning to maintain stable performance in the changing environment. The main challenges include the diversity of the traffic scene and the accumulation of forgetting about the previous traffic scenes. In this work, an adapter-based network model is proposed to solve the domain-incremental traffic scene segmentation task. Specifically, the domain-aware adapter (DAA) module is proposed, which divides the model parameters into domain-shared and domain-specific, so that the model can handle the information of all learned domains by dynamically expanding parameters. To further alleviate catastrophic forgetting, the inter-class correlation enhancement (ICE) module is proposed, which utilizes inter-class correlation to improve segmentation accuracy for single domain and knowledge transfer between domains. Extensive experimental results show that the proposed method can achieve promising results for retaining the competitive performance for both new and old domains.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] CNN based Semantic Segmentation for Urban Traffic Scenes using Fisheye Camera
    Deng, Liuyuan
    Yang, Ming
    Qian, Yeqiang
    Wang, Chunxiang
    Wang, Bing
    2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 231 - 236
  • [22] Progressive Adapting and Pruning: Domain-Incremental Learning for Saliency Prediction
    Yang, Kaihui
    Han, Junwei
    Guo, Guangyu
    Fang, Chaowei
    Fan, Yingzi
    Cheng, Lechao
    Zhang, Dingwen
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (08)
  • [23] ESNET: EDGE-BASED SEGMENTATION NETWORK FOR REAL-TIME SEMANTIC SEGMENTATION IN TRAFFIC SCENES
    Lyu, Haoran
    Fu, Huiyuan
    Hu, Xiaojun
    Liu, Liang
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1855 - 1859
  • [24] Federated Incremental Semantic Segmentation
    Dong, Jiahua
    Zhang, Duzhen
    Cong, Yang
    Cong, Wei
    Ding, Henghui
    Dai, Dengxin
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3934 - 3943
  • [25] Transformed-*: A domain-incremental lifelong learning scenario generation framework
    Zurek, Dominik
    Corizzo, Roberto
    Karwatowski, Michal
    Pietron, Marcin
    Faber, Kamil
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [26] Personalized Federated Domain-Incremental Learning Based on Adaptive Knowledge Matching
    Lp, Yichen
    Xu, Wenchao
    Wang, Haozhao
    Qi, Yining
    Li, Ruixuan
    Gu, Jingcai
    COMPUTER VISION-ECCV 2024, PT XLVI, 2025, 15104 : 127 - 144
  • [27] An Efficient Domain-Incremental Learning Approach to Drive in All Weather Conditions
    Mirza, M. Jehanzeb
    Masana, Marc
    Possegger, Horst
    Bischof, Horst
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3000 - 3010
  • [28] Brain-Inspired Domain-Incremental Adaptive Detection for Autonomous Driving
    Liang, Weihao
    Gan, Lu
    Wang, Pengfei
    Meng, Wei
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [29] Review on Semantic Segmentation of Road Scenes
    Wang Longfei
    Yan Chunman
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (12)
  • [30] SR-FDIL: Synergistic Replay for Federated Domain-Incremental Learning
    Li, Yichen
    Xu, Wenchao
    Qi, Yining
    Wang, Haozhao
    Li, Ruixuan
    Guo, Song
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (11) : 1879 - 1890