Enhancing open-world object detection with AIGC-generated datasets and elastic weight consolidationEnhancing open world object detection with...W. Xue et al.

被引:0
|
作者
Wenjin Xue [1 ]
Guowei Xu [1 ]
Nan Yang [2 ]
Jian Liu [1 ]
机构
[1] Tiangong University,School of Control Science and Engineering
[2] Tiangong University,School of Mechanical Engineering
关键词
Target customized detection; OWOD; Stable diffusion model; LoRA; Dataset; Loss module;
D O I
10.1007/s11227-024-06910-3
中图分类号
学科分类号
摘要
This paper proposes a novel approach to enhancing open-world object detection (OWOD) models by combining artificial intelligence generated content and elastic weight consolidation (EWC). To address the issue of low category richness and mitigate catastrophic forgetting, we first utilize stable diffusion with low-rank adaptation (LoRA) fine-tuning to generate customized detection target datasets. These datasets are then employed to train an improved open-world region-based efficient model, incorporating an EWC module to constrain parameter changes during learning new tasks. Experimental results demonstrate that our approach achieves a mean average precision of 84.7% on the generated datasets, significantly improving category richness while mitigating forgetting of previously learned categories. The proposed method effectively balances learning new categories and retaining memory of old ones, advancing the frontiers of OWOD research.
引用
收藏
相关论文
共 10 条
  • [1] DDOWOD: DiffusionDet for open-world object detection
    Fan, Jiaqi
    Zhang, Enming
    Wei, Ying
    Wang, Yuefeng
    Xia, Jiakun
    Liu, Junwei
    Liu, Xinghong
    Ma, Shuailei
    Pattern Recognition Letters, 2024, 186 : 170 - 177
  • [2] Semi-supervised Open-World Object Detection
    Mullappilly, Sahal Shaji
    Gehlot, Abhishek Singh
    Anwer, Rao Muhammad
    Khan, Fahad Shahbaz
    Cholakkal, Hisham
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4305 - 4314
  • [3] Rethinking Open-World Object Detection in Autonomous Driving Scenarios
    Ma, Zeyu
    Yang, Yang
    Wang, Guoqing
    Xu, Xing
    Shen, Heng Tao
    Zhang, Mingxing
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1279 - 1288
  • [4] CAT: LoCalization and IdentificAtion Cascade Detection Transformer for Open-World Object Detection
    Ma, Shuailei
    Wang, Yuefeng
    Wei, Ying
    Fan, Jiaqi
    Li, Thomas H.
    Liu, Hongli
    Lv, Fanbing
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19681 - 19690
  • [5] A Parallel Open-World Object Detection Framework with Uncertainty Mitigation for Campus Monitoring
    Dong, Jian
    Zhang, Zhange
    He, Siqi
    Liang, Yu
    Ma, Yuqing
    Yu, Jiaqi
    Zhang, Ruiyan
    Li, Binbin
    APPLIED SCIENCES-BASEL, 2023, 13 (23):
  • [6] LVMUM: Toward Open-World Object Detection with Large Vision Models and Unsupervised Modeling
    Huang, Yangyang
    Xi, Xing
    Wu, Weiye
    Luo, Ronghua
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VII, ICIC 2024, 2024, 14868 : 65 - 76
  • [7] Instance-Dictionary Learning for Open-World Object Detection in Autonomous Driving Scenarios
    Ma, Zeyu
    Zheng, Ziqiang
    Wei, Jiwei
    Yang, Yang
    Shen, Heng Tao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3395 - 3408
  • [8] A New Multinetwork Mean Distillation Loss Function for Open-World Domain Incremental Object Detection
    Yang, Jing
    Yuan, Kun
    Chen, Suhao
    Li, Qinglang
    Li, Shaobo
    Zhang, Xiuhua
    Li, Bin
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023
  • [9] OW-Adapter: Human-Assisted Open-World Object Detection with a Few Examples
    Jamonnak, Suphanut
    Guo, Jiajing
    He, Wenbin
    Gou, Liang
    Ren, Liu
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (01) : 694 - 704
  • [10] Open-World Foreign Object Debris Detection Framework Empowered by Generative Adversarial Network and Computer Vision Models
    Noroozi, Mohammad
    Shah, Ankit
    TRANSPORTATION RESEARCH RECORD, 2024,