Zero-Shot Camouflaged Object Detection

被引:6
|
作者
Li, Haoran [1 ,2 ]
Feng, Chun-Mei [3 ]
Xu, Yong [4 ]
Zhou, Tao [5 ]
Yao, Lina [6 ]
Chang, Xiaojun [7 ]
机构
[1] Univ Technol Sydney, ReLER Lab, AAII, Ultimo, NSW 2007, Australia
[2] Univ Wollongong, Sch Comp & Informat Technol, Wollongong, NSW 2522, Australia
[3] ASTAR, Inst High Performance Comp IHPC, Singapore 138632, Singapore
[4] Harbin Inst Technol Shenzhen, Shenzhen Key Lab Visual Object Detect & Recognit, Shenzhen 518055, Peoples R China
[5] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[6] Univ New South Wales, Sch Comp Sci & Engn, Data Dynam Lab, Sydney, NSW 2052, Australia
[7] Univ Technol Sydney, Fac Engn & Informat Technol, ReLER Lab, AAII, Ultimo, NSW 2007, Australia
关键词
Camouflaged object detection; zero-shot learn-ing; graph representation; NETWORK; DESIGN;
D O I
10.1109/TIP.2023.3308295
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The goal of Camouflaged object detection (COD) is to detect objects that are visually embedded in their surroundings. Existing COD methods only focus on detecting camouflaged objects from seen classes, while they suffer from performance degradation to detect unseen classes. However, in a real-world scenario, collecting sufficient data for seen classes is extremely difficult and labeling them requires high professional skills, thereby making these COD methods not applicable. In this paper, we propose a new zero-shot COD framework (termed as ZSCOD), which can effectively detect the never unseen classes. Specifically, our framework includes a Dynamic Graph Searching Network (DGSNet) and a Camouflaged Visual Reasoning Generator (CVRG). In details, DGSNet is proposed to adaptively capture more edge details for boosting the COD performance. CVRG is utilized to produce pseudo-features that are closer to the real features of the seen camouflaged objects, which can transfer knowledge from seen classes to unseen classes to help detect unseen objects. Besides, our graph reasoning is built on a dynamic searching strategy, which can pay more attention to the boundaries of objects for reducing the influences of background. More importantly, we construct the first zero-shot COD benchmark based on the COD10K dataset. Experimental results on public datasets show that our ZSCOD not only detects the camouflaged object of unseen classes but also achieves state-of-the-art performance in detecting seen classes.
引用
收藏
页码:5126 / 5137
页数:12
相关论文
共 50 条
  • [1] Zero-Shot Object Detection
    Bansal, Ankan
    Sikka, Karan
    Sharma, Gaurav
    Chellappa, Rama
    Divakaran, Ajay
    [J]. COMPUTER VISION - ECCV 2018, PT I, 2018, 11205 : 397 - 414
  • [2] ZERO-SHOT OBJECT DETECTION WITH TRANSFORMERS
    Zheng, Ye
    Cui, Li
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 444 - 448
  • [3] Zero-Shot Object Detection with Textual Descriptions
    Li, Zhihui
    Yao, Lina
    Zhang, Xiaoqin
    Wang, Xianzhi
    Kanhere, Salil
    Zhang, Huaxiang
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8690 - 8697
  • [4] Zero-Shot Object Detection for Indoor Robots
    Abdalwhab, Abdalwhab
    Liu, Huaping
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [5] Transductive Learning for Zero-Shot Object Detection
    Rahman, Shafin
    Khan, Salman
    Barnes, Nick
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6081 - 6090
  • [6] Synthetic Feature Assessment for Zero-Shot Object Detection
    Dai, Xinmiao
    Wang, Chong
    Li, Haohe
    Lin, Sunqi
    Dong, Li
    Wu, Jiafei
    Wang, Jun
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 444 - 449
  • [7] Zero-Shot Object Counting
    Xu, Jingyi
    Le, Hieu
    Nguyen, Vu
    Ranjan, Viresh
    Samaras, Dimitris
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 15548 - 15557
  • [8] ZERO-SHOT DETECTION WITH TRANSFERABLE OBJECT PROPOSAL MECHANISM
    Shao, Yilan
    Li, Yanan
    Wang, Donghui
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3666 - 3670
  • [9] Robust Region Feature Synthesizer for Zero-Shot Object Detection
    Huang, Peiliang
    Han, Junwei
    Cheng, De
    Zhang, Dingwen
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7612 - 7621
  • [10] Zero-shot object detection with contrastive semantic association network
    Haohe Li
    Chong Wang
    Weijie Liu
    Yilin Gong
    Xinmiao Dai
    [J]. Applied Intelligence, 2023, 53 : 30056 - 30068