Few-shot object segmentation with a new feature aggregation module

被引:4
|
作者
Liu, Kaijun [1 ]
Lyu, Shujing [1 ]
Shivakumara, Palaiahnakote [2 ]
Lu, Yue [1 ]
机构
[1] East China Normal Univ, Shanghai Key Lab Multidimens Informat Proc, Shanghai, Peoples R China
[2] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur, Malaysia
关键词
Few-shot learning; Object segmentation; Feature aggregation; Attention mechanism;
D O I
10.1016/j.displa.2023.102459
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The success of convolutional neural network for object segmentation depends on a large amount of training data and high-quality samples. But annotating such high-quality training data for pixel-wise segmentation is labor-intensive. To reduce the massive labor work, few-shot learning has been introduced to segment objects, which uses a few samples for training without compromising the performance. However, the current few-shot models are biased towards the seen classes rather than being class-irrelevant due to lack of global context prior attention. Therefore, this study aims at proposing a few-shot object segmentation model with a new feature aggregation module. Specifically, the proposed work develops a detail-aware module to enhance the discrimination of details with diversified attributes. To enhance the semantics of each pixel, we propose a global attention module to aggregate detailed features containing semantic information. Furthermore, to improve the performance of the proposed model, the model uses support samples that represents class-specific prototype obtained by respective category prototype block. Next, the proposed model predicts label of each pixel of query sample by estimating the distance between the pixel and prototypes. Experiments on standard datasets demonstrate significance of the proposed model over SOTA in terms of segmentation with a few training samples.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] FFNet: Feature Fusion Network for Few-shot Semantic Segmentation
    Ya-Nan Wang
    Xiangtao Tian
    Guoqiang Zhong
    Cognitive Computation, 2022, 14 : 875 - 886
  • [22] Hybrid feature enhancement network for few-shot semantic segmentation
    Min, Hai
    Zhang, Yemao
    Zhao, Yang
    Jia, Wei
    Lei, Yingke
    Fan, Chunxiao
    PATTERN RECOGNITION, 2023, 137
  • [23] Prior Guided Feature Enrichment Network for Few-Shot Segmentation
    Tian, Zhuotao
    Zhao, Hengshuang
    Shu, Michelle
    Yang, Zhicheng
    Li, Ruiyu
    Jia, Jiaya
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) : 1050 - 1065
  • [24] FPIseg: Iterative segmentation network based on feature pyramid for few-shot segmentation
    Wang, Ronggui
    Yang, Cong
    Yang, Juan
    Xue, Lixia
    IET IMAGE PROCESSING, 2023, 17 (13) : 3801 - 3814
  • [25] Object detection based on few-shot learning via instance-level feature correlation and aggregation
    Wang, Meng
    Ning, Hongwei
    Liu, Haipeng
    APPLIED INTELLIGENCE, 2023, 53 (01) : 351 - 368
  • [26] Object detection based on few-shot learning via instance-level feature correlation and aggregation
    Meng Wang
    Hongwei Ning
    Haipeng Liu
    Applied Intelligence, 2023, 53 : 351 - 368
  • [27] Base and Meta: A New Perspective on Few-Shot Segmentation
    Lang, Chunbo
    Cheng, Gong
    Tu, Binfei
    Li, Chao
    Han, Junwei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) : 10669 - 10686
  • [28] Hierarchical bidirectional aggregation with prior guided transformer for few-shot segmentation
    Qiuyu Kong
    Jie Jiang
    Junyan Yang
    Qi Wang
    International Journal of Multimedia Information Retrieval, 2023, 12
  • [29] Hierarchical bidirectional aggregation with prior guided transformer for few-shot segmentation
    Kong, Qiuyu
    Jiang, Jie
    Yang, Junyan
    Wang, Qi
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2023, 12 (02)
  • [30] Temporal Aggregation with Context Focusing for Few-Shot Video Object Detection
    Han, Wentao
    Lei, Jie
    Wang, Fahong
    Feng, Zunlei
    Liang, Ronghua
    Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, 2023, : 2196 - 2201