SML: Semantic meta-learning for few-shot semantic segmentation * *

被引:10
|
作者
Pambala, Ayyappa Kumar [1 ]
Dutta, Titir [1 ]
Biswas, Soma [1 ]
机构
[1] Indian Inst Sci, Dept Elect Engn, Bangalore 560012, Karnataka, India
关键词
Few-shot learning; Semantic segmentation; Attributes;
D O I
10.1016/j.patrec.2021.03.036
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The significant amount of training data required for training Convolutional Neural Networks has become a bottleneck for applications like semantic segmentation. Few-shot semantic segmentation algorithms address this problem, with an aim to achieve good performance in the low-data regime, with few annotated training images. Recent approaches based on class-prototypes computed from available training data have achieved immense success for this task. In this work, we propose a novel meta-learning framework, Semantic Meta-Learning (SML), which incorporates class level semantic descriptions in the generated prototypes for this problem. In addition, we propose to use the well-established technique, ridge regression, to not only bring in the class-level semantic information, but also to effectively utilise the information available from multiple images present in the training data for prototype computation. This has a simple closed-form solution, and thus can be implemented easily and efficiently. Extensive experiments on the benchmark PASCAL-5i dataset under different experimental settings demonstrate the effectiveness of the proposed framework. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:93 / 99
页数:7
相关论文
共 50 条
  • [1] Differentiable Meta-Learning Model for Few-Shot Semantic Segmentation
    Tian, Pinzhuo
    Wu, Zhangkai
    Qi, Lei
    Wang, Lei
    Shi, Yinghuan
    Gao, Yang
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12087 - 12094
  • [2] Transductive meta-learning with enhanced feature ensemble for few-shot semantic segmentation
    Amin Karimi
    Charalambos Poullis
    [J]. Scientific Reports, 14
  • [3] MaskSplit: Self-supervised Meta-learning for Few-shot Semantic Segmentation
    Amac, Mustafa Sercan
    Sencan, Ahmet
    Baran, Orhun Bugra
    Ikizler-Cinbis, Nazli
    Cinbis, Ramazan Gokberk
    [J]. 2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 428 - 438
  • [4] Transductive meta-learning with enhanced feature ensemble for few-shot semantic segmentation
    Karimi, Amin
    Poullis, Charalambos
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01)
  • [5] Few-Shot Semantic Segmentation of Strip Steel Surface Defects Based on Meta-Learning
    Feng, Hu
    Song, Ke-Chen
    Cui, Wen-Qi
    Yan, Yun-Hui
    [J]. Dongbei Daxue Xuebao/Journal of Northeastern University, 2024, 45 (03): : 354 - 360
  • [6] LEARNING WITH MEMORY FOR FEW-SHOT SEMANTIC SEGMENTATION
    Lu, Hongchao
    Wei, Chao
    Deng, Zhidong
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 629 - 633
  • [7] Learning Meta-class Memory for Few-Shot Semantic Segmentation
    Wu, Zhonghua
    Shi, Xiangxi
    Lin, Guosheng
    Cai, Jianfei
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 497 - 506
  • [8] Meta-Seg: A Generalized Meta-Learning Framework for Multi-Class Few-Shot Semantic Segmentation
    Cao, Zhiying
    Zhang, Tengfei
    Diao, Wenhui
    Zhang, Yue
    Lyu, Xiaode
    Fu, Kun
    Sun, Xian
    [J]. IEEE ACCESS, 2019, 7 : 166109 - 166121
  • [9] Generalized Few-shot Semantic Segmentation
    Tian, Zhuotao
    Lai, Xin
    Jiang, Li
    Liu, Shu
    Shu, Michelle
    Zhao, Hengshuang
    Jia, Jiaya
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11553 - 11562
  • [10] PRIOR SEMANTIC HARMONIZATION NETWORK FOR FEW-SHOT SEMANTIC SEGMENTATION
    Yang, Xinhao
    Ma, Liyan
    Zhou, Yang
    Peng, Yan
    Xie, Shaorong
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1126 - 1130