MaskSplit: Self-supervised Meta-learning for Few-shot Semantic Segmentation

被引:5
|
作者
Amac, Mustafa Sercan [1 ]
Sencan, Ahmet [2 ]
Baran, Orhun Bugra [2 ]
Ikizler-Cinbis, Nazli [3 ]
Cinbis, Ramazan Gokberk [2 ]
机构
[1] MonolithAI, London, England
[2] Middle East Tech Univ, Dept Comp Engn, Ankara, Turkey
[3] Hacettepe Univ, Dept Comp Engn, Ankara, Turkey
关键词
D O I
10.1109/WACV51458.2022.00050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Just like other few-shot learning problems, few-shot segmentation aims to minimize the need for manual annotation, which is particularly costly in segmentation tasks. Even though the few-shot setting reduces this cost for novel test classes, there is still a need to annotate the training data. To alleviate this need, we propose a self-supervised training approach for learning few-shot segmentation models. We first use unsupervised saliency estimation to obtain pseudo-masks on images. We then train a simple prototype based model over different splits of pseudo masks and augmentations of images. Our extensive experiments show that the proposed approach achieves promising results, highlighting the potential of self-supervised training. To the best of our knowledge this is the first work that addresses unsupervised few-shot segmentation problem on natural images.
引用
收藏
页码:428 / 438
页数:11
相关论文
共 50 条
  • [1] SML: Semantic meta-learning for few-shot semantic segmentation * *
    Pambala, Ayyappa Kumar
    Dutta, Titir
    Biswas, Soma
    [J]. PATTERN RECOGNITION LETTERS, 2021, 147 : 93 - 99
  • [2] Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks
    Bansal, Trapit
    Jha, Rishikesh
    Munkhdalai, Tsendsuren
    McCallum, Andrew
    [J]. PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 522 - 534
  • [3] Weakly Supervised Few-Shot Segmentation via Meta-Learning
    Gama, Pedro H. T.
    Oliveira, Hugo
    Marcato Jr, Jose
    dos Santos, Jefersson A.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1784 - 1797
  • [4] Differentiable Meta-Learning Model for Few-Shot Semantic Segmentation
    Tian, Pinzhuo
    Wu, Zhangkai
    Qi, Lei
    Wang, Lei
    Shi, Yinghuan
    Gao, Yang
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12087 - 12094
  • [5] Self-supervised Few-Shot Learning for Semantic Segmentation: An Annotation-Free Approach
    Karimijafarbigloo, Sanaz
    Azad, Reza
    Merhof, Dorit
    [J]. PREDICTIVE INTELLIGENCE IN MEDICINE, PRIME 2023, 2023, 14277 : 159 - 171
  • [6] Self-Supervised Learning for Few-Shot Medical Image Segmentation
    Ouyang, Cheng
    Biffi, Carlo
    Chen, Chen
    Kart, Turkay
    Qiu, Huaqi
    Rueckert, Daniel
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (07) : 1837 - 1848
  • [7] Self-Supervised Tuning for Few-Shot Segmentation
    Zhu, Kai
    Zhai, Wei
    Cao, Yang
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 1019 - 1025
  • [8] SEML: Self-Supervised Information-Enhanced Meta-learning for Few-Shot Text Classification
    Hui Li
    Guimin Huang
    Yiqun Li
    Xiaowei Zhang
    Yabing Wang
    Jun Li
    [J]. International Journal of Computational Intelligence Systems, 16
  • [9] SEML: Self-Supervised Information-Enhanced Meta-learning for Few-Shot Text Classification
    Li, Hui
    Huang, Guimin
    Li, Yiqun
    Zhang, Xiaowei
    Wang, Yabing
    Li, Jun
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [10] SELF-SUPERVISED FEW-SHOT LEARNING FOR ISCHEMIC STROKE LESION SEGMENTATION
    Tomasetti, Luca
    Hansen, Stine
    Khanmohammadi, Mahdieh
    Engan, Kjersti
    Hollesli, Liv Jorunn
    Kurz, Kathinka Daehli
    Kampffmeyer, Michael
    [J]. 2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,