A Relational Model for One-Shot Classification of Images and Pen Strokes

被引:1
|
作者
Polis, Arturs [1 ]
Ilin, Alexander [1 ]
机构
[1] Aalto Univ, Espoo, Finland
基金
芬兰科学院;
关键词
One-shot learning; Relational learning; Transformer; Graph network; Omniglot;
D O I
10.1016/j.neucom.2022.06.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We show that a deep learning model with built-in relational inductive bias can bring benefits to sample-efficient learning, without relying on extensive data augmentation. Our study shows that excellent results can be achieved with a model in which the relational inductive bias is applied to images, while building an efficient one-shot classifier on top of raw strokes is more challenging. The proposed one-shot classification model performs relational matching of a pair of inputs in the form of local and pairwise attention. Our approach solves with almost perfect accuracy the one-shot image classification Omniglot challenge when combined with a Hungarian matching algorithm and attains competitive results on the same task on characters represented as rotation-augmented strokes.(c) 2022 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http:// creativecommons.org/licenses/by/4.0/).
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [1] One-Shot Relational Learning for Knowledge Graphs
    Xiong, Wenhan
    Yu, Mo
    Chang, Shiyu
    Guo, Xiaoxiao
    Wang, William Yang
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 1980 - 1990
  • [2] A System for One-Shot Learning of Cervical Cancer Cell Classification in Histopathology Images
    Yarlagadda, Dig Vijay Kumar
    Rao, Praveen
    Rao, Deepthi
    Tawfik, Ossama
    MEDICAL IMAGING 2019: DIGITAL PATHOLOGY, 2019, 10956
  • [3] A plant disease classification using one-shot learning technique with field images
    Saad, Mohamed H.
    Salman, Ahmed E.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (20) : 58935 - 58960
  • [4] One-Shot Synthesis of Images and Segmentation Masks
    Sushko, Vadim
    Zhang, Dan
    Gall, Juergen
    Khoreva, Anna
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 6274 - 6283
  • [5] MULTIMODAL ONE-SHOT LEARNING OF SPEECH AND IMAGES
    Eloff, Ryan
    Engelbrecht, Herman A.
    Kamper, Herman
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 8623 - 8627
  • [6] AugPaste: One-Shot Anomaly Detection for Medical Images
    Huang, Weikai
    Huang, Yijin
    Tang, Xiaoying
    OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2022, 2022, 13576 : 1 - 11
  • [7] One-shot Learning Approach for Unknown Malware Classification
    Tran, Trung Kien
    Sato, Hiroshi
    Kubo, Masao
    PROCEEDINGS OF THE 2018 5TH ASIAN CONFERENCE ON DEFENSE TECHNOLOGY (ACDT 2018), 2018, : 8 - 13
  • [8] OS-SSVEP: One-shot SSVEP classification
    Deng, Yang
    Ji, Zhiwei
    Wang, Yijun
    Zhou, S. Kevin
    NEURAL NETWORKS, 2024, 180
  • [9] One-Shot Image Classification by Learning to Restore Prototypes
    Xue, Wanqi
    Wang, Wei
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 6558 - 6565
  • [10] Meta-Meta Classification for One-Shot Learning
    Chowdhury, Arkabandhu
    Chaudhari, Dipak
    Chaudhuri, Swarat
    Jermaine, Chris
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1628 - 1637