Cross-Domain Few-Shot Relation Extraction via Representation Learning and Domain Adaptation

被引:0
|
作者
Yuan, Zhongju [1 ]
Wang, Zhenkun [1 ,2 ]
Li, Genghui [1 ]
机构
[1] Southern Univ Sci & Technol, Sch Syst Design & Intelligent Mfg, Shenzhen, Peoples R China
[2] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen, Peoples R China
关键词
D O I
10.1109/IJCNN54540.2023.10191836
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot relation extraction aims to recognize novel relations with few labeled sentences in each relation. Previous metric-based few-shot relation extraction algorithms identify relationships by comparing the prototypes generated by the few labeled sentences embedding with the embeddings of the query sentences using a trained metric function. However, as these domains always have considerable differences from those in the training dataset, the generalization ability of these approaches on unseen relations in many domains is limited. Since the prototype is necessary for obtaining relationships between entities in the latent space, we suggest learning more interpretable and efficient prototypes from prior knowledge and the intrinsic semantics of relations to extract new relations in various domains more effectively. By exploring the relationships between relations using prior information, we effectively improve the prototype representation of relations. By using contrastive learning to make the classification margins between sentence embedding more distinct, the prototype's geometric interpretability is enhanced. Additionally, utilizing a transfer learning approach for the cross-domain problem allows the generation process of the prototype to account for the gap between other domains, making the prototype more robust and enabling the better extraction of associations across multiple domains. The experiment results on the benchmark FewRel dataset demonstrate the advantages of the suggested method over some state-of-the-art approaches.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Dual Adaptive Representation Alignment for Cross-Domain Few-Shot Learning
    Zhao Y.
    Zhang T.
    Li J.
    Tian Y.
    [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45 (10) : 11720 - 11732
  • [2] Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficulty
    Oh, Jaehoon
    Kim, Sungnyun
    Ho, Namgyu
    Kim, Jin-Hwa
    Song, Hwanjun
    Yun, Se-Young
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [3] Visual Domain Bridge: A source-free domain adaptation for cross-domain few-shot learning
    Yazdanpanah, Moslem
    Moradi, Parham
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 2867 - 2876
  • [4] Cross-domain few-shot learning via adaptive transformer networks
    Paeedeh, Naeem
    Pratama, Mahardhika
    Ma'sum, Muhammad Anwar
    Mayer, Wolfgang
    Cao, Zehong
    Kowlczyk, Ryszard
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 288
  • [5] Cross-domain few-shot learning via adaptive transformer networks
    Paeedeh, Naeem
    Pratama, Mahardhika
    Ma'sum, Muhammad Anwar
    Mayer, Wolfgang
    Cao, Zehong
    Kowlczyk, Ryszard
    [J]. Knowledge-Based Systems, 2024, 288
  • [6] Knowledge transduction for cross-domain few-shot learning
    Li, Pengfang
    Liu, Fang
    Jiao, Licheng
    Li, Shuo
    Li, Lingling
    Liu, Xu
    Huang, Xinyan
    [J]. PATTERN RECOGNITION, 2023, 141
  • [7] Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptation
    Yue, Xiangyu
    Zheng, Zangwei
    Zhang, Shanghang
    Gao, Yang
    Darrell, Trevor
    Keutzer, Kurt
    Vincentelli, Alberto Sangiovanni
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13829 - 13839
  • [8] Few-shot Heterogeneous Graph Learning via Cross-domain Knowledge Transfer
    Zhang, Qiannan
    Wu, Xiaodong
    Yang, Qiang
    Zhang, Chuxu
    Zhang, Xiangliang
    [J]. PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2450 - 2460
  • [9] HybridPrompt: Domain-Aware Prompting for Cross-Domain Few-Shot Learning
    Wu, Jiamin
    Zhang, Tianzhu
    Zhang, Yongdong
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024,
  • [10] HybridPrompt: Domain-Aware Prompting for Cross-Domain Few-Shot Learning
    Wu, Jiamin
    Zhang, Tianzhu
    Zhang, Yongdong
    [J]. International Journal of Computer Vision, 132 (12): : 5681 - 5697