Wiki-based Prompts for Enhancing Relation Extraction using Language Models

被引:1
|
作者
Layegh, Amirhossein [1 ]
Payberah, Amir H. [1 ]
Soylu, Ahmet [2 ]
Roman, Dumitru [3 ]
Matskin, Mihhail [1 ]
机构
[1] KTH Royal Inst Technol, Stockholm, Sweden
[2] Oslo Metropolitan Univ, Oslo, Norway
[3] SINTEF AS, Oslo, Norway
关键词
Relation Extraction; Language Models; Prompt Construction; knowledge Integration;
D O I
10.1145/3605098.3635949
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Prompt-tuning and instruction-tuning of language models have exhibited significant results in few-shot Natural Language Processing (NLP) tasks, such as Relation Extraction (RE), which involves identifying relationships between entities within a sentence. However, the effectiveness of these methods relies heavily on the design of the prompts. A compelling question is whether incorporating external knowledge can enhance the language model's understanding of NLP tasks. In this paper, we introduce wiki-based prompt construction that leverages Wikidata as a source of information to craft more informative prompts for both prompt-tuning and instructiontuning of language models in RE. Our experiments show that using wiki-based prompts enhances cutting-edge language models in RE, emphasizing their potential for improving RE tasks. Our code and datasets are available at GitHub (1).
引用
收藏
页码:731 / 740
页数:10
相关论文
共 50 条
  • [31] Enhancing Address Data Integrity using Transformer-Based Language Models
    Kurklu, Omer Faruk
    Akagiunduz, Erdem
    32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
  • [32] Using a wiki-based collaborative process writing pedagogy to facilitate collaborative writing among Chinese primary school students
    Li, Xuanxi
    Chu, Samuel Kai Wah
    Ki, Wing Wah
    Woo, Matsuko
    AUSTRALASIAN JOURNAL OF EDUCATIONAL TECHNOLOGY, 2012, 28 (01) : 159 - 181
  • [33] Enhancing Biomedical Relation Extraction with Transformer Models using Shortest Dependency Path Features and Triplet Information
    Kanjirangat, Vani
    Rinaldi, Fabio
    JOURNAL OF BIOMEDICAL INFORMATICS, 2021, 122
  • [34] Exploring the effect of wiki-based writing instruction on writing skills and writing self-efficacy of Chinese English-as-a-foreign language learners
    Dai, Jianchun
    Wang, Li
    He, Yongcheng
    FRONTIERS IN PSYCHOLOGY, 2023, 13
  • [35] Teaching medical students about barriers to care using electronic learning modules and a wiki-based community resource guide.
    Laird-Fick, H. S.
    Solomon, D. J.
    Ford, M.
    Pletcher, S.
    JOURNAL OF GENERAL INTERNAL MEDICINE, 2007, 22 : 193 - 193
  • [36] Using Language Models for Enhancing the Completeness of Natural-Language Requirements
    Luitel, Dipeeka
    Hassani, Shabnam
    Sabetzadeh, Mehrdad
    REQUIREMENTS ENGINEERING: FOUNDATION FOR SOFTWARE QUALITY, REFSQ 2023, 2023, 13975 : 87 - 104
  • [37] AutoRE: Document-Level Relation Extraction with Large Language Models
    Xue, Lilong
    Zhang, Dan
    Dong, Yuxiao
    Tang, Jie
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 3: SYSTEM DEMONSTRATIONS, 2024, : 211 - 220
  • [38] Enhancing Biomedical Text Summarization Using Semantic Relation Extraction
    Shang, Yue
    Li, Yanpeng
    Lin, Hongfei
    Yang, Zhihao
    PLOS ONE, 2011, 6 (08):
  • [39] Enhancing Relation Extraction Using Syntactic Indicators and Sentential Contexts
    Tao, Qiongxing
    Luo, Xiangfeng
    Wang, Hao
    Xu, Richard
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1574 - 1580
  • [40] A Study on Accessing Linguistic Information in Pre-Trained Language Models by Using Prompts
    Di Marco, Marion
    Haemmerl, Katharina
    Fraser, Alexander
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 7328 - 7336