Wiki-based Prompts for Enhancing Relation Extraction using Language Models

被引:1
|
作者
Layegh, Amirhossein [1 ]
Payberah, Amir H. [1 ]
Soylu, Ahmet [2 ]
Roman, Dumitru [3 ]
Matskin, Mihhail [1 ]
机构
[1] KTH Royal Inst Technol, Stockholm, Sweden
[2] Oslo Metropolitan Univ, Oslo, Norway
[3] SINTEF AS, Oslo, Norway
关键词
Relation Extraction; Language Models; Prompt Construction; knowledge Integration;
D O I
10.1145/3605098.3635949
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Prompt-tuning and instruction-tuning of language models have exhibited significant results in few-shot Natural Language Processing (NLP) tasks, such as Relation Extraction (RE), which involves identifying relationships between entities within a sentence. However, the effectiveness of these methods relies heavily on the design of the prompts. A compelling question is whether incorporating external knowledge can enhance the language model's understanding of NLP tasks. In this paper, we introduce wiki-based prompt construction that leverages Wikidata as a source of information to craft more informative prompts for both prompt-tuning and instructiontuning of language models in RE. Our experiments show that using wiki-based prompts enhances cutting-edge language models in RE, emphasizing their potential for improving RE tasks. Our code and datasets are available at GitHub (1).
引用
收藏
页码:731 / 740
页数:10
相关论文
共 50 条
  • [21] A Brief Review of Relation Extraction Based on Pre-Trained Language Models
    Xu, Tiange
    Zhang, Fu
    FUZZY SYSTEMS AND DATA MINING VI, 2020, 331 : 775 - 789
  • [22] Using a Wiki-Based Course Design to Create a Student-Centered Learning Environment: Strategies and Lessons
    Hu, Qian
    Johnston, Erik
    JOURNAL OF PUBLIC AFFAIRS EDUCATION, 2012, 18 (03) : 493 - 512
  • [23] Enhanced clustering models with wiki-based k-nearest neighbors-based representation for web search result clustering
    Abdulameer, Ali Sabah
    Tiun, Sabrina
    Sani, Nor Samsiah
    Ayob, Masri
    Taha, Adil Yaseen
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (03) : 840 - 850
  • [24] Revisiting Relation Extraction in the era of Large Language Models
    Wadhwa, Somin
    Amir, Silvio
    Wallace, Byron C.
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023): LONG PAPERS, VOL 1, 2023, : 15566 - 15589
  • [25] Developing general cultural awareness in a monocultural English as a foreign language context in a Mexican university: a wiki-based critical incident approach
    Vences, Paola Trejo
    Fay, Richard
    LANGUAGE LEARNING JOURNAL, 2015, 43 (02): : 222 - 233
  • [26] PLRTE: Progressive learning for biomedical relation triplet extraction using large language models
    Zheng, Yi-Kai
    Zeng, Bi
    Feng, Yi-Chun
    Zhou, Lu
    Li, Yi-Xue
    JOURNAL OF BIOMEDICAL INFORMATICS, 2024, 159
  • [27] Relation extraction using large language models: a case study on acupuncture point locations
    Li, Yiming
    Peng, Xueqing
    Li, Jianfu
    Zuo, Xu
    Peng, Suyuan
    Pei, Donghong
    Tao, Cui
    Xu, Hua
    Hong, Na
    JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2024, 31 (11) : 2622 - 2631
  • [28] Health Care Professionals' Beliefs About Using Wiki-Based Reminders to Promote Best Practices in Trauma Care
    Archambault, Patrick Michel
    Bilodeau, Andrea
    Gagnon, Marie-Pierre
    Aubin, Karine
    Lavoie, Andre
    Lapointe, Jean
    Poitras, Julien
    Croteau, Sylvain
    Pham-Dinh, Martin
    Legare, France
    JOURNAL OF MEDICAL INTERNET RESEARCH, 2012, 14 (02)
  • [29] Empirical Analysis of Dialogue Relation Extraction with Large Language Models
    Li, Guozheng
    Xu, Zijie
    Shang, Ziyu
    Liu, Jiajun
    Ji, Ke
    Guo, Yikai
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 6359 - 6367
  • [30] GPT-RE: In-context Learning for Relation Extraction using Large Language Models
    Wan, Zhen
    Cheng, Fei
    Mao, Zhuoyuan
    Liu, Qianying
    Song, Haiyue
    Li, Jiwei
    Kurohashi, Sadao
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 3534 - 3547