PromptRank: Unsupervised Keyphrase Extraction Using Prompt

被引:0
|
作者
Kong, Aobo [1 ]
Zhao, Shiwan
Chen, Hao [2 ]
Li, Qicheng [1 ]
Qin, Yong [1 ]
Sun, Ruiqi [2 ]
Bai, Xiaoyan [2 ]
机构
[1] Nankai Univ, CS, TMCC, Tianjin, Peoples R China
[2] Lenovo Res, Enterprise & Cloud Res Lab, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The keyphrase extraction task refers to the automatic selection of phrases from a given document to summarize its core content. State-of-the-art (SOTA) performance has recently been achieved by embedding-based algorithms, which rank candidates according to how similar their embeddings are to document embeddings. However, such solutions either struggle with the document and candidate length discrepancies or fail to fully utilize the pre-trained language model (PLM) without further fine-tuning. To this end, in this paper, we propose a simple yet effective unsupervised approach, PromptRank, based on the PLM with an encoder-decoder architecture. Specifically, PromptRank feeds the document into the encoder and calculates the probability of generating the candidate with a designed prompt by the decoder. We extensively evaluate the proposed PromptRank on six widely used benchmarks. PromptRank outperforms the SOTA approach MDERank, improving the F1 score relatively by 34.18%, 24.87%, and 17.57% for 5, 10, and 15 returned results, respectively. This demonstrates the great potential of using prompt for unsupervised keyphrase extraction. We release our code at this url.
引用
收藏
页码:9788 / 9801
页数:14
相关论文
共 50 条
  • [1] TripleRank: An unsupervised keyphrase extraction algorithm
    Li, Tuohang
    Hu, Liang
    Li, Hongtu
    Sun, Chengyu
    Li, Shuai
    Chi, Ling
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 219 (219)
  • [2] Unsupervised keyphrase extraction for search ontologies
    Gulla, Jon Atle
    Borch, Hans Olaf
    Ingvaldsen, Jon Espen
    [J]. NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS, PROCEEDINGS, 2006, 3999 : 25 - 36
  • [3] Unsupervised Keyphrase Extraction for Web Pages
    Haarman, Tim
    Zijlema, Bastiaan
    Wiering, Marco
    [J]. MULTIMODAL TECHNOLOGIES AND INTERACTION, 2019, 3 (03)
  • [4] Combination of Unsupervised Keyphrase Extraction Algorithms
    Zhu, Zede
    Li, Miao
    Chen, Lei
    Yang, Zhenxin
    Chen, Sheng
    [J]. 2013 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2013), 2013, : 33 - 36
  • [5] AttentionRank: Unsupervised keyphrase Extraction using Self and Cross Attentions
    Ding, Haoran
    Luo, Xiao
    [J]. 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 1919 - 1928
  • [6] Unsupervised Keyphrase Extraction in Academic Publications Using Human Attention
    Zhang, Yingyi
    Zhang, Chengzhi
    [J]. 17TH INTERNATIONAL CONFERENCE ON SCIENTOMETRICS & INFORMETRICS (ISSI2019), VOL II, 2019, : 2483 - 2484
  • [7] SemCluster: Unsupervised Automatic Keyphrase Extraction Using Affinity Propagation
    Alrehamy, Hassan H.
    Walker, Coral
    [J]. ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, 2018, 650 : 222 - 235
  • [8] An Unsupervised Approach for Keyphrase Extraction Using Within-Collection Resources
    Li, Teng-Fei
    Hu, Liang
    Chu, Jian-Feng
    Li, Hong-Tu
    Chi, Ling
    [J]. IEEE ACCESS, 2019, 7 : 126088 - 126097
  • [9] NamedKeys: Unsupervised Keyphrase Extraction for Biomedical Documents
    Gero, Zelalem
    Ho, Joyce C.
    [J]. ACM-BCB'19: PROCEEDINGS OF THE 10TH ACM INTERNATIONAL CONFERENCE ON BIOINFORMATICS, COMPUTATIONAL BIOLOGY AND HEALTH INFORMATICS, 2019, : 328 - 337
  • [10] How Preprocessing Affects Unsupervised Keyphrase Extraction
    Wang, Rui
    Liu, Wei
    McDonald, Chris
    [J]. COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, CICLING 2014, PT I, 2014, 8403 : 163 - 176