A Three-Stage Curriculum Learning Framework with Hierarchical Label Smoothing for Fine-Grained Entity Typing

被引:1
|
作者
Xu, Bo [1 ]
Zhang, Zhengqi [1 ]
Sha, Chaofeng [2 ,3 ]
Du, Ming [1 ]
Song, Hui [1 ]
Wang, Hongya [1 ]
机构
[1] Donghua Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[3] Shanghai Key Lab Intelligence Proc, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1007/978-3-031-00129-1_23
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we study the noisy labeling problem on the fine-grained entity typing (FET) task. Most existing methods propose to divide the training data into "clean" and "noisy" sets and use different strategies to deal with them during the training process. However, the "clean" samples used in these methods are not actually clean, some of them also contain noisy labels. To overcome this issue, we propose a three-stage curriculum learning framework with hierarchical label smoothing to train the FET model, which can use relatively clean data to train the model and prevent the model from overfitting to noisy labels. Experiments conducted on three widely used FET datasets show that our method achieves the new state-of-the-art performance. Our code is publicly available at https://github.com/xubodhu/NFETC-CLHLS.
引用
收藏
页码:289 / 296
页数:8
相关论文
共 50 条
  • [1] Hierarchical Modeling of Label Dependency and Label Noise in Fine-grained Entity Typing
    Wu, Junshuang
    Zhang, Richong
    Mao, Yongyi
    Shahrbabak, Masoumeh Soflaei
    Huai, Jinpeng
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3950 - 3956
  • [2] Dealing With Hierarchical Types and Label Noise in Fine-Grained Entity Typing
    Wu, Junshuang
    Zhang, Richong
    Mao, Yongyi
    Huai, Jinpeng
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2022, 30 : 1305 - 1318
  • [3] Fine-Grained Entity Typing with Hierarchical Inference
    Ren, Quan
    [J]. PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, : 2552 - 2558
  • [4] Transfer learning for fine-grained entity typing
    Hou, Feng
    Wang, Ruili
    Zhou, Yi
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2021, 63 (04) : 845 - 866
  • [5] Transfer learning for fine-grained entity typing
    Feng Hou
    Ruili Wang
    Yi Zhou
    [J]. Knowledge and Information Systems, 2021, 63 : 845 - 866
  • [6] Multilingual Fine-Grained Entity Typing
    van Erp, Marieke
    Vossen, Piek
    [J]. LANGUAGE, DATA, AND KNOWLEDGE, LDK 2017, 2017, 10318 : 262 - 275
  • [7] Hierarchical Losses and New Resources for Fine-grained Entity Typing and Linking
    Murty, Shikhar
    Verga, Patrick
    Vilnis, Luke
    Radovanovic, Irena
    McCallum, Andrew
    [J]. PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 97 - 109
  • [8] Improving Fine-grained Entity Typing with Entity Linking
    Dai, Hongliang
    Du, Donghong
    Li, Xin
    Song, Yangqiu
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 6210 - 6215
  • [9] Fine-Grained Entity Typing via Label Noise Reduction and Data Augmentation
    Li, Haoyang
    Lin, Xueling
    Chen, Lei
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT I, 2021, 12681 : 356 - 374
  • [10] Fine-Grained Entity Typing in Hyperbolic Space
    Lopez, Federico
    Heinzerling, Benjamin
    Strube, Michael
    [J]. 4TH WORKSHOP ON REPRESENTATION LEARNING FOR NLP (REPL4NLP-2019), 2019, : 169 - 180