A Classification Model of Legal Consulting Questions Based on Multi-Attention Prototypical Networks

被引:0
|
作者
Jianzhou Feng
Jinman Cui
Qikai Wei
Zhengji Zhou
Yuxiong Wang
机构
[1] Yanshan University,School of information Science and Engineering
[2] Shengming Jizhi (Beijing) Technology Co.,undefined
[3] Ltd,undefined
[4] Chongqing NewGo AI Co.,undefined
[5] Ltd,undefined
关键词
Legal consulting questions classification; Few-shot learning; Prototypical networks; Instance-dimension level attention;
D O I
暂无
中图分类号
学科分类号
摘要
Text classification is a research hotspot in the field of natural language processing. Existing text classification models based on supervised learning, especially deep learning models, have made great progress on public datasets. But most of these methods rely on a large amount of training data, and these datasets coverage is limited. In the legal intelligent question-answering system, accurate classification of legal consulting questions is a necessary prerequisite for the realization of intelligent question answering. However, due to lack of sufficient annotation data and the cost of labeling is high, which lead to the poor effect of traditional supervised learning methods under sparse labeling. In response to the above problems, we construct a few-shot legal consulting questions dataset, and propose a prototypical networks model based on multi-attention. For the same category of instances, this model first highlights the key features in the instances as much as possible through instance-dimension level attention. Then it realizes the classification of legal consulting questions by prototypical networks. Experimental results show that our model achieves state-of-the-art results compared with baseline models. The code and dataset are released on https://github.com/cjm0824/MAPN.
引用
收藏
相关论文
共 50 条
  • [41] Hierarchical Attention Prototypical Networks for Few-Shot Text Classification
    Sun, Shengli
    Sun, Qingfeng
    Zhou, Kevin
    Lv, Tengchao
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 476 - 485
  • [42] Hybrid Attention-Based Prototypical Networks for Noisy Few-Shot Relation Classification
    Gao, Tianyu
    Han, Xu
    Liu, Zhiyuan
    Sun, Maosong
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 6407 - 6414
  • [43] Few-shot relation classification by context attention-based prototypical networks with BERT
    Bei Hui
    Liang Liu
    Jia Chen
    Xue Zhou
    Yuhui Nian
    EURASIP Journal on Wireless Communications and Networking, 2020
  • [44] MATNet: A Combining Multi-Attention and Transformer Network for Hyperspectral Image Classification
    Zhang, Bo
    Chen, Yaxiong
    Rong, Yi
    Xiong, Shengwu
    Lu, Xiaoqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [45] Dense Captioning Method Based on Multi-attention Structure
    Liu Q.-R.
    Li G.
    Zhao C.
    Gu G.-H.
    Zhao Y.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (10): : 2537 - 2548
  • [46] MSMA: A multi-stage and multi-attention algorithm for the classification of multimodal skin lesions
    Shu, Ci
    Yu, Long
    Tian, Shengwei
    Shi, Xianwei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
  • [47] Factual Consistency Assessment Evaluation Model for Text Summarization Based on Multi-Attention Mechanism
    Wei, Chuyuan
    Zhang, Xinxian
    Wang, Zhiyuan
    Li, Jinzhe
    Liu, Jie
    Computer Engineering and Applications, 2023, 59 (07) : 163 - 170
  • [48] Multi-Depth Learning with Multi-Attention for fine-grained image classification
    Dai, Zuhua
    Li, Hongyi
    Li, Kelong
    Zhou, Anwei
    2020 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND HUMAN-COMPUTER INTERACTION (ICHCI 2020), 2020, : 206 - 212
  • [49] Patent Citation Dynamics Modeling via Multi-Attention Recurrent Networks
    Ji, Taoran
    Chen, Zhiqian
    Self, Nathan
    Fu, Kaiqun
    Lu, Chang-Tien
    Ramakrishnan, Naren
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2621 - 2627
  • [50] Human Action Recognition Method Based on Multi-Attention Mechanism and Spatiotemporal Graph Convolution Networks
    Li, Xuanye
    Hao, Xingwei
    Jia, Jingong
    Zhou, Yuanfeng
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (07): : 1055 - 1063