A Classification Model of Legal Consulting Questions Based on Multi-Attention Prototypical Networks

被引:0
|
作者
Jianzhou Feng
Jinman Cui
Qikai Wei
Zhengji Zhou
Yuxiong Wang
机构
[1] Yanshan University,School of information Science and Engineering
[2] Shengming Jizhi (Beijing) Technology Co.,undefined
[3] Ltd,undefined
[4] Chongqing NewGo AI Co.,undefined
[5] Ltd,undefined
关键词
Legal consulting questions classification; Few-shot learning; Prototypical networks; Instance-dimension level attention;
D O I
暂无
中图分类号
学科分类号
摘要
Text classification is a research hotspot in the field of natural language processing. Existing text classification models based on supervised learning, especially deep learning models, have made great progress on public datasets. But most of these methods rely on a large amount of training data, and these datasets coverage is limited. In the legal intelligent question-answering system, accurate classification of legal consulting questions is a necessary prerequisite for the realization of intelligent question answering. However, due to lack of sufficient annotation data and the cost of labeling is high, which lead to the poor effect of traditional supervised learning methods under sparse labeling. In response to the above problems, we construct a few-shot legal consulting questions dataset, and propose a prototypical networks model based on multi-attention. For the same category of instances, this model first highlights the key features in the instances as much as possible through instance-dimension level attention. Then it realizes the classification of legal consulting questions by prototypical networks. Experimental results show that our model achieves state-of-the-art results compared with baseline models. The code and dataset are released on https://github.com/cjm0824/MAPN.
引用
收藏
相关论文
共 50 条
  • [31] Multi-Attention Object Detection Model in Remote Sensing Images Based on Multi-Scale
    Ying, Xiang
    Wang, Qiang
    Li, Xuewei
    Yu, Mei
    Jiang, Han
    Gao, Jie
    Liu, Zhiqiang
    Yu, Ruiguo
    IEEE ACCESS, 2019, 7 : 94508 - 94519
  • [32] Integrating deep learning and multi-attention for joint extraction of entities and relationships in engineering consulting texts
    Gao, Binwei
    Hu, Yuquan
    Gu, Jianan
    Han, Xueqiao
    AUTOMATION IN CONSTRUCTION, 2024, 168
  • [33] Fusion of ConvLSTM and Multi-Attention Mechanism Network for Hyperspectral Image Classification
    Tang Ting
    Xin, Pan
    Luo Xiao-ling
    Gao Xiao-jing
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43 (08) : 2608 - 2616
  • [34] Double-Branch Multi-attention Mechanism Based Sharpness-Aware Classification Network
    Jiang W.
    Zhao L.
    Tu C.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (03): : 252 - 267
  • [35] Topic-aware hierarchical multi-attention network for text classification
    Ye Jiang
    Yimin Wang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 1863 - 1875
  • [36] Deep Prototypical Networks With Hybrid Residual Attention for Hyperspectral Image Classification
    Xi, Bobo
    Li, Jiaojiao
    Li, Yunsong
    Song, Rui
    Shi, Yanzi
    Liu, Songlin
    Du, Qian
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 3683 - 3700
  • [37] Few-shot relation classification by context attention-based prototypical networks with BERT
    Hui, Bei
    Liu, Liang
    Chen, Jia
    Zhou, Xue
    Nian, Yuhui
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2020, 2020 (01)
  • [38] Topic-aware hierarchical multi-attention network for text classification
    Jiang, Ye
    Wang, Yimin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (05) : 1863 - 1875
  • [39] Stereo Matching Algorithm Based on Multi-Attention Mechanism
    Chen Qibo
    Ge Baozhen
    Li Yunpeng
    Quan Jianing
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)
  • [40] Dual-network Multi-attention Collaborative Classification Based on Fine-grained Vision
    Zhu, Qiangxi
    Kuang, WenLan
    Li, Zhixin
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 513 - 520