Attention virtual adversarial based semi-supervised question generation

被引:1
|
作者
An, Jing [1 ]
Wang, Kefan [1 ]
Sun, Hui [2 ]
Cui, Can [2 ]
Li, Wei [2 ]
Ma, Chao [1 ]
机构
[1] Shanghai Inst Technol, Sch Elect & Elect Engn, Shanghai, Peoples R China
[2] Tongji Univ, Sch Elect & Informat Engn, Shanghai 201804, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
adversarial train; question generation; semi-supervised learning; virtual adversarial training;
D O I
10.1002/cpe.6797
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Question generation (QG) refers to the automatic generation of questions based on the given passages and answers, and has a wide range of application scenarios in human-computer interaction, education, medical and other fields. However, for Chinese QG, due to the lack of word separation in the writing rules of Chinese text, many methods are not suitable for it, and the generated results have incorrect word order and invalid expressions. In addition, traditional models only use labeled data, but it is difficult and expensive to obtain data labels. In order to solve this problem, this article proposes a semi-supervised QG model termed virtual stroke-aware copy network (VSAC Net). It is based on virtual adversarial training and can be used for Chinese QG tasks with few labeled samples. The VSAC Net model combines word embedding virtual counter disturbance and attention virtual counter disturbance, the fitting of the input layer and the attention layer is taken into account, and reduces the overfitting of the model. According to Dureader dataset, a small sample QG dataset is constructed, and the VSAC Net is used for solving. The results show that the proposed model can achieve a better generation effect on small sample datasets.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Patch attention network with generative adversarial model for semi-supervised binocular disparity prediction
    Zhibo Rao
    Mingyi He
    Yuchao Dai
    Zhelun Shen
    [J]. The Visual Computer, 2022, 38 : 77 - 93
  • [32] Stable self-attention adversarial learning for semi-supervised semantic image segmentation
    Zhang, Jia
    Li, Zhixin
    Zhang, Canlong
    Ma, Huifang
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 78
  • [33] Patch attention network with generative adversarial model for semi-supervised binocular disparity prediction
    Rao, Zhibo
    He, Mingyi
    Dai, Yuchao
    Shen, Zhelun
    [J]. VISUAL COMPUTER, 2022, 38 (01): : 77 - 93
  • [34] Semi-Supervised Leukocyte Segmentation Based on Adversarial Learning With Reconstruction Enhancement
    Teng, Shenghua
    Wu, Jiawei
    Chen, Yuanyuan
    Fan, Haoyi
    Cao, Xinrong
    Li, Zuoyong
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [35] Semi-supervised community detection method based on generative adversarial networks
    Liu, Xiaoyang
    Zhang, Mengyao
    Liu, Yanfei
    Liu, Chao
    Li, Chaorong
    Wang, Wei
    Zhang, Xiaoqin
    Bouyer, Asgarali
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (03)
  • [36] Adversarial Sample Based Semi-Supervised Learning for Industrial Soft Sensor
    Feng, Liangjun
    Zhao, Chunhui
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 11644 - 11649
  • [37] A semi-supervised image segmentation method based on generative adversarial network
    Nie, Wei
    Gou, Peng
    Liu, Yang
    Zhou, Tianyu
    Xu, Nuo
    Wang, Peng
    Du, QiQi
    [J]. IEEE Joint International Information Technology and Artificial Intelligence Conference (ITAIC), 2022, 2022-June : 1217 - 1223
  • [38] SEMI-SUPERVISED ADVERSARIAL AUTOENCODER BASED SPECTRUM SENSING FOR COGNITIVE RADIO
    Liang, Wei
    Zhang, Xi
    Yuan, Jianhua
    Kou, Caixia
    Ai, Wenbao
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2023, 19 (01): : 161 - 173
  • [39] SEMI-SUPERVISED CHANGE DETECTION BASED ON GRAPHS WITH GENERATIVE ADVERSARIAL NETWORKS
    Liu, Junfu
    Chen, Keming
    Xu, Guangluan
    Li, Hao
    Yan, Menglong
    Diao, Wenhui
    Sun, Xian
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 74 - 77
  • [40] Hierarchical Attention Based Semi-supervised Network Representation Learning
    Liu, Jie
    Deng, Junyi
    Xu, Guanghui
    He, Zhicheng
    [J]. NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT I, 2018, 11108 : 237 - 249