Attention virtual adversarial based semi-supervised question generation

被引:1
|
作者
An, Jing [1 ]
Wang, Kefan [1 ]
Sun, Hui [2 ]
Cui, Can [2 ]
Li, Wei [2 ]
Ma, Chao [1 ]
机构
[1] Shanghai Inst Technol, Sch Elect & Elect Engn, Shanghai, Peoples R China
[2] Tongji Univ, Sch Elect & Informat Engn, Shanghai 201804, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
adversarial train; question generation; semi-supervised learning; virtual adversarial training;
D O I
10.1002/cpe.6797
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Question generation (QG) refers to the automatic generation of questions based on the given passages and answers, and has a wide range of application scenarios in human-computer interaction, education, medical and other fields. However, for Chinese QG, due to the lack of word separation in the writing rules of Chinese text, many methods are not suitable for it, and the generated results have incorrect word order and invalid expressions. In addition, traditional models only use labeled data, but it is difficult and expensive to obtain data labels. In order to solve this problem, this article proposes a semi-supervised QG model termed virtual stroke-aware copy network (VSAC Net). It is based on virtual adversarial training and can be used for Chinese QG tasks with few labeled samples. The VSAC Net model combines word embedding virtual counter disturbance and attention virtual counter disturbance, the fitting of the input layer and the attention layer is taken into account, and reduces the overfitting of the model. According to Dureader dataset, a small sample QG dataset is constructed, and the VSAC Net is used for solving. The results show that the proposed model can achieve a better generation effect on small sample datasets.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Adversarial Semi-Supervised Semantic Segmentation with Attention Mechanism
    Yun, Fei
    Yin, Yanjun
    Zhang, Wenxuan
    Zhi, Min
    [J]. Computer Engineering and Applications, 2023, 59 (08) : 254 - 262
  • [2] Virtual Adversarial Training for Semi-supervised Verification Tasks
    Noroozi, Vahid
    Bahaadini, Sara
    Zheng, Lei
    Xie, Sihong
    Yu, Philip S.
    [J]. 2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [3] Semi-supervised Active Learning for Semi-supervised Models: Exploit Adversarial Examples with Graph-based Virtual Labels
    Guo, Jiannan
    Shi, Haochen
    Kang, Yangyang
    Kuang, Kun
    Tang, Siliang
    Jiang, Zhuoren
    Sun, Changlong
    Wu, Fei
    Zhuang, Yueting
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2876 - 2885
  • [4] Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning
    Miyato, Takeru
    Maeda, Shin-Ichi
    Koyama, Masanori
    Ishii, Shin
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (08) : 1979 - 1993
  • [5] Latent Space Virtual Adversarial Training for Supervised and Semi-Supervised Learning
    Osada, Genki
    Ahsan, Budrul
    Prasad Bora, Revoti
    Nishide, Takashi
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (03) : 667 - 678
  • [6] Attention-Based Generative Adversarial Network for Semi-supervised Image Classification
    Xuezhi Xiang
    Zeting Yu
    Ning Lv
    Xiangdong Kong
    Abdulmotaleb El Saddik
    [J]. Neural Processing Letters, 2020, 51 : 1527 - 1540
  • [7] Attention-Based Generative Adversarial Network for Semi-supervised Image Classification
    Xiang, Xuezhi
    Yu, Zeting
    Lv, Ning
    Kong, Xiangdong
    El Saddik, Abdulmotaleb
    [J]. NEURAL PROCESSING LETTERS, 2020, 51 (02) : 1527 - 1540
  • [8] Semi-Supervised Graph Contrastive Learning With Virtual Adversarial Augmentation
    Dong, Yixiang
    Luo, Minnan
    Li, Jundong
    Liu, Ziqi
    Zheng, Qinghua
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) : 4232 - 4244
  • [9] Virtual Adversarial Training for Semi-supervised Breast Mass Classification
    Chen, Xuxin
    Wang, Ximin
    Zhang, Ke
    Fung, Kar-Ming
    Thai, Theresa C.
    Moore, Kathleen
    Mannel, Robert S.
    Liu, Hong
    Zheng, Bin
    Qiu, Yuchen
    [J]. BIOPHOTONICS AND IMMUNE RESPONSES XVII, 2022, 11961
  • [10] Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering
    Zhang, Shiyue
    Bansal, Mohit
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 2495 - 2509