Writing Consistency Evaluation Based on Siamese Neural Network

被引：0

作者：

Liu J. ^{[1
,2
]}

Zhang W. ^{[1
]}

Li Y. ^{[1
]}

Zhang Y. ^{[1
]}

Zhou J. ^{[3
]}

机构：

[1] School of Information Engineering College, Capital Normal University, Beijing

[2] School of Information Science, North China University of Technology, Beijing

[3] School of Research Center for Language Intelligence of China, Capital Normal University, Beijing

来源：

Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology | 2022年 / 42卷 / 06期

关键词：

Automated essay scoring; Composition evaluation; Siamese neural network; Writing consistency;

D O I：

10.15918/j.tbit1001-0645.2021.171

中图分类号：

学科分类号：

摘要：

For current chapter graded consistency metric model only considers the full text consistency of the tested composition, and cannot capture the implicit semantic characteristics of the text language block and the consistency between them. In view of the above problems, a composition text consistency evaluation model was proposed for general compositions. Refering to the thoughts of the twin neural network, the model was arranged to extract the character, image characteristics, and storyline characteristics of the core character simultaneously in the composition and to perform similarity metrics, so as to obtain the central idea of the text and the matching score of the text consistency. A subject model Biterm-LDA(Latent Dirichlet Allocation)was used to extract the subject character of composition to avoid the dependence of the artificial labeling. The results show that the proposed model score is consistent with the results of artificial labeling, and is superior to ordinary neural network models. Copyright ©2022 Transaction of Beijing Institute of Technology. All rights reserved.

引用

页码：649 / 657

页数：8

共 11 条

[1] TAN Xiaoping, YANG Lijiao, SU Jingjie, A study of the construction of grammar points knowledge-base and the Annotation of grammar points for TCSL, Journal of Chinese Information Processing, 29, 6, pp. 54-61, (2015)
[2] FU Ruiji, WANG Dong, WANG Shijin, Et al., Elegant sentence recognition for automated essay scoring, Journal of Chinese Information Processing, 32, 6, pp. 88-97, (2018)
[3] YANG R, CAO J, WEN Z, Et al., Enhancing automated essay scoring performance via cohesion measurement and combination of regression and ranking, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, pp. 1560-1569, (2020)
[4] KUO K, CARPUAT M., Evaluating a Bi-LSTM model for metaphor detection in TOEFL essays, Proceedings of the Second Workshop on Figurative Language Processing, pp. 192-196, (2020)
[5] MAYFIELD E, BLACK A W., Should You fine-tune BERT for automated essay scoring?, Proceedings of the Fifteenth WorkShop on Innovative Use of NLP for Building Educational Applications, pp. 151-162, (2020)
[6] LIN Z, NG H T, KAN M Y., Automatically evaluating text coherence using discourse relations, Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 1, pp. 997-1006, (2011)
[7] FENG V W, LIN Z, HIRST G., The impact of deep hierarchical discourse structures in the evaluation of text coherence, Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics, pp. 940-949, (2014)
[8] LIU Qiongxin, SONG Xiang, QIN Mingshuai, Deep knowledge-enhanced network for news recommendation, Transactions of Beijing Institute of Technology, 41, 3, pp. 286-294, (2021)
[9] GONG Hongyu, SAKAKINI Tarek, BHAT Suma, Et al., Document similarity for texts of varying lengths via hidden topics, Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 2341-2351, (2018)
[10] GAO Huiying, LIU Jiawei, YANG Shuxin, Identifying topics of online healthcare reviews based on improved LDA, Transactions of Beijing Institute of Technology, 39, 4, pp. 427-434, (2019)

← 1 2 →