Automatic Evaluation for Arabic Essays: A Rule-Based System

被引:0
|
作者
Alqahtani, Abeer [1 ]
Alsaif, Amal [1 ]
机构
[1] Al Immam Mohammad Ibn Saud Islamic Univ IMSIU, Coll Comp & Informat Sci, Comp Sci Dept, Riyadh, Saudi Arabia
关键词
automatic essay scoring; writing evaluation;
D O I
10.1109/isspit47144.2019.9001802
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Essay writing is a common way to evaluate students' writing skills. Automated Essay Scoring (AES) systems are designed to facilitate the grading task for a large number of students in schools, universities, and testing companies. This study proposes a rule-based system to evaluate Arabic essays automatically, based on free textual essay analysis, whether or not there are predefined model essays. The evaluation criteria include surface-based and text processing requirements such as spelling, punctuation marks, essay structure, coherence, and essay style. To evaluate our system, we collected unrestricted Arabic essays from native Arabic writers with university-level proficiency. This dataset has been manually evaluated following our rubric based on the common criteria for good writing. The results obtained by our system show that, for essay's overall score around 73% were correctly evaluated. In addition, results show a variety in the system performance for each specific criterion. This system is designed as a baseline for more advanced AES system that uses complex features with machine learning techniques in future.
引用
下载
收藏
页数:7
相关论文
共 50 条
  • [41] An experimental evaluation of the effectiveness of automatic rule-based transformations for safety-critical applications
    Rebaudengo, M
    Reorda, MS
    Torchiano, M
    Violante, M
    IEEE INTERNATIONAL SYMPOSIUM ON DEFECT AND FAULT TOLERANCE IN VLSI SYSTEMS, PROCEEDINGS, 2000, : 257 - 265
  • [42] Automatic construction of rule-based trees for conceptual retrieval
    Kim, M
    Lu, F
    Raghavan, VV
    SPIRE 2000: SEVENTH INTERNATIONAL SYMPOSIUM ON STRING PROCESSING AND INFORMATION RETRIEVAL - PROCEEDINGS, 2000, : 153 - 161
  • [43] A MULTIPLE HYPOTHESIS RULE-BASED AUTOMATIC TARGET RECOGNIZER
    WOOTTON, J
    CARPENTER, C
    HOBSON, G
    KELLER, J
    LECTURE NOTES IN COMPUTER SCIENCE, 1988, 301 : 315 - 324
  • [44] A rule-based algorithm for automatic bond type perception
    Zhang, Qian
    Zhang, Wei
    Li, Youyong
    Wang, Junmei
    Zhang, Liling
    Hou, Tingjun
    JOURNAL OF CHEMINFORMATICS, 2012, 4
  • [45] Rule-based automatic software performance diagnosis and improvement
    Xu, Jing
    PERFORMANCE EVALUATION, 2012, 69 (11) : 525 - 550
  • [46] Automatic extraction of definitions in Portuguese: A rule-based approach
    Del Gaudio, Rosa
    Branco, Antonio
    PROGRESS IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2007, 4874 : 659 - 670
  • [47] Rule-based Automatic Phonetic Transcription for the Romanian Language
    Stefan-Adrian, Toma
    Doru-Petru, Munteanu
    2009 COMPUTATION WORLD: FUTURE COMPUTING, SERVICE COMPUTATION, COGNITIVE, ADAPTIVE, CONTENT, PATTERNS, 2009, : 682 - 686
  • [48] Rule-based automatic software performance diagnosis and improvement
    Xu, Jing
    PERFORMANCE EVALUATION, 2010, 67 (08) : 585 - 611
  • [49] Automatic Trigger Generation for Rule-based Smart Homes
    Nandi, Chandrakana
    Ernst, Michael D.
    PROCEEDINGS OF THE 2016 ACM WORKSHOP ON PROGRAMMING LANGUAGES AND ANALYSIS FOR SECURITY (PLAS'16), 2016, : 97 - 102
  • [50] A Rule-Based Approach for Automatic Interaction Detection and Annotation
    Sharaf, Nada
    Abdennadher, Slim
    Fruhwirth, Thom
    2017 21ST INTERNATIONAL CONFERENCE INFORMATION VISUALISATION (IV), 2017, : 194 - 198