A Fuzzy Indiscernibility Based Measure of Distance between Semantic Spaces Towards Automatic Evaluation of Free Text Answers

被引:1
|
作者
Chakraborty, Udit Kr. [1 ]
Roy, Samir [2 ]
Choudhury, Sankhayan [3 ]
机构
[1] Sikkim Manipal Inst Technol, Dept Comp Sci & Engn, Sikkim 737136, India
[2] Natl Inst Tech Teachers Training & Res, Dept Comp Sci & Engn, Kolkata, India
[3] Univ Calcutta, Dept Comp Sci & Engn, Kolkata, India
关键词
Evaluation; textual answer; semantic similarity; roughness; fuzzy indiscernibility; RESPONSES;
D O I
10.1142/S021848851750043X
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Quantitative models built as tools for evaluating human language performance, can prove useful for both theoretical and applied areas of discourse comprehension, assessment, and education. The current paper offers a test case focused on mathematical articulation of a model and a test of that model with existing corpora. The model presented has been developed to evaluate free text answers of students based on the fuzzy indiscernibility between the semantic spaces created by the model answer and the learners' response. The model semantic space represented as a knowledge matrix can be constructed out of one or more model answers prepared by human experts and closely resemble the knowledge of the human evaluator. The proposed model finds out the indiscernibility between the types of word usage and scores the answer based on the fuzzy indiscernibility measures stored in a graded thesaurus prepared specifically for this purpose. The results returned on experimental data correlates well with human evaluators. This simulated learner-friendly atmosphere, inspired by a teacher's intelligent benevolence, ensures effective attainment of learning objective in e-learning environment.
引用
收藏
页码:987 / 1004
页数:18
相关论文
共 25 条
  • [1] Semantic Similarity based Approach for Automatic Evaluation of Free Text Answers using Link Grammar
    Chakraborty, Udit Kr
    Gurung, Rashmi
    Roy, Samir
    [J]. 2014 IEEE SIXTH INTERNATIONAL CONFERENCE ON TECHNOLOGY FOR EDUCATION (T4E), 2014, : 218 - 221
  • [2] Automatic Evaluation of Free Text Answers: A Review
    Shah, Nirja
    Pareek, Jyoti
    [J]. Communications in Computer and Information Science, 2022, 1760 CCIS : 232 - 249
  • [3] Leveraging Semantic Facets for Automatic Assessment of Short Free Text Answers
    Qiao, Chen
    Hu, Xiao
    [J]. IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2023, 16 (01): : 26 - 39
  • [4] Asymptotic Evaluation of Distance Measure on High Dimensional Vector Spaces in Text Mining
    Goto, Masayuki
    Ishida, Takashi
    Suzuki, Makoto
    Hirasawa, Shigeichi
    [J]. 2008 INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY AND ITS APPLICATIONS, VOLS 1-3, 2008, : 439 - +
  • [5] Automatic Evaluation of Text Summarization Based on Semantic Link Network
    Cao, Mengyun
    Hai Zhuge
    [J]. 2019 15TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG 2019), 2019, : 107 - 114
  • [6] A Semantic Similarity Measure Between Web Services Based on Google Distance
    Yang, Huirong
    Fu, Pengbin
    Yin, Baocai
    Ma, Mengduo
    Tang, Yanyan
    [J]. 2011 35TH IEEE ANNUAL INTERNATIONAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC), 2011, : 14 - 19
  • [7] An Automatic Translation Evaluation System Based on Semantic Similarities and Fuzzy Neartude
    Ke Xiao-hua
    [J]. 2009 INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND INFORMATION APPLICATION TECHNOLOGY, VOL III, PROCEEDINGS,, 2009, : 583 - 586
  • [8] Natural language processing for automatic evaluation of free-text answers - a feasibility study based on the European Diploma in Radiology examination
    Stoehr, Fabian
    Kaempgen, Benedikt
    Mueller, Lukas
    Zufiria, Laura Oleaga
    Junquero, Vanesa
    Merino, Cristina
    Mildenberger, Peter
    Kloeckner, Roman
    [J]. INSIGHTS INTO IMAGING, 2023, 14 (01)
  • [9] Natural language processing for automatic evaluation of free-text answers — a feasibility study based on the European Diploma in Radiology examination
    Fabian Stoehr
    Benedikt Kämpgen
    Lukas Müller
    Laura Oleaga Zufiría
    Vanesa Junquero
    Cristina Merino
    Peter Mildenberger
    Roman Kloeckner
    [J]. Insights into Imaging, 14
  • [10] OntoBAeval: Ontology Based Automatic Evaluation of Free-Text Response
    Thanawala, Pratik
    Pareek, Jyoti
    Shah, Manan
    [J]. 2014 IEEE SIXTH INTERNATIONAL CONFERENCE ON TECHNOLOGY FOR EDUCATION (T4E), 2014, : 189 - 190