Performance analysis of GAME: A generic automated marking environment

被引:12
|
作者
Blumenstein, Michael [1 ]
Green, Steve [1 ]
Fogelman, Shoshana [2 ]
Nguyen, Ann [1 ]
Muthukkumarasarny, Vallipuram [1 ]
机构
[1] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 9726, Australia
[2] Griffith Univ, Griffith Sch Environm, Nathan, Qld 9726, Australia
关键词
architectures for educational technology system; post-secondary education; programming and programming languages; teaching/learning strategies;
D O I
10.1016/j.compedu.2006.11.006
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper describes the Generic Automated Marking Environment (GAME) and provides a detailed analysis of its performance in assessing student programming projects and exercises. GAME has been designed to automatically assess programming assignments written in a variety of languages based oil the "structure" of the source code and the correctness of the program's output. Currently, the system is able to mark programs written in Java, C++ and the C language. To use the system, instructors are required to provide a simple "marking schema" for each given assessment item, which includes pertinent information such as the location of files and the model solution. In this research, GAME has been tested on a number of student programming exercises and assignments and its performance has been compared against that of a human marker. An in-depth statistical analysis of the comparison is presented, providing encouraging results and directions for employing GAME as a tool for teaching and learning. (C) 2006 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1203 / 1216
页数:14
相关论文
共 50 条
  • [31] Automated Unbounded Analysis of Cryptographic Constructions in the Generic Group Model
    Ambrona, Miguel
    Barthe, Gilles
    Schmidt, Benedikt
    ADVANCES IN CRYPTOLOGY - EUROCRYPT 2016, PT II, 2016, 9666 : 822 - 851
  • [32] A game semantics for generic polymorphism
    Abramsky, S
    Jagadeesan, R
    ANNALS OF PURE AND APPLIED LOGIC, 2005, 133 (1-3) : 3 - 37
  • [33] A game semantics for generic polymorphism
    Abramsky, S
    Jagadeesan, R
    FOUNDATIONS OF SOFTWARE SCIENCE AND COMPUTATION STRUCTURES, PROCEEDINGS, 2003, 2620 : 1 - 22
  • [34] Automated road marking recognition system
    Ziyatdinov, R. R.
    Shigabiev, R. R.
    Talipov, D. N.
    INTERNATIONAL SCIENTIFIC-TECHNICAL CONFERENCE ON INNOVATIVE ENGINEERING TECHNOLOGIES, EQUIPMENT AND MATERIALS 2016 (ISTC-IETEM-2016), 2017, 240
  • [35] STUDY ON THE GAME ANALYSIS OF ENVIRONMENT POLLUTION CONTROLLING
    Ma, Wei-Min
    Zhang, Xiao-Na
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 2164 - +
  • [36] A Customized and Automated Assignment Management and Marking System for Evaluating Student Performance in the STEM Disciplines
    Shokri, Ashkan
    Halupka, Veronica
    Pauwels, Valentijn R. N.
    2021 IEEE FRONTIERS IN EDUCATION CONFERENCE (FIE 2021), 2021,
  • [37] Unit Testing Challenges with Automated Marking
    Tantithamthavorn, Chakkrit
    Chen, Norman
    PROCEEDINGS OF THE 2023 30TH ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE, APSEC 2023, 2023, : 544 - 548
  • [38] Automated Marking of Transfer Function Problems
    Moore, David
    TECHNOLOGICAL DEVELOPMENTS IN EDUCATION AND AUTOMATION, 2010, : 139 - 144
  • [39] Marking of number and genericity: generic interpretation in the acquisition of PB
    Augusto, Marina R. A.
    LETRAS DE HOJE-ESTUDOS E DEBATES EM LINGUISTICA LITERATURA E LINGUA PORTUGUESA, 2007, 42 (01): : 35 - 52
  • [40] Game analysis of China's generic technology R&D
    Du, Haitao
    Cao, Yashu
    PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON MANAGEMENT SCIENCE AND ENGINEERING MANAGEMENT, 2008, : 153 - 157