Improving the expressiveness of black-box models for predicting student performance

被引:31
|
作者
Villagra-Arnedo, Carlos J. [1 ]
Gallego-Duran, Francisco J. [1 ]
Llorens-Largo, Faraon [1 ]
Compan-Rosique, Patricia [1 ]
Satorre-Cuerda, Rosana [1 ]
Molina-Carmona, Rafael [1 ]
机构
[1] Univ Alicante, Dept Comp Sci & Artificial Intelligence, Carretera San Vicente del Raspeig S-N, Alicante 03690, Spain
关键词
Black-box models; Prediction; Student performance; Graphical representation; CLASSIFICATION;
D O I
10.1016/j.chb.2016.09.001
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Early prediction systems of student performance can be very useful to guide student learning. For a prediction model to be really useful as an effective aid for learning, it must provide tools to adequately interpret progress, to detect trends and behaviour patterns and to identify the causes of learning problems. White-box and black-box techniques have been described in literature to implement prediction models. White-box techniques require a priori models to explore, which make them easy to interpret but difficult to be generalized and unable to detect unexpected relationships between data. Black-box techniques are easier to generalize and suitable to discover unsuspected relationships but they are cryptic and difficult to be interpreted for most teachers. In this paper a black-box technique is proposed to take advantage of the power and versatility of these methods, while making some decisions about the input data and design of the classifier that provide a rich output data set. A set of graphical tools is also proposed to exploit the output information and provide a meaningful guide to teachers and students. From our experience, a set of tips about how to design a prediction system and the representation of the output information is also provided. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:621 / 631
页数:11
相关论文
共 50 条
  • [1] Black-Box Performance Models: Prediction based on Observation
    Happe, Jens
    Li, Hui
    Theilmann, Wolfgang
    QUASSOSS 09: 1ST INTERNATIONAL WORKSHOP ON THE QUALITY OF SERVICE-ORIENTED SOFTWARE SYSTEM, 2009, : 19 - 24
  • [2] Improving query efficiency of black-box attacks via the preference of models
    Yang, Xiangyuan
    Lin, Jie
    Zhang, Hanlin
    Zhao, Peng
    INFORMATION SCIENCES, 2024, 678
  • [3] Black-box models for fault detection and performance monitoring of buildings
    Jacob, Dirk
    Dietz, Sebastian
    Komhard, Susanne
    Neumann, Christian
    Herkel, Sebastian
    JOURNAL OF BUILDING PERFORMANCE SIMULATION, 2010, 3 (01) : 53 - 62
  • [4] Personalizing Performance Regression Models to Black-Box Optimization Problems
    Eftimov, Tome
    Jankovic, Anja
    Popovski, Gorjan
    Doerr, Carola
    Korosec, Peter
    PROCEEDINGS OF THE 2021 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'21), 2021, : 669 - 677
  • [5] Performance of conceptual and black-box models in flood warning systems
    Banihabib, Mohammad Ebrahim
    COGENT ENGINEERING, 2016, 3 (01):
  • [6] Interpretable Companions for Black-Box Models
    Pan, Danqing
    Wang, Tong
    Hara, Satoshi
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108 : 2444 - 2453
  • [7] Causal Interpretations of Black-Box Models
    Zhao, Qingyuan
    Hastie, Trevor
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2021, 39 (01) : 272 - 281
  • [8] OneMax in Black-Box Models with Several Restrictions
    Carola Doerr
    Johannes Lengler
    Algorithmica, 2017, 78 : 610 - 640
  • [9] ONEMAX in Black-Box Models with Several Restrictions
    Doerr, Carola
    Lengler, Johannes
    ALGORITHMICA, 2017, 78 (02) : 610 - 640
  • [10] Testing Framework for Black-box AI Models
    Aggarwal, Aniya
    Shaikh, Samiulla
    Hans, Sandeep
    Haldar, Swastik
    Ananthanarayanan, Rema
    Saha, Diptikalyan
    2021 IEEE/ACM 43RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: COMPANION PROCEEDINGS (ICSE-COMPANION 2021), 2021, : 81 - 84