Assessing Secondary Students' Digital Literacy Using an Evidence-Centered Game Design Approach

This study measured secondary students' digital literacy using a digital, game-based assessment system that was designed and developed based on the Evidence-Centered Game Design (ECGD) approach. A total of 188 valid secondary student samples were included in this study. Fine-grained behavioral data generated from students' gameplay processes were collected and recorded with the assessment system. The Delphi method was employed to determine the feature variables extracted from the process data that were related to digital literacy, and the Analytic Hierarchy Process (AHP) method was used to construct the measurement model. The assessment results of the ECGD-based assessment had a high correlation with the standardized test scores, which have been shown to be reliable and valid in previous large-scale assessment studies.