An empirical assessment of pedagogical usability criteria for digital learning material with elementary school students

This paper presents the pedagogical usability criteria for evaluating the digital learning material. Pedagogical aspects of designing or using digital learning material are much less frequently studied than technical ones. Further, there are relatively few inventories measuring subjective end-user satisfaction with the pedagogical aspects of digital learning material and not a single inventory has undergone a rigorous process of empirical psychometric testing. They include the following components: 1. Learner control, 2. Learner activity, 3. Cooperative/Collaborative learning, 4. Goal orientation, 5. Applicability, 6. Added value, 7. Motivation, 8. Valuation of previous knowledge, 9. Flexibility and 10. Feedback. The pedagogical usability criteria have been operationalized into an on-line Likert -scale self-rating Pedagogically Meaningful Learning Questionnaire ( PMLQ) that has 56 items. In the PMLQ, separate items have been developed to measure the usability of the learning management system (LMS) and the learning material (LM). When evaluating the usability of a LMS, it is possible in the pedagogical context to evaluate the kind of learning material it enables the users to produce. Evaluation of the usability of a LM is based on a fact that the learning content is based on a certain learning goal or goals. The criteria of pedagogical usability presented here have undergone two-step psychometric testing process using empirical samples of 5th and 6th grade elementary school students (n = 66 and n = 74). Students evaluated one LMS and four LM's with PMLQ. Results supported the existence of theoretical dimensions of the criteria. The PMLQ was able to capture differences in the pedagogical usability profiles of the learning modules. Generalizability of the pedagogical usability criteria to other domains is limited by the small sample size, the small age range of respondents' and the small number of learning material evaluated. However, empirical studies that aim at evaluating a more representative set of learning material in different domains targeted for both adolescent and adult learners are currently conducted.