Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison

被引:61
|
作者
Van den Haak, MJ [1 ]
de Jong, MDT [1 ]
Schellens, PJ [1 ]
机构
[1] Univ Twente, Fac Behav Sci, Dept Commun Studies, NL-7500 AE Enschede, Netherlands
关键词
usability testing; concurrent think-aloud protocols; retrospective think-aloud protocols; constructive interaction; co-discovery; validity;
D O I
10.1016/j.intcom.2004.07.007
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper describes a comparative study of three usability test approaches: concurrent think-aloud protocols, retrospective think-aloud protocols, and constructive interaction. These three methods were compared by means of an evaluation of an online library catalogue, which involved four points of comparison: number and type of usability problems detected; relevance of the problems detected; overall task performance; and participant experiences. The results of the study showed that there were only few significant differences between the usability test approaches, mainly with respect to manner of problem detecting, task performance and participant experience. For the most part, the usability methods proved very much comparable, revealing similar numbers and types of problems that were equally relevant. Taking some practical aspects into account, a case can be made for preferring the concurrent think-aloud protocols over the other two methods. (C) 2004 Elsevier B.V. All rights reserved.
引用
收藏
页码:1153 / 1170
页数:18
相关论文
共 21 条
  • [1] Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue
    van den Haak, M
    De Jong, M
    Schellens, PJ
    [J]. BEHAVIOUR & INFORMATION TECHNOLOGY, 2003, 22 (05) : 339 - 351
  • [2] Think-Aloud Protocols: A Comparison of Three Think-Aloud Protocols for use in Testing Data-Dissemination Web Sites for Usability
    Olmsted-Hawala, Erica L.
    Murphy, Elizabeth D.
    Hawala, Sam
    Ashenfelter, Kathleen T.
    [J]. CHI2010: PROCEEDINGS OF THE 28TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1-4, 2010, : 2381 - +
  • [3] Utilizing Think-Aloud Protocols to Assess the Usability of a Test for Ethical Sensitivity in Construction
    Sands, Kenneth Stafford, II
    Simmons, Denise Rutledge
    [J]. 2014 ASEE ANNUAL CONFERENCE, 2014,
  • [4] YouTube Gamers and Think-Aloud Protocols: Introducing Usability Testing
    May, Jamie
    [J]. IEEE TRANSACTIONS ON PROFESSIONAL COMMUNICATION, 2019, 62 (01) : 94 - 103
  • [5] Rethinking Thinking Aloud: A Comparison of Three Think-Aloud Protocols
    Alhadreti, Obead
    Mayhew, Pam
    [J]. PROCEEDINGS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2018), 2018,
  • [6] Think-aloud Protocols: Analyzing Three Different Think-aloud Protocols with Counts of Verbalized Frustrations in a Usability Study of an Information-rich Web Site
    Olmsted-Hawala, Erica L.
    Murphy, Elizabeth D.
    Hawala, Sam
    Ashenfelter, Kathleen T.
    [J]. 2010 IEEE INTERNATIONAL PROFESSIONAL COMMUNICATION CONFERENCE, 2010, : 60 - 66
  • [7] A comparison of think-aloud, questionnaires and interviews for testing usability with children
    Donker, A
    Markopoulos, P
    [J]. PEOPLE AND COMPUTERS XVI- MEMORABLE YET INVISIBLE, PROCEEDINGS, 2002, : 305 - 316
  • [8] An Empirical Study of the Effects of Three Think-Aloud Protocols on Identification of Usability Problems
    Bruun, Anders
    Stage, Jan
    [J]. HUMAN-COMPUTER INTERACTION - INTERACT 2015, PT II, 2015, 9297 : 159 - 176
  • [9] Exploring two methods of usability testing: concurrent versus retrospective think-aloud protocols
    van den Haak, MJ
    de Jong, MDT
    [J]. IPCC 2003 PROCEEDINGS, THE SHAPE OF KNOWLEDGE, 2003, : 285 - 287
  • [10] Evaluating municipal websites: A methodological comparison of three think-aloud variants
    van den Haak, Maaike J.
    de Jong, Menno D. T.
    Schellens, Peter Jan
    [J]. GOVERNMENT INFORMATION QUARTERLY, 2009, 26 (01) : 193 - 202