USING PLACEHOLDER TEXT IN NARRATIVE OPEN-ENDED QUESTIONS IN WEB SURVEYS

被引:3
|
作者
Kunz, Tanja [1 ]
Quoss, Franziska [2 ]
Gummer, Tobias [1 ]
机构
[1] GESIS Leibniz Inst Social Sci, Monitoring Soc & Social Change, B2,1, D-68159 Mannheim, Germany
[2] Swiss Fed Inst Technol, Dept Humanities Social & Polit Sci, IFW C 43-1,Haldeneggsteig 4, CH-8092 Zurich, Switzerland
关键词
Burden; Coding quality; Data quality; Paradata; Placeholder text; Visual design of narrative open-ended questions; RESPONSE QUALITY; ITEM NONRESPONSE; VISUAL DESIGN; ONLINE; FEATURES; ANSWER; LENGTH; PC;
D O I
10.1093/jssam/smaa039
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
Narrative open-ended questions are suitable for gathering detailed information without limiting respondents to a predefined set of response categories. However, despite efforts to improve the quality of open-ended responses using different verbal and visual design features, respondents are often unwilling to expend effort on substantive and comprehensive responses. Based on a Web survey experiment conducted with opt-in panelists in Germany, we test whether placeholder text (i.e., lorem ipsum) in the answer box of a narrative open-ended question can be used as a visual stimulus to promote high-quality responses without discouraging respondents from answering the question. We find that, although placeholder texts that suggest long and extensive responses elicit more extensive responses, they also result in longer response times and less substantive responses. As the disadvantages of such lengthy placeholder texts thus appear to outweigh their advantages, we advise against using them. We further find that shorter placeholder texts do not provide any additional benefits. These findings also suggest that any kind of visual design feature should always be tested thoroughly before use.
引用
收藏
页码:992 / 1012
页数:21
相关论文
共 50 条
  • [1] Open-Ended Questions in Web Surveys
    Smyth, Jolene D.
    Dillman, Don A.
    Christian, Leah Melani
    Mcbride, Mallory
    [J]. PUBLIC OPINION QUARTERLY, 2009, 73 (02) : 325 - 337
  • [2] Intelligent processing of open-ended questions in mass web-surveys
    Nikulchev, Evgeny
    Silaeva, Anastasiya
    Ilin, Dmitry
    Malykh, Sergey
    [J]. 14TH INTERNATIONAL SYMPOSIUM INTELLIGENT SYSTEMS, 2021, 186 : 706 - 712
  • [3] The Effects of Open-Ended Probes on Closed Survey Questions in Web Surveys
    Hadler, Patricia
    [J]. SOCIOLOGICAL METHODS & RESEARCH, 2023,
  • [4] Editorial: The Use of Open-ended Questions in Surveys
    Neuert, Cornelia E.
    Meitinger, Katharina
    Behr, Dorothee
    Schonlau, Matthias
    [J]. METHODS DATA ANALYSES, 2021, 15 (01): : 3 - 6
  • [5] Automatic coding of open-ended surveys using text categorization techniques
    Giorgetti, D
    Prodanof, I
    Sebastiani, F
    [J]. ASC 2003: THE IMPACT OF TECHNOLOGY ON THE SURVEY PROCESS, 2003, : 173 - 184
  • [6] A Comparison of Three Designs for List-style Open-ended Questions in Web Surveys
    Kunz, Tanja
    Meitinger, Katharina
    [J]. FIELD METHODS, 2022, 34 (04) : 303 - 317
  • [7] The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web Surveys
    Holland, Jennifer L.
    Christian, Leah Melani
    [J]. SOCIAL SCIENCE COMPUTER REVIEW, 2009, 27 (02) : 196 - 212
  • [8] Designing Input Fields for Non-Narrative Open-Ended Responses in Web Surveys
    Couper, Mick P.
    Kennedy, Courtney
    Conrad, Frederick G.
    Tourangeau, Roger
    [J]. JOURNAL OF OFFICIAL STATISTICS, 2011, 27 (01) : 65 - 85
  • [9] Automatic grading and hinting in open-ended text questions
    Sychev, Oleg
    Anikin, Anton
    Prokudin, Artem
    [J]. COGNITIVE SYSTEMS RESEARCH, 2020, 59 : 264 - 272
  • [10] Text highlighting combined with open-ended questions: A methodological extension
    Ares, Gaston
    Ryan, Grace S. S.
    Jaeger, Sara R. R.
    [J]. JOURNAL OF SENSORY STUDIES, 2023, 38 (03)