Harmonizing data from open-ended and closed-ended quantity questions with observed score equating

被引:0
|
作者
Singh, Ranjit K. [1 ]
Roth, Matthias [1 ]
机构
[1] GESIS Leibniz Inst Social Sci, Mannheim, Germany
来源
SURVEY RESEARCH METHODS | 2023年 / 17卷 / 02期
关键词
data harmonization; observed score equating; FAIR data; comparability;
D O I
10.18148/srm/2023.v17i2.8087
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
Many surveys ask respondents about manifest quantities, such as income, age, weight, or their height. Surveys often either use open-ended questions, where respondents report the quantity directly as an integer value (e.g., "56"), or closed-ended quantity questions where respondents select from a set of discrete interval response options (e.g., "51 to 100"). Quantity data gath-ered with different response schemes thus becomes hard to compare or to harmonize to be used in integrative analyses. We compare two approaches to harmonizing quantity question data. Firstly, the widely used middle of category (MOC) interpolation. Secondly, Observed Score Equating in a Random Groups Design (OSE-RG). OSE-RG is originally an approach to harmonize measures for latent constructs. However, the equipercentile OSE-RG algorithm lends itself well to quantity questions. To test the performance of both algorithms, we gathered experimental data (N = 3484) on the number of books possessed as an example quantity, where we varied the quantity-question response scheme. We show that OSE-RG often outperforms or at least matches MOC when harmonizing closed-ended questions towards an open-ended format, or when harmonizing different closed-ended response formats amongst each other. Notably, OSE-RG is also less susceptible to response biases induced by different close-ended interval response schemes.
引用
收藏
页码:177 / 191
页数:15
相关论文
共 50 条
  • [41] Does the sequence of data collection influence participants' responses to closed and open-ended questions? A methodological study
    Covell, Christine L.
    Sidani, Souraya
    Ritchie, Judith A.
    INTERNATIONAL JOURNAL OF NURSING STUDIES, 2012, 49 (06) : 664 - 671
  • [42] Data Set on the Use of Continuous Improvement Programs in Companies From Open-Ended Questions
    Juarez-Tarraga, Amable
    Santandreu-Mascarell, Cristina
    Marin-Garcia, Juan A.
    FRONTIERS IN PSYCHOLOGY, 2021, 12
  • [43] Behavior of open- and closed-ended piles driven into sands
    Paik, K
    Salgado, R
    Lee, J
    Kim, B
    JOURNAL OF GEOTECHNICAL AND GEOENVIRONMENTAL ENGINEERING, 2003, 129 (04) : 296 - 306
  • [44] Contribution of open-ended questions in student evaluation of teaching
    Marshall, Pablo
    HIGHER EDUCATION RESEARCH & DEVELOPMENT, 2022, 41 (06) : 1992 - 2005
  • [45] Pastoral Conversation: Relational Listening and Open-Ended Questions
    Glenn E. Boyd
    Pastoral Psychology, 2003, 51 (5) : 345 - 360
  • [46] DO OPEN-ENDED QUESTIONS MEASURE SALIENT ISSUES
    GEER, JG
    PUBLIC OPINION QUARTERLY, 1991, 55 (03) : 360 - 370
  • [47] Automatic grading and hinting in open-ended text questions
    Sychev, Oleg
    Anikin, Anton
    Prokudin, Artem
    COGNITIVE SYSTEMS RESEARCH, 2020, 59 : 264 - 272
  • [48] Semi-automated categorization of open-ended questions
    Schonlau, Matthias
    Couper, Mick P.
    SURVEY RESEARCH METHODS, 2016, 10 (02): : 143 - 152
  • [49] Interactive Coding of Responses to Open-Ended Questions in Russian
    Senderovich, Nikita
    Maysuradze, Archil
    KNOWLEDGE ENGINEERING AND SEMANTIC WEB, KESW 2015, 2015, 518 : 195 - 209
  • [50] THE COMPARISON OF QUANTITATIVE METHODS FOR OPEN-ENDED QUESTIONS ANALYSIS
    Haviger, Jiri
    ICERI2015: 8TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION, 2015, : 5447 - 5453