Generalizability Theory as a Unifying Framework of Measurement Reliability in Adolescent Research

被引:14
|
作者
Fan, Xitao [1 ]
Sun, Shaojing [2 ]
机构
[1] Univ Macau, Taipa, Peoples R China
[2] Fudan Univ, Shanghai 200433, Peoples R China
来源
JOURNAL OF EARLY ADOLESCENCE | 2014年 / 34卷 / 01期
关键词
reliability; generalizability theory; intraclass correlation; Cronbach's coefficient alpha; interrater reliability; Pearson correlation; variance components; analysis of variance; INTRACLASS CORRELATIONS; INTERRATER RELIABILITY; BARTKOS; SCALE;
D O I
10.1177/0272431613482044
中图分类号
D669 [社会生活与社会问题]; C913 [社会生活与社会问题];
学科分类号
1204 ;
摘要
In adolescence research, the treatment of measurement reliability is often fragmented, and it is not always clear how different reliability coefficients are related. We show that generalizability theory (G-theory) is a comprehensive framework of measurement reliability, encompassing all other reliability methods (e.g., Pearson r, coefficient alpha and KR-20, intraclass correlation coefficients). As such, G-theory provides the flexibility and comprehensiveness not offered by conventional reliability methods. Within the G-theory framework, the similarities and differences of different reliability coefficients can be easily understood, and planning for optimal measurement protocols in adolescence research is feasible. Using hypothetical data, we show how different conventional reliability estimates are related to G-theory estimates and how G-theory estimates are obtained in research practice. Adolescence researchers may use G-theory as the general framework for understanding different reliability estimates.
引用
收藏
页码:38 / 65
页数:28
相关论文
共 50 条
  • [21] An Examination of Rater Drift Within a Generalizability Theory Framework
    Harik, Polina
    Clauser, Brian E.
    Grabovsky, Irina
    Nungester, Ronald J.
    Swanson, Dave
    Nandakumar, Ratna
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2009, 46 (01) : 43 - 58
  • [23] APPLICATION OF GENERALIZABILITY THEORY TO ASSESS RELIABILITY OF HEALTH MARKER STATES
    Schunemann, Holger J.
    Norman, Geoff
    Stahl, Elisabeth
    Wiklund, Ingela
    Puhan, Milo
    Guyatt, Gordon
    QUALITY OF LIFE RESEARCH, 2004, 13 (09) : 1550 - 1550
  • [24] Beyond classical reliability: Using generalizability theory to assess dependability
    Burns, KJ
    RESEARCH IN NURSING & HEALTH, 1998, 21 (01) : 83 - 90
  • [25] Reliability of Body Composition Assessment Using Generalizability Theory (G-Theory).
    Hart, Peter D.
    Jensen, Patrick
    MEDICINE AND SCIENCE IN SPORTS AND EXERCISE, 2016, 48 (05): : 992 - 992
  • [26] Graphic pain rating scale reliability using generalizability theory
    Ragan, BG
    Kang, M
    Marquez, T
    Bell, GW
    Zhu, W
    MEDICINE AND SCIENCE IN SPORTS AND EXERCISE, 2004, 36 (05): : S295 - S295
  • [27] Reliability of observers' subjective impressions of families: A generalizability theory approach
    Stora, Bent
    Hagtvet, Knut A.
    Heyerdahl, Sonja
    PSYCHOTHERAPY RESEARCH, 2013, 23 (04) : 448 - 463
  • [28] Estimating Reliability of Referee Licensing Test: Application of Generalizability Theory
    Lee, Tae-Koo
    Lee, Han-Joo
    Yang, Hee-Won
    Lee, Kyung-Hwa
    Kwak, Ju-Hyun
    RESEARCH QUARTERLY FOR EXERCISE AND SPORT, 2018, 89 : A32 - A32
  • [29] The Comparison of Reliability According to Generalizability Theory and Classical Test Theory on Random Data
    Guler, Nese
    EGITIM VE BILIM-EDUCATION AND SCIENCE, 2011, 36 (162): : 225 - 234
  • [30] The Examination of Reliability of Vee Diagrams According to Classical Test Theory and Generalizability Theory
    Polat Demir, Betul
    JOURNAL OF MEASUREMENT AND EVALUATION IN EDUCATION AND PSYCHOLOGY-EPOD, 2016, 7 (02): : 419 - 431