The reliability and validity of a matrix to assess the completed reflective personal development plans of general practitioners

被引:7
|
作者
Roberts, C
Cromarty, I
Crossley, J
Jolly, B
机构
[1] Univ Sheffield, Sheffield S10 2TN, S Yorkshire, England
[2] Postgrad GP Educ, Cambridge, England
[3] Chesterfield & N Derbyshire Royal Hosp Trust, Chesterfield, England
[4] Monash Univ, Fac Med Nursing & Hlth Sci, Ctr Med & Hlth Sci Educ, Clayton, Vic 3168, Australia
关键词
family practice; education; medical; graduate; standards; staff development; accreditation; documentation; Great Britain; clinical competence; psychometrics;
D O I
10.1111/j.1365-2929.2006.02413.x
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
INTRODUCTION We wished to determine whether assessors could make reliable and valid judgements about the quality of completed reflective personal development plans (PDPs) for the purpose of accrediting UK general practitioners (GPs) for a postgraduate education allowance using a marking matrix, and secondly, to plan a feasible model of PDP assessment in the context of forthcoming GP appraisal/revalidation that would overcome the main sources of error identified from this study. METHODS Within generalisability theory, a variance components analysis on PDP scores estimated reliability and the effect on them of varying, for example, the number of assessors. We investigated the construct validity of the matrix through its internal consistency and detection of differences in the quality of PDPs. RESULTS For a single PDP and one assessor, 37.6% of the variance in scores was due to true differences in the quality of the PDP. Between 5 and 7 PDP assessors are needed to achieve summative reliability of greater than 0.8. While increasing the number of judges is important, reliability could also be improved by addressing assessor subjectivity. Construct validity was demonstrated, as the matrix distinguished between good, satisfactory and poor PDPs, and it had good internal consistency. CONCLUSION PDP assessment has reasonable summative characteristics for the purpose of assessing GPs' reflective continuing professional development. If doctors could include their PDPs within their revalidation folders as evidence of their reflections on pursuing better clinical performance, we have described a reliable, valid and feasible method of external assessment.
引用
收藏
页码:363 / 370
页数:8
相关论文
共 48 条
  • [31] The development and reliability of the Royal College of General Practitioners' questionnaire for measuring senior house officers' satisfaction with their hospital training
    Hand, CH
    Adams, M
    BRITISH JOURNAL OF GENERAL PRACTICE, 1998, 48 (432): : 1399 - 1403
  • [32] Development of the psychosomatic symptom scale (PSSS) and assessment of its reliability and validity in general hospital patients in China
    Li, Lei
    Peng, Tianci
    Liu, Rui
    Jiang, Ronghuan
    Liang, Dongfeng
    Li, Xiangping
    Ni, Aihua
    Ma, Huan
    Wei, Xianwen
    Liu, Hanxiang
    Zhang, Jing
    Li, Hengfen
    Pang, Jianyue
    Ji, Yunxin
    Zhang, Li
    Cao, Yin
    Chen, Yun
    Zhou, Bo
    Wang, Jinny
    Mao, Xueqin
    Yang, Lejin
    Fang, Jianqun
    Shi, Honglan
    Wu, Aiqin
    Yuan, Yonggui
    GENERAL HOSPITAL PSYCHIATRY, 2020, 64 : 1 - 8
  • [33] Resourcing an evolution of roles in general-practice: a study to determine the validity and reliability of tools to assist nurses and patients to assess physical activity
    Dutton, Shona N.
    Bauman, Adrian
    Dennis, Sarah M.
    Zwar, Nicholas
    Harris, Mark F.
    AUSTRALIAN JOURNAL OF PRIMARY HEALTH, 2016, 22 (06) : 505 - 509
  • [34] Development of the myositis activities profile -: Validity and reliability of a self-administered questionnaire to assess activity limitations in patients with polymyositis/dermatomyositis
    Alexanderson, H
    Lundberg, IE
    Stenström, CH
    JOURNAL OF RHEUMATOLOGY, 2002, 29 (11) : 2386 - 2392
  • [35] Development of a Novel Pictorial Questionnaire to Assess Knowledge and Behaviour on Ergonomics and Posture as Well as Musculoskeletal Pain in University Students: Validity and Reliability
    Salman, Mona
    Bettany-Saltikov, Josette
    Kandasamy, Gokulakannan
    Aristegui Racero, Garikoitz
    HEALTHCARE, 2024, 12 (03)
  • [36] Development and use of a pediatric quality of life questionnaire in AIDS clinical trials: Reliability and validity of the general health assessment for children
    Gortmaker, SL
    Lenderking, WR
    Clark, C
    Lee, S
    Fowler, MG
    Oleske, JM
    MEASURING HEALTH-RELATED QUALITY OF LIFE IN CHILDREN AND ADOLESCENTS: IMPLICATIONS FOR RESEARCH AND PRACTICE, 1998, : 219 - 235
  • [37] Development, validity, and reliability of the General Activities of Daily Living Scale: a multidimensional measure of activities of daily living for older people
    de Paula, Jonas J.
    Bertola, Laiss
    de Avila, Rafaela T.
    Assis, Luciana de O.
    Albuquerque, Maicon
    Bicalho, Maria A.
    de Moraes, Edgar N.
    Nicolato, Rodrigo
    Malloy-Diniz, Leandro F.
    REVISTA BRASILEIRA DE PSIQUIATRIA, 2014, 36 (02) : 143 - 152
  • [38] Indicators of the appropriateness of long term prescribing in general practice in the United Kingdom: consensus development, face and content validity, feasibility, and reliability
    Cantrill, JA
    Sibbald, B
    Buetow, S
    QUALITY IN HEALTH CARE, 1998, 7 (03): : 130 - 135
  • [39] Development of 3D method to assess intramuscular spatial distribution of fat infiltration in patients with rotator cuff tear: reliability and concurrent validity
    Rajan Khanna
    Matthew D. Saltzman
    James M. Elliott
    Mark A. Hoggarth
    Guido M. Marra
    Imran Omar
    Todd Parrish
    Amee L. Seitz
    BMC Musculoskeletal Disorders, 20
  • [40] Development of 3D method to assess intramuscular spatial distribution of fat infiltration in patients with rotator cuff tear: reliability and concurrent validity
    Khanna, Rajan
    Saltzman, Matthew D.
    Elliott, James M.
    Hoggarth, Mark A.
    Marra, Guido M.
    Omar, Imran
    Parrish, Todd
    Seitz, Amee L.
    BMC MUSCULOSKELETAL DISORDERS, 2019, 20 (1)