The utility of reflective portfolios as a method of assessing first year medical students' personal and professional development

This study explores the reliability, validity and acceptability of assessment criteria for reflective portfolios at Peninsula Medical School, UK. The construct validity of the criteria was established by exploring its relationship with two other assessment methods and its reliability was determined using the generalizability (G) coefficient. Focus groups with assessors and students were convened to explore their views of the portfolios. Two portfolio analyses had a G coefficient of .42. Performance in the portfolio analyses was correlated with performance in personal and professional development judgements (r = -.512, p < .01) and scientific reports (r = .273, p = .002). Themes emerging from the focus groups include students preferring the structured nature of the portfolios but assessors feeling that this reduced the uniqueness of the portfolios. Although students understood the importance of reflective practice, some disliked the process of reflection, particularly reflective writing. Educators should design assessment criteria that maximize reliability, validity and acceptability rather than simply focusing on reliability alone.