Premium
Educational portfolios in the assessment of general practice trainers: reliability of assessors
Author(s) -
Pitts John,
Coles Colin,
Thomas Peter
Publication year - 1999
Publication title -
medical education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.776
H-Index - 138
eISSN - 1365-2923
pISSN - 0308-0110
DOI - 10.1046/j.1365-2923.1999.00445.x
Subject(s) - summative assessment , judgement , reliability (semiconductor) , general practice , portfolio , consistency (knowledge bases) , psychology , medical education , cornerstone , cohort , inter rater reliability , medicine , formative assessment , family medicine , pedagogy , rating scale , computer science , developmental psychology , political science , history , artificial intelligence , law , archaeology , financial economics , power (physics) , quantum mechanics , physics , economics
Objectives This paper reports a project that assessed a series of portfolios assembled by a cohort of participants attending a course for prospective general practice trainers. Design The reliability of judgements about individual ‘components’, together with an overall global judgement about performance were studied. Setting NHSE South & West, King Alfred’s College, Winchester and Institute of Community Studies, Bournemouth University. Subjects Eight experienced general practice trainers recruited from around Wessex, which incorporates Hampshire, Dorset, Wiltshire and the Isle of Wight. Results The reliability of individual assessor’s judgements (i.e. their consistency) was moderate, but inter‐rater reliability did not reach a level which could support making a safe summative judgement. The levels of reliability reached were similar to other subjective assessments and perhaps reflected individuality of personal agendas of both the assessed and the assessors, and variations in portfolio structure and content. Conclusions Suggestions for approaches in future are made.