Open AccessUsing analytic rating scales to assess English/Chinese bi-directional interpretation: A longitudinal Rasch analysis of scale utility and rater behavior
Author(s) -
Chao Han
Publication year - 2018
Publication title -
linguistica antverpiensia new series - themes in translation studies
Language(s) - English
Resource type - Journals
ISSN - 2295-5739
DOI - 10.52034/lanstts.v16i0.429
Subject(s) - rasch model , rating scale , reliability (semiconductor) , scale (ratio) , interpretation (philosophy) , inter rater reliability , psychology , consistency (knowledge bases) , quality (philosophy) , cognitive psychology , computer science , artificial intelligence , developmental psychology , power (physics) , physics , philosophy , epistemology , quantum mechanics , programming language
Descriptor-based analytic rating scales have been increasingly used to assess interpretation quality. However, little empirical evidence is available to unequivocally support the effectiveness of rating scales and rater reliability. This longitudinal study thus attempts to shed insight into scale utility and rater behavior in English/Chinese interpretation performance assessment, using multifaceted Rasch measurement. Specifically, the study focuses on criterion/scale difficulty, scale effectiveness, rater severity/leniency and rater self-consistency between English/Chinese interpreting and over three time points. Research results are discussed, highlighting the utility of analytic rating scales and the variability of rater behavior in interpretation assessment. The results also have implications for developing reliable, valid, and practical instruments to assess interpretation quality.