Premium
Rater Sensitivity to Qualities of Lexis in Writing
Author(s) -
RUEGG RACHAEL,
FRITZ ERIK,
HOLLAND JENNIFER
Publication year - 2011
Publication title -
tesol quarterly
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.737
H-Index - 91
eISSN - 1545-7249
pISSN - 0039-8322
DOI - 10.5054/tq.2011.240860
Subject(s) - lexis , grammar , linguistics , rating scale , psychology , test (biology) , scale (ratio) , developmental psychology , geography , philosophy , paleontology , cartography , biology
An examination of the scores given using analytic rating scales can provide insight into how well the scales are measuring what they are supposed to be measuring. Many analytic rating scales include separate scales for lexis and grammar, yet the distinction between lexis and grammar has not been widely researched or defined. It is therefore unclear whether separate lexis and grammar scales are appropriate. For this reason, the lexis scores for 140 timed essays on a Japanese university English proficiency test were analyzed to determine what portion of variance is accounted for by different lexical qualities. In this test, which was administered to incoming university students at the beginning of the academic year, it was found that lexical accuracy is predictive of lexis scores. The lexis scores, however, are predicted by the scores on the grammar scale much more than range, frequency, or even accuracy of lexis in the essays. The difficulties in separating lexis from grammar when rating writing are discussed. Finally, limitations of the study and suggestions for further research are given.