Open AccessDesign and validation of a system of categories to assess the written discourse of L2 English learners
Author(s) -
Silvia Corral Robles,
Micaela Sánchez Martín,
Gracia María González Gijón
Publication year - 2021
Publication title -
porta linguarum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.554
H-Index - 13
eISSN - 2695-8244
pISSN - 1697-7467
DOI - 10.30827/portalin.v0i36.15944
Subject(s) - rigour , credibility , inter rater reliability , content validity , content analysis , psychology , mathematics education , test (biology) , coding (social sciences) , delphi method , qualitative research , transferability , foreign language , language assessment , english as a foreign language , test validity , computer science , pedagogy , psychometrics , artificial intelligence , sociology , mathematics , clinical psychology , developmental psychology , social science , rating scale , paleontology , geometry , logit , machine learning , political science , law , biology
This study is part of a broader research focused on written discourse analysis and its application in English language teaching. This paper aims to design and evaluate the validity of the content of an instrument (a system of categories) built to analyse the written discourse in L2 (English) of 112 Spanish students in Upper Secondary Education. This study was carried out from a qualitative approach using the technique of content analysis and the Delphi technique with five experts in the field. The results show that the category system has content validity as it meets the criteria to ensure the scientific rigour of qualitative methodology: credibility, transferability, dependence and confirmability. Moreover, there is a high score in terms of interrater reliability on the criteria contrasted with Kendall's W test (>.07), as well as on its application in the coding process which was confirmed with Cohen's Kappa test (.658). It can be concluded that this instrument is a valid tool to help ELF teachers and secondary school students in the teaching and learning process of the written discourse in English as a foreign language.