Premium
Statistical Significance Testing in Second Language Research: Basic Problems and Suggestions for Reform
Author(s) -
Norris John M.
Publication year - 2015
Publication title -
language learning
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.882
H-Index - 103
eISSN - 1467-9922
pISSN - 0023-8333
DOI - 10.1111/lang.12114
Subject(s) - psychology , confusion , statistical hypothesis testing , statistical analysis , significance testing , statistical significance , cognitive psychology , linguistics , statistics , mathematics , philosophy , psychoanalysis
Traditions of statistical significance testing in second language (L2) quantitative research are strongly entrenched in how researchers design studies, select analyses, and interpret results. However, statistical significance tests using p values are commonly misinterpreted by researchers, reviewers, readers, and others, leading to confusion regarding the actual findings of primary studies and critical challenges for the accumulation of meaningful knowledge about language learning research. This paper outlines the basic challenges of accurately calculating and interpreting statistical significance tests, explores common examples of incorrect interpretations in L2 research, and proposes strategies for resolving these problems.