Open AccessWHAT CAN REPEATED CROSS‐SECTIONAL STUDIES TELL US ABOUT STUDENT GROWTH?
Author(s) -
Almond Russell G.,
Sinharay Sandip
Publication year - 2012
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2012.tb02299.x
Subject(s) - cross sectional study , psychology , repeated measures design , cross sectional data , growth curve (statistics) , sample (material) , sample size determination , statistics , econometrics , mathematics , chromatography , chemistry
To answer questions about how students' proficiencies are changing over time, educational researchers are looking for data sources that span many years. Clearly, for answering questions about student growth, a longitudinal study—in which a single sample is followed over many years—is preferable to repeated cross‐sectional samples—in which a separate sample is taken every year. Repeated cross‐sectional studies, such as the National Assessment of Educational Progress (NAEP), however, are often readily available. Repeated cross‐sectional studies conflate several sources of variability (differences in the initial status of individuals, individual differences in the growth curves, and individual‐by‐measurement‐occasion differences) in ways that are not easily separated. Although repeated cross‐sectional studies can provide information about the growth of the averages, the growth of the averages corresponds to the average of the growth curves only in very restricted circumstances. This paper reviews the literature on modeling growth with an eye to characterizing the limitations of repeated cross‐sectional studies and understanding the sensitivity of the results to key decisions (particularly, choices of cut points). In most cases, repeated cross‐sectional studies should be used to confirm and contextualize the results of more targeted longitudinal studies.