Premium
Comparison of the reliability and validity of scores from two concept‐mapping techniques *
Author(s) -
RuizPrimo Maria Araceli,
Schultz Susan E.,
Li Min,
Shavelson Richard J.
Publication year - 2001
Publication title -
journal of research in science teaching
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 3.067
H-Index - 131
eISSN - 1098-2736
pISSN - 0022-4308
DOI - 10.1002/1098-2736(200102)38:2<260::aid-tea1005>3.0.co;2-f
Subject(s) - concept map , construct (python library) , sample (material) , reliability (semiconductor) , scratch , mind map , computer science , mathematics education , psychology , artificial intelligence , mathematics , chemistry , power (physics) , physics , chromatography , quantum mechanics , programming language , operating system
This paper reports the results of a study that compared two concept‐mapping techniques, one high‐directed, “fill‐in‐the‐map,” and one low‐directed, “construct‐a‐map‐from‐scratch.” We examined whether: (1) skeleton map scores were sensitive to the sample of nodes or linking lines to be filled in; (2) the two types of skeleton maps were equivalent; and (3) the two mapping techniques provided similar information about students' connected understanding. Results indicated that fill‐in‐the‐map scores were not sensitive to the sample of concepts or linking lines to be filled in. Nevertheless, the fill‐in‐the‐nodes and fill‐in‐the‐lines techniques were not equivalent forms of fill‐in‐the‐map. Finally, high‐directed and low‐directed maps led to different interpretations about students' knowledge structure. Whereas scores obtained under the high‐directed technique indicated that students' performance was close to the maximum possible, the scores obtained with the low‐directed technique revealed that students' knowledge was incomplete compared to a criterion map. We concluded that the construct‐a‐map technique better reflected differences among students' knowledge structure. © 2001 John Wiley & Sons, Inc. J Res Sci Teach 38: 260–278, 2001