Open AccessInterrater and intermethod reliability of default mode network selection
Author(s) -
Franco Alexandre R.,
Pritchard Aaron,
Calhoun Vince D.,
Mayer Andrew R.
Publication year - 2009
Publication title -
human brain mapping
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.005
H-Index - 191
eISSN - 1097-0193
pISSN - 1065-9471
DOI - 10.1002/hbm.20668
Subject(s) - default mode network , inter rater reliability , neuroscience , reliability (semiconductor) , psychology , hum , functional magnetic resonance imaging , anterior cingulate cortex , cognition , posterior cingulate , computer science , neuroimaging , human brain , brain mapping , artificial intelligence , pattern recognition (psychology) , cognitive psychology , developmental psychology , power (physics) , rating scale , physics , quantum mechanics , art , performance art , art history
There has been a growing interest in the neuroimaging community regarding resting state data (i.e., passive mental activity) and the subsequent activation of the so‐called default mode network (DMN). Although this network was originally characterized by a pattern of deactivation during active cognitive states, more recent applications of data‐driven techniques such as independent component analysis (ICA) have permitted the analysis of brain activation during extended periods of truly passive mental activity. However, ICA requires the resultant components to be evaluated for “goodness of fit” via either human raters or more automated techniques. To our knowledge, an investigation on the reliability of either technique in determining the component that best corresponds to default‐mode activity has not been performed. Moreover, it is not clear how automated techniques, which are necessarily dependent upon a template mask, are affected by the structures used to compose the mask. The current study investigated both interrater (human‐human) reliability and intermethod (human‐machine) reliability for determining DMN activation in 42 healthy controls. Results indicated that near perfect interrater reliability was achieved, whereas intermethod reliability was only within the moderate range. The latter was significantly improved via a weighted combination of the anterior and posterior cingulate nodes of the DMN. Implications for fully automating the component selection process are discussed. Hum Brain Mapp, 2009. © 2009 Wiley‐Liss, Inc.