Open AccessReal-world structure facilitates the rapid emergence of scene category information in visual brain signals
Author(s) -
Daniel Kaiser,
Greta Häberle,
Radoslaw Martin Cichy
Publication year - 2020
Publication title -
journal of neurophysiology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.302
H-Index - 245
eISSN - 1522-1598
pISSN - 0022-3077
DOI - 10.1152/jn.00164.2020
Subject(s) - computer science , electroencephalography , decoding methods , artificial intelligence , scene statistics , computer vision , visual perception , pattern recognition (psychology) , visual processing , communication , psychology , perception , neuroscience , telecommunications
In everyday life, our visual surroundings are not arranged randomly but structured in predictable ways. Although previous studies have shown that the visual system is sensitive to such structural regularities, it remains unclear whether the presence of an intact structure in a scene also facilitates the cortical analysis of the scene's categorical content. To address this question, we conducted an EEG experiment during which participants viewed natural scene images that were either "intact" (with their quadrants arranged in typical positions) or "jumbled" (with their quadrants arranged into atypical positions). We then used multivariate pattern analysis to decode the scenes' category from the EEG signals (e.g., whether the participant had seen a church or a supermarket). The category of intact scenes could be decoded rapidly within the first 100 ms of visual processing. Critically, within 200 ms of processing, category decoding was more pronounced for the intact scenes compared with the jumbled scenes, suggesting that the presence of real-world structure facilitates the extraction of scene category information. No such effect was found when the scenes were presented upside down, indicating that the facilitation of neural category information is indeed linked to a scene's adherence to typical real-world structure rather than to differences in visual features between intact and jumbled scenes. Our results demonstrate that early stages of categorical analysis in the visual system exhibit tuning to the structure of the world that may facilitate the rapid extraction of behaviorally relevant information from rich natural environments. NEW & NOTEWORTHY Natural scenes are structured, with different types of information appearing in predictable locations. Here, we use EEG decoding to show that the visual brain uses this structure to efficiently analyze scene content. During early visual processing, the category of a scene (e.g., a church vs. a supermarket) could be more accurately decoded from EEG signals when the scene adhered to its typical spatial structure compared with when it did not.