Open AccessA temporal-and-spatial flow based multimodal fake news detection by pooling and attention blocks
Author(s) -
Ying Guo,
Wei Song
Publication year - 2022
Publication title -
ieee access
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.587
H-Index - 127
ISSN - 2169-3536
DOI - 10.1109/access.2022.3229762
Subject(s) - aerospace , bioengineering , communication, networking and broadcast technologies , components, circuits, devices and systems , computing and processing , engineered materials, dielectrics and plasmas , engineering profession , fields, waves and electromagnetics , general topics for engineers , geoscience , nuclear engineering , photonics and electrooptics , power, energy and industry applications , robotics and control systems , signal processing and analysis , transportation
As the advance of multimedia technology, the sources of information are not limited to one form but emerging multi-modal properties. Through the multimedia data processing, it is an essential component how to detect the fake news to avoid their spread. The fake news can leverage multimedia contents to fabricate evidences or mislead readers, which damages a lot for data management in social networks. In this work, we explore the task of multimodal fake news detection. The major challenge of fake news detection stems from the modality fusion by abundant information. Overcoming the limitations of the current models, we tackle the challenge of learning corrections between modalities in news, and substantially propose a block-based representation and fusion mechanism that can leverage the middle knowledge both from the spatial and temporal respective. Except for the original fake news detector, our model outperforms others from two components: pooling blocks-based feature extractor, attention blocks-based feature aggregator. The performance of our proposed architecture is evaluated on Weibo dataset, which indicates the superiority over the baseline model to an evident degree.