Open AccessDecoding of visual activity patterns from fMRI responses using multivariate pattern analyses and convolutional neural network
Author(s) -
Raheel Zafar,
Nidal Kamel,
Mohamad Naufal,
Aamir Saeed Malik,
Sarat C. Dass,
Rana Fayyaz Ahmad,
Jafri Malin Abdullah,
Faruque Reza
Publication year - 2018
Publication title -
journal of integrative neuroscience
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.336
H-Index - 33
eISSN - 1757-448X
pISSN - 0219-6352
DOI - 10.3233/jin-170016
Subject(s) - convolutional neural network , decoding methods , multivariate statistics , computer science , neural decoding , multivariate analysis , artificial intelligence , pattern recognition (psychology) , psychology , machine learning , telecommunications
Decoding of human brain activity has always been a primary goal in neuroscience especially with functional magnetic resonance imaging (fMRI) data. In recent years, Convolutional neural network (CNN) has become a popular method for the extraction of features due to its higher accuracy, however it needs a lot of computation and training data. In this study, an algorithm is developed using Multivariate pattern analysis (MVPA) and modified CNN to decode the behavior of brain for different images with limited data set. Selection of significant features is an important part of fMRI data analysis, since it reduces the computational burden and improves the prediction performance; significant features are selected using t-test. MVPA uses machine learning algorithms to classify different brain states and helps in prediction during the task. General linear model (GLM) is used to find the unknown parameters of every individual voxel and the classification is done using multi-class support vector machine (SVM). MVPA-CNN based proposed algorithm is compared with region of interest (ROI) based method and MVPA based estimated values. The proposed method showed better overall accuracy (68.6%) compared to ROI (61.88%) and estimation values (64.17%).