Open AccessSpike buffer: improve deep network performance by offset mechanism
Author(s) -
Li Daihui,
Zeng Shangyou,
Ma Chengxu
Publication year - 2020
Publication title -
the journal of engineering
Language(s) - English
Resource type - Journals
ISSN - 2051-3305
DOI - 10.1049/joe.2019.1235
Subject(s) - computer science , offset (computer science) , convolutional neural network , buffer (optical fiber) , convolution (computer science) , artificial neural network , artificial intelligence , activation function , algorithm , pattern recognition (psychology) , telecommunications , programming language
For a well‐designed neural network model, it is difficult to further improve its performance. This study proposes an offset mechanism called spike buffer, which can effectively improve the performance of the designed convolutional neural networks. The spike buffer introduces an offset buffer‐bit and a gradient spike function in the convolution channels to enhance the expression of effective features and suppresses the extraction of invalid features. Without significantly increasing the computational complexity of deep convolution neural networks, it can improve the feature selection performance of convolution neural networks and enhance the ability of non‐linear mapping, and can be easily embedded into various convolution neural networks. Experiments show that the performance of convolutional neural networks with integrated spike buffer can be effectively improved.