Open AccessOptical flow estimation combining with objects edge features
Author(s) -
Liao Bin,
Hu Jinlong,
Li Tenghui
Publication year - 2020
Publication title -
electronics letters
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.375
H-Index - 146
eISSN - 1350-911X
pISSN - 0013-5194
DOI - 10.1049/el.2020.0578
Subject(s) - optical flow , visual cortex , artificial intelligence , computer science , computer vision , artificial neural network , benchmark (surveying) , enhanced data rates for gsm evolution , inference , pattern recognition (psychology) , edge detection , motion estimation , image processing , neuroscience , image (mathematics) , psychology , geodesy , geography
Optical flow estimation has been concerned with biological plausibility since the optical flow was drawn from psychology. In this Letter, optical flow estimation combining with objects edge features is proposed. Inspired of functional division and collaboration of edge detection in primary visual cortex and motion information acquisition in a motion‐selective area in the human visual cortex, a neural sub‐network is introduced to extract motion edge information as primary visual cortex does, and the other neural sub‐network is utilised to perceive motion information as a motion‐selective area in visual cortex does. The inference sub‐network in the authors’ model used augmentation features composed of objects, edge features and general features as inputs to predict the optical flow. In experiments on large displacements benchmark datasets, their approach showed promising results to improve the performance of optical flow comparing with the other models based on the visuomotor perception of visual cortex processing mechanism.