Open AccessEGOF-Net: epipolar guided optical flow network for unrectified stereo matching
Author(s) -
Yunpeng Li,
Baozhen Ge,
Qi Tian,
Qieni Lü,
Jianing Quan,
Q. B. Chen,
Lei Chen
Publication year - 2021
Publication title -
optics express
Language(s) - Uncategorized
Resource type - Journals
SCImago Journal Rank - 1.394
H-Index - 271
ISSN - 1094-4087
DOI - 10.1364/oe.440241
Subject(s) - epipolar geometry , computer science , fundamental matrix (linear differential equation) , artificial intelligence , computer vision , pipeline (software) , optical flow , stereopsis , matching (statistics) , point cloud , image (mathematics) , mathematics , mathematical analysis , statistics , programming language
It is challenging to realize stereo matching in dynamic stereo vision systems. We present an epipolar guided optical flow network (EGOF-Net) for unrectified stereo matching by estimating robust epipolar geometry with a deep cross-checking-based fundamental matrix estimation method (DCCM) and then surpassing false matches with a 4D epipolar modulator (4D-EM) module. On synthetic and real-scene datasets, our network outperforms the state-of-the-art methods by a substantial margin. Also, we test the network in an existing dynamic stereo system and successfully reconstruct the 3D point clouds. The technique can simplify the stereo vision pipeline by ticking out rectification operations. Moreover, it suggests a new opportunity for combining heuristic algorithms with neural networks. The code is available on https://github.com/psyrocloud/EGOF-Net.