Open AccessRobust spatiotemporal stereo against image motion and temporal disparity variation
Author(s) -
Shin Y.,
Yoon K.J.
Publication year - 2016
Publication title -
electronics letters
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.375
H-Index - 146
eISSN - 1350-911X
pISSN - 0013-5194
DOI - 10.1049/el.2015.4026
Subject(s) - artificial intelligence , computer vision , optical flow , computer science , similarity (geometry) , filter (signal processing) , pixel , matching (statistics) , motion estimation , mathematics , image (mathematics) , pattern recognition (psychology) , statistics
When there exists camera motion as well as scene motion, the position and disparity of a pixel in an image sequence temporally vary with time. Such image motion (IM) and temporal disparity variation (TDV) degrade the performance of spatiotemporal stereo matching. In this Letter, a robust spatiotemporal similarity measure that addresses IM and TDV is proposed. To this end, an irregular spatiotemporal window whose temporal windows are located by a TDV value and optical flows is designed. In addition, a spatiotemporal guided filter‐based aggregation technique using temporal weights based on temporal proximity and flow reliability is presented. To handle a large number of labels effectively, a search range reduction method for finding a probable label set is presented. Experimental results show that the proposed method yields consistent and accurate disparity maps under IM and TDV.