The Mapping-Adaptive Convolution: A Fundamental Theory for Homography or Perspective Invariant Matching Methods

If the local area of a three-dimensional object surface can be considered as a plane, the deformation between its two images captured from different camera placements is modelled by a homography. By tuning the parameters in a homographic mapping, all possible deformations caused by the change of camera placement can be simulated for the local feature matching method. Since aliasing may happen when resampling the original image to the geometry of the simulated image, an antialiasing convolution must be applied before resampling. However, the antialiasing convolution itself must also be homography-adaptive. In the scale invariant feature transform (SIFT) or affine-SIFT (ASIFT) method, the similitude or affine rectification scheme of the convolution is applied to solve this problem under similitude or affine mapping. However, these schemes will not work under homographic or perspective mapping. Although the perspective invariant matching method (perspective-SIFT or PSIFT) has been proposed in some references...