Enhancement on 3 DoF Image Stitching Using Inertia Sensor Data

In this paper, a method to generate panoramic images by combining conventional feature extraction algorithms (e.g., SIFT, SURF, MPEG-7 CDVS) with sensed data from an inertia sensor is proposed to enhance the image stitching results. The challenge of image stitching increases when the images are taken from two different mobile phones with no posture calibration. Using inertia sensor data obtained by the mobile phone, images with different yaw angles, pitch angles, roll angles are preprocessed and adjusted before performing stitching process. Performance of stitching (e.g., stitching accuracy) between conventional feature extraction algorithms is reported along with the stitching performance with/without using the inertia sensor data. Finally, the method of speeding up the stitching of videos (i.e., a sequence of images) is proposed using the same inertia sensor data. Keywords—image stitching; video stitching; panoramic video; ultra wide viewing video; sensor-based image stitching