Comparative framework for vision‐based gesturing modes and implementation of robust colour‐marker detector for practical environments

In this study, the authors have provided a detailed analysis based on experimental analysis, user‐feedback, and the literature survey to choose the appropriate gesturing mode between colour‐markers and bare‐hand for virtual dynamic gesturing system. Salient factors such as lexicon duration, muscle strain, target users, detection/tracking accuracy and so on, indicated that colour‐marker based models can outperform bare‐hand systems in real‐world scenarios. Colour‐markers are more robust to factors such as uneven illumination, affine transformations, and holds a better similarity to the natural way of writing on paper. However, colour‐markers can easily be erroneously detected/tracked due to the presence of imposters in the background. Most of the existing colour‐marker systems are developed with this limitation that reduces the naturalness and confines its application to a narrowed environment. This study addresses multiple types of frequently occurring imposters which are static/dynamic in nature and occlude the genuine colour‐marker often times. The imposters are distinguished based on factors such as speed, start/end position, the area of motion and so on. Some uncertain types of imposters which are partly similar to genuine gestures are distinguished based on the randomness present in the trajectories and classification models. The proposed techniques have achieved an accuracy of 98.26% in distinguishing the given imposter categories in this system.