Open AccessMultimodal action recognition using variational‐based Beta‐Liouville hidden Markov models
Author(s) -
Ali Samr,
Bouguila Nizar
Publication year - 2020
Publication title -
iet image processing
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.401
H-Index - 45
eISSN - 1751-9667
pISSN - 1751-9659
DOI - 10.1049/iet-ipr.2020.0709
Subject(s) - hidden markov model , beta (programming language) , action (physics) , artificial intelligence , markov chain , computer science , pattern recognition (psychology) , mathematics , markov process , machine learning , physics , statistics , quantum mechanics , programming language
The visible spectrum is the most widely used modality for video media. Nonetheless, it is highly dependent on the lighting conditions. Hence, infrared (IR) imaging lower light sensitivity characterisation presents the untapped potential for robust automatic recognition systems. This is applicable to many applications including IR action recognition (AR), which is a relatively young field in IR. As such, in this study, the authors tackle IR and multimodal AR with the proposed utilisation of variational learning of Beta‐Liouville (BL) hidden Markov models (HMMs). Furthermore, to the best of the authors' knowledge, this is the first evaluation of the BL HMM in visible AR and in multimodal fusion for AR. They present the results of the proposed model on the infrared action recognition and the IOSB datasets. Experimental results demonstrate promising outcomes. The importance of using IR and multispectral fusion in AR is also highlighted by the results.