Open AccessPose‐driven human activity anomaly detection in a CCTV‐like environment
Author(s) -
Yang Yuxing,
Angelini Federico,
Naqvi Syed Mohsen
Publication year - 2022
Publication title -
iet image processing
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.401
H-Index - 45
eISSN - 1751-9667
pISSN - 1751-9659
DOI - 10.1049/ipr2.12664
Subject(s) - anomaly detection , artificial intelligence , computer science , object detection , autoencoder , computer vision , pattern recognition (psychology) , object (grammar) , anomaly (physics) , deep learning , rgb color model , physics , condensed matter physics
Human activity anomaly detection plays a crucial role in the next generation of surveillance and assisted living systems. Most anomaly detection algorithms are generative models and learn features from raw images. This work shows that popular state‐of‐the‐art autoencoder‐based anomaly detection systems are not capable of effectively detecting human‐posture and object‐positions related anomalies. Therefore, a human pose‐driven and object‐detector‐based deep learning architecture is proposed, which simultaneously leverages human poses and raw RGB data to perform human activity anomaly detection. It is demonstrated that pose‐driven learning overcomes the raw RGB based counterpart limitations in different human activities classification. Extensive validation is provided by using popular datasets. Then, it is demonstrated that with the aid of object detection, the human activities classification can be effectively used in human activity anomaly detection. Moreover, novel challenging datasets, that is, BMbD, M‐BMbD and JBMOPbD, are proposed for single and multi‐target human posture anomaly detection and joint human posture and object position anomaly detection evaluations.