Open AccessDeep social force network for anomaly event detection
Author(s) -
Yang Xingming,
Wang Zhiming,
Wu Kewei,
Xie Zhao,
Hou Jinkui
Publication year - 2021
Publication title -
iet image processing
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.401
H-Index - 45
eISSN - 1751-9667
pISSN - 1751-9659
DOI - 10.1049/ipr2.12299
Subject(s) - computer science , artificial intelligence , discriminative model , anomaly detection , optical flow , encoder , computer vision , deep learning , motion (physics) , feature (linguistics) , coding (social sciences) , pattern recognition (psychology) , image (mathematics) , mathematics , linguistics , philosophy , operating system , statistics
Anomaly event detection is vital in surveillance video analysis. However, how to learn the discriminative motion in the crowd scene is still not tackled. Here, a deep social force network by exploiting both social force extracting and deep motion coding is proposed. Given a grid of particles with velocity provided by the optical flow, the interaction force in the crowd scene is investigated and a social force module is embedded in a deep network. A deep motion convolution was further designed with a 3D (DMC‐3D) module. The DMC‐3D not only eliminates the noise motion in the crowd scene with a spatial encoder–decoder but also learns the 3D feature with a spatio‐temporal encoder. The deep social force coding is modelled with multiple features, in which each feature can describe specific anomaly motion. The experiments on UCF‐Crime and ShanghaiTech datasets demonstrate that our method can predict the temporal localization of anomaly events and outperform the state‐of‐the‐art methods.