Open AccessUnsupervised discovery of human activities from long‐time videos
Author(s) -
Elloumi Salma,
Cosar Serhan,
Pusiol Guido,
Bremond Francois,
Thonnat Monique
Publication year - 2015
Publication title -
iet computer vision
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.38
H-Index - 37
eISSN - 1751-9640
pISSN - 1751-9632
DOI - 10.1049/iet-cvi.2014.0311
Subject(s) - computer science , set (abstract data type) , network topology , trajectory , field (mathematics) , feature (linguistics) , motion (physics) , artificial intelligence , construct (python library) , feature extraction , machine learning , mathematics , linguistics , philosophy , astronomy , pure mathematics , programming language , operating system , physics
In this study, the authors propose a complete framework based on a hierarchical activity model to understand and recognise activities of daily living in unstructured scenes. At each particular time of a long‐time video, the framework extracts a set of space‐time trajectory features describing the global position of an observed person and the motion of his/her body parts. Human motion information is gathered in a new feature that the authors call perceptual feature chunks (PFCs). The set of PFCs is used to learn, in an unsupervised way, particular regions of the scene (topology) where the important activities occur. Using topologies and PFCs, the video is broken into a set of small events (‘primitive events’) that have a semantic meaning. The sequences of ‘primitive events’ and topologies are used to construct hierarchical models for activities. The proposed approach has been tested with the medical field application to monitor patients suffering from Alzheimer's and dementia. The authors have compared their approach to their previous study and a rule‐based approach. Experimental results show that the framework achieves better performance than existing works and has the potential to be used as a monitoring tool in medical field applications.