Open AccessPerson tracking algorithm based on convolutional neural network for indoor video surveillance
Author(s) -
Rykhard Bohush,
I. Yu. Zakharava
Publication year - 2020
Publication title -
kompʹûternaâ optika
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.491
H-Index - 29
eISSN - 2412-6179
pISSN - 0134-2452
DOI - 10.18287/2412-6179-co-565
Subject(s) - computer science , artificial intelligence , convolutional neural network , computer vision , feature (linguistics) , video tracking , frame (networking) , pattern recognition (psychology) , similarity (geometry) , object detection , feature extraction , object (grammar) , image (mathematics) , telecommunications , philosophy , linguistics
In this paper, a person tracking algorithm for indoor video surveillance is presented. The algorithm contains the following steps: person detection, person features formation, features similarity calculation for the detected objects, postprocessing, person indexing, and person visibility determination in the current frame. Convolutional Neural Network (CNN) YOLO v3 is used for person detection. Person features are formed based on H channel in HSV color space histograms and a modified CNN ResNet. The proposed architecture includes 29 convolutional and one fully connected layer. As the output, it forms a 128-feature vector for every input image. CNN model was trained to perform feature extraction. Experiments were conducted using MOT methodology on stable camera videos in indoor environment. Main characteristics of the presented algorithm are calculated and discussed, confirming its effectiveness in comparison with the current approaches for person tracking in an indoor environment. Our algorithm performs real time processing for object detection and tracking using CUDA technology and a graphics card NVIDIA GTX 1060.