Open AccessMouse face tracking using convolutional neural networks
Author(s) -
Akkaya İbrahim Batuhan,
Halici Ugur
Publication year - 2018
Publication title -
iet computer vision
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.38
H-Index - 37
eISSN - 1751-9640
pISSN - 1751-9632
DOI - 10.1049/iet-cvi.2017.0084
Subject(s) - computer science , convolutional neural network , artificial intelligence , robustness (evolution) , computer vision , pattern recognition (psychology) , deep learning , feature (linguistics) , face (sociological concept) , facial motion capture , feature extraction , facial recognition system , face detection , social science , biochemistry , chemistry , linguistics , philosophy , sociology , gene
Facial expressions of laboratory mice provide important information for pain assessment to explore the effect of drugs being developed for medical purposes. For automatic pain assessment, a mouse face tracker is needed to extract the face regions in videos recorded in pain experiments. However, since the body and face of mice are the same colour and mice move fast, tracking their face is a challenging task. In recent years, with their ability to learn from data, deep learning provides effective solutions for a wide variety of problems. In particular, convolutional neural networks (CNNs) are very successful in computer vision tasks. In this study, a CNN based tracker network called MFTN is proposed for mouse face tracking. CNNs are good at extracting hierarchical features from the training dataset. High‐level features contain semantic features and low‐level features have high spatial resolution. In the proposed MFTN architecture, target information is extracted from a combination of low‐ and high‐level features by a sub‐network, namely the Feature Adaptation Network (FAN), to achieve a robust and accurate tracker. Among the MFTN versions, the MFTN/c tracker achieved an accuracy of 0.8, robustness of 0.67, and a throughput of 213 fps on a workstation with GPU.