Open AccessEstimation of 3D human hand poses with structured pose prior
Author(s) -
Guo Fangtai,
He Zaixing,
Zhang Shuyou,
Zhao Xinyue
Publication year - 2019
Publication title -
iet computer vision
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.38
H-Index - 37
eISSN - 1751-9640
pISSN - 1751-9632
DOI - 10.1049/iet-cvi.2018.5480
Subject(s) - pose , computer science , artificial intelligence , embedding , key (lock) , 3d pose estimation , grasp , point cloud , construct (python library) , computer vision , articulated body pose estimation , representation (politics) , pattern recognition (psychology) , machine learning , computer security , politics , political science , law , programming language
Here, the authors present multistage estimation model embedding with structured pose prior (SPP), a novel coarse‐to‐fine framework for real‐time 3D hand estimation from single depth image. Authors’ main contributions can be summarised as follows: (i) The authors proposed SPP to enforce constraints of canonical hand pose instead of original hand pose. (ii) The authors are the first to adopt under‐complete stacked denoising auto‐encoder (SDA) to construct pose prior by mapping canonical hand pose to latent representation. In the case of enforcing constraints of canonical hand pose, the authors empirically validate that under‐complete SDA outperforms over‐complete SDA in improving the hand estimation accuracy. (iii) The authors propose candidate keypoints patches (CKP) as intermediate data to conduct further hand pose refinement. Experimental evaluation on two publically available datasets shows that authors’ model is competitive both in accuracy and computation time. Especially, authors’ method placed first in the location of palm key‐point on both two datasets, and the high accuracy of hand palm key‐point plays an important role in many applications, such as that manipulator can grasp objects to specific coordinates with the guiding of human hand palm.