Premium
A Robust Multi‐View System for High‐Fidelity Human Body Shape Reconstruction
Author(s) -
Zhang Qitong,
Wang Lei,
Ge Linlin,
Luo Shan,
Zhu Taihao,
Jiang Feng,
Ding Jimmy,
Feng Jieqing
Publication year - 2021
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.14354
Subject(s) - computer vision , artificial intelligence , computer science , robustness (evolution) , 3d reconstruction , point cloud , calibration , human body , body shape , camera resectioning , fidelity , mathematics , biochemistry , telecommunications , chemistry , statistics , gene
This paper proposes a passive multi‐view system for human body shape reconstruction, namely RHF‐Human, to overcome several challenges including accurate calibration and stereo matching in self‐occluded and low‐texture skin regions. The reconstruction process includes four steps: capture, multi‐view camera calibration, dense reconstruction, and meshing. The capture system, which consists of 90 digital single‐lens reflex cameras, is single‐shot to avoid nonrigid deformation of the human body. Two technical contributions are made: (1) a two‐step robust multi‐view calibration approach that improves calibration accuracy and saves calibration time for each new human body acquired and (2) an accurate PatchMatch multi‐view stereo method for dense reconstruction to perform correct matching in self‐occluded and low‐texture skin regions and to reduce the noise caused by body hair. Experiments on models of various genders, poses, and skin with different amounts of body hair show the robustness of the proposed system. A high‐fidelity human body shape dataset with 227 models is constructed, and the average accuracy is within 1.5 mm. The system provides a new scheme for the accurate reconstruction of nonrigid human models based on passive vision and has good potential in fashion design and health care.