Open AccessEnergy expenditure estimation using visual and inertial sensors
Author(s) -
Tao Lili,
Burghardt Tilo,
Mirmehdi Majid,
Damen Dima,
Cooper Ashley,
Camplani Massimo,
Hannuna Sion,
Paiement Adeline,
Craddock Ian
Publication year - 2018
Publication title -
iet computer vision
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.38
H-Index - 37
eISSN - 1751-9640
pISSN - 1751-9632
DOI - 10.1049/iet-cvi.2017.0112
Subject(s) - accelerometer , inertial measurement unit , computer science , computer vision , artificial intelligence , inertial frame of reference , wearable computer , sensor fusion , energy expenditure , rgb color model , medicine , physics , quantum mechanics , embedded system , endocrinology , operating system
Deriving a person's energy expenditure accurately forms the foundation for tracking physical activity levels across many health and lifestyle monitoring tasks. In this study, the authors present a method for estimating calorific expenditure from combined visual and accelerometer sensors by way of an RGB‐Depth camera and a wearable inertial sensor. The proposed individual‐independent framework fuses information from both modalities which leads to improved estimates beyond the accuracy of single modality and manual metabolic equivalents of task (MET) lookup table based methods. For evaluation, the authors introduce a new dataset called SPHERE_RGBD + Inertial_calorie , for which visual and inertial data are simultaneously obtained with indirect calorimetry ground truth measurements based on gas exchange. Experiments show that the fusion of visual and inertial data reduces the estimation error by 8 and 18% compared with the use of visual only and inertial sensor only, respectively, and by 33% compared with a MET‐based approach. The authors conclude from their results that the proposed approach is suitable for home monitoring in a controlled environment.