Open AccessRGB-D, Laser and Thermal Sensor Fusion for People following in a Mobile Robot
Author(s) -
Loreto Susperregi,
José María Martínez-Otzeta,
Ander Ansuategui,
Aitor Ibarguren,
Basilio Sierra
Publication year - 2013
Publication title -
international journal of advanced robotic systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.394
H-Index - 46
eISSN - 1729-8814
pISSN - 1729-8806
DOI - 10.5772/56123
Subject(s) - computer science , computer vision , artificial intelligence , mobile robot , rgb color model , sensor fusion , particle filter , robot , filter (signal processing)
Detecting and tracking people is a key capability for robots that operate in populated environments. In this paper, we used a multiple sensor fusion approach that combines three kinds of sensors in order to detect people using RGB-D vision, lasers and a thermal sensor mounted on a mobile platform. The Kinect sensor offers a rich data set at a significantly low cost, however, there are some limitations to its use in a mobile platform, mainly that the Kinect algorithms for people detection rely on images captured by a static camera. To cope with these limitations, this work is based on the combination of the Kinect and a Hokuyo laser and a thermopile array sensor. A real-time particle filter system merges the information provided by the sensors and calculates the position of the target, using probabilistic leg and thermal patterns, image features and optical flow to this end. Experimental results carried out with a mobile platform in a Science museum have shown that the combination of different sensory cues increases the reliability of the people following system