Development of Optical Communication Marks for Mobile Robots to Recognize Their Environment and to Handle Objects

In an environment in which robots and human beings coexist it is di cult for a mobile manipulator to grasp an object autonomously Generally the most di cult aspect of realizing such action is object recognition Such an environment includes many of irregular shapes and sizes because of unknown distance from sensors to each object and blocking of vision sensors Object s abstraction and recognition thus remains far from practical use of current sensing technology To solve the recognition problem we developed marks recognized through optical communication rather than attempting to improve sensing technology Marks using light emitting diodes LEDs have the advantages of being visible as far as they remain in sight having the properties of the target correctly using digital signals and localizing the mark position using stereovision Once the marks are attached to several movable objects a robot can nd a location of a target object easily by communicating with the mark attached to the target object Also if the marks are located at known positions such as walls a mobile robot can localize itself by detecting such marks In this research we developed an Intelligent Mark System IMS between a robot and marks which uses visible and infrared LEDs for communication Using this system we performed object grasping tasks the target is a small can with IMS using a mobile manipulator localizing a mobile robot using IMS on several walls and recognizing large objects desks In this paper we explain an overview of communication between marks and robots and we discuss task performance results for an autonomous mobile manipulator using IMS in a real environment Also we report the feasibility and limitations of our proposal