Image-Based Visual Servoing for Robotic Systems: A Nonlinear Lyapunov-Based Control Approach

The objective of this project is to enable current and future EM robots with an increased ability to perceive and interact with unstructured and unknown environments through the use of camera-based visual servo controllers. The scientific goals of this research are to develop a new visual servo control methodology that: (1) adapts for the unknown camera calibration parameters (e.g., focal length, scaling factors, camera position, and orientation) and the physical parameters of the robotic system (e.g., mass, inertia, friction), (2) compensates for unknown depth information (extract 3D information from the 2D image), and (3) enables multi-uncalibrated cameras to be used as a means to provide a larger field-of-view. Nonlinear Lyapunov-based techniques in conjunction with results from projective geometry are being used to overcome the complex control issues and alleviate many of the restrictive assumptions that impact current visual servo controlled robotic systems. The potential relevance of this control methodology will be a plug-and-play visual servoing control module that can be utilized in conjunction with current technology such as feature extraction and recognition, to enable current EM robotic systems with the capabilities of increased accuracy, autonomy, and robustness, with a larger field of view (and hence a larger workspace). These capabilities will enable EM robots to significantly accelerate D&D operations by providing for improved robot autonomy and increased worker productivity, while also reducing the associated costs, removing the human operator from the hazardous environments, and reducing the burden and skill of the human operators