z-logo
open-access-imgOpen Access
Vision-based Proximity and Tactile Sensing for Robot Arms: Design, Perception, and Control
Author(s) -
Quan Khanh Luu,
Dinh Quang Nguyen,
Nhan Huu Nguyen,
Nam Phuong Dam,
Van Anh Ho
Publication year - 2025
Publication title -
ieee transactions on robotics
Language(s) - English
Resource type - Magazines
SCImago Journal Rank - 2.027
H-Index - 159
eISSN - 1941-0468
pISSN - 1552-3098
DOI - 10.1109/tro.2025.3593087
Subject(s) - robotics and control systems , computing and processing , components, circuits, devices and systems
Soft-bodied robots with multimodal sensing capabilities hold promise for versatile and user-friendly robotics. However, seamlessly integrating multiple sensing functionalities into soft artificial skins remains a challenge due to compatibility issues between soft materials and conventional electronics. While vision-based tactile sensing has enabled simple and effective sensor designs for robotic touch, there has been limited exploration of this technique for intrinsic multimodal sensing in large-sized soft robot bodies. To address this gap, this paper introduces a novel vision-based soft sensing technique, named ProTac, capable of operating either in tactile or proximity sensing modes. This vision-based sensing technology relies on a soft functional skin that can actively switch its optical properties between opaque and transparent states. Furthermore, the paper develops efficient learning pipelines for proximity and tactile perceptions, as well as sensing strategies enabled through the timing activation of the two sensing modes. The effectiveness of the soft sensing technology is demonstrated through a soft ProTac link, which can be integrated into newly constructed or existing commercial robot arms. Results suggest that robots integrated with the ProTac link, along with rigorous control formulation can perform safe and purposeful control actions, which enhances human-robot interaction scenarios and facilitates motion control tasks that are challenging to achieve with conventional rigid links. Supplementary video: https://youtu.be/dFgZLUpeWw4 Project website: https://quan-luu.github.io/protac-website/

The content you want is available to Zendy users.

Already have an account? Click here to sign in.
Having issues? You can contact us here
Accelerating Research

Address

John Eccles House
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom