English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Tools annual

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Tools monthly

Global: Zendy Plus monthly

Presents the access of premium content as premium feature

Premium Content

Global: Zendy Plus annual

Global: Zendy Free Plan

Executing contact-rich manipulation tasks necessitates the fusion of tactileand visual feedback. However, the distinct nature of these modalities posessignificant challenges. In this paper, we introduce a system that leveragesvisual and tactile sensory inputs to enable dexterous in-hand manipulation.Specifically, we propose Robot Synesthesia, a novel point cloud-based tactilerepresentation inspired by human tactile-visual synesthesia. This approachallows for the simultaneous and seamless integration of both sensory inputs,offering richer spatial information and facilitating better reasoning aboutrobot actions. The method, trained in a simulated environment and then deployedto a real robot, is applicable to various in-hand object rotation tasks.Comprehensive ablations are performed on how the integration of vision andtouch can improve reinforcement learning and Sim2Real performance. Our projectpage is available at https://yingyuan0414.github.io/visuotactile/ .

Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing