English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

We construct the first markerless deformable interaction dataset recordinginteractive motions of the hands and deformable objects, called HMDO (HandManipulation with Deformable Objects). With our built multi-view capturesystem, it captures the deformable interactions with multiple perspectives,various object shapes, and diverse interactive forms. Our motivation is thecurrent lack of hand and deformable object interaction datasets, as 3D hand anddeformable object reconstruction is challenging. Mainly due to mutualocclusion, the interaction area is difficult to observe, the visual featuresbetween the hand and the object are entangled, and the reconstruction of theinteraction area deformation is difficult. To tackle this challenge, we proposea method to annotate our captured data. Our key idea is to collaborate withestimated hand features to guide the object global pose estimation, and thenoptimize the deformation process of the object by analyzing the relationshipbetween the hand and the object. Through comprehensive evaluation, the proposedmethod can reconstruct interactive motions of hands and deformable objects withhigh quality. HMDO currently consists of 21600 frames over 12 sequences. In thefuture, this dataset could boost the research of learning-based reconstructionof deformable interaction scenes.

HMDO: Markerless Multi-view Hand Manipulation Capture with Deformable Objects