English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Tools annual

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Tools monthly

Global: Zendy Plus monthly

Presents the access of premium content as premium feature

Premium Content

Global: Zendy Plus annual

Global: Zendy Free Plan

While 3D human body modeling has received much attention in computer vision,modeling the acoustic equivalent, i.e. modeling 3D spatial audio produced bybody motion and speech, has fallen short in the community. To close this gap,we present a model that can generate accurate 3D spatial audio for full humanbodies. The system consumes, as input, audio signals from headset microphonesand body pose, and produces, as output, a 3D sound field surrounding thetransmitter's body, from which spatial audio can be rendered at any arbitraryposition in the 3D space. We collect a first-of-its-kind multimodal dataset ofhuman bodies, recorded with multiple cameras and a spherical array of 345microphones. In an empirical evaluation, we demonstrate that our model canproduce accurate body-induced sound fields when trained with a suitable loss.Dataset and code are available online.

Sounding Bodies: Modeling 3D Spatial Sound of Humans Using Body Pose and Audio