English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

Speech-driven 3D face animation poses significant challenges due to theintricacy and variability inherent in human facial movements. This paperemphasizes the importance of considering both the composite and regionalnatures of facial movements in speech-driven 3D face animation. The compositenature pertains to how speech-independent factors globally modulatespeech-driven facial movements along the temporal dimension. Meanwhile, theregional nature alludes to the notion that facial movements are not globallycorrelated but are actuated by local musculature along the spatial dimension.It is thus indispensable to incorporate both natures for engendering vividanimation. To address the composite nature, we introduce an adaptive modulationmodule that employs arbitrary facial movements to dynamically adjustspeech-driven facial movements across frames on a global scale. To accommodatethe regional nature, our approach ensures that each constituent of the facialfeatures for every frame focuses on the local spatial movements of 3D faces.Moreover, we present a non-autoregressive backbone for translating audio to 3Dfacial movements, which maintains high-frequency nuances of facial movementsand facilitates efficient inference. Comprehensive experiments and user studiesdemonstrate that our method surpasses contemporary state-of-the-art approachesboth qualitatively and quantitatively.

Speech-Driven 3D Face Animation with Composite and Regional Facial Movements