English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

Sight and hearing are two senses that play a vital role in humancommunication and scene understanding. To mimic human perception ability,audio-visual learning, aimed at developing computational approaches to learnfrom both audio and visual modalities, has been a flourishing field in recentyears. A comprehensive survey that can systematically organize and analyzestudies of the audio-visual field is expected. Starting from the analysis ofaudio-visual cognition foundations, we introduce several key findings that haveinspired our computational studies. Then, we systematically review the recentaudio-visual learning studies and divide them into three categories:audio-visual boosting, cross-modal perception and audio-visual collaboration.Through our analysis, we discover that, the consistency of audio-visual dataacross semantic, spatial and temporal support the above studies. To revisit thecurrent development of the audio-visual learning field from a more macro view,we further propose a new perspective on audio-visual scene understanding, thendiscuss and analyze the feasible future direction of the audio-visual learningarea. Overall, this survey reviews and outlooks the current audio-visuallearning field from different aspects. We hope it can provide researchers witha better understanding of this area. A website including constantly-updatedsurvey is released: \url{https://gewu-lab.github.io/audio-visual-learning/}.

Learning in Audio-visual Context: A Review, Analysis, and New Perspective