English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

Goal-oriented generative script learning aims to generate subsequent steps toreach a particular goal, which is an essential task to assist robots or humansin performing stereotypical activities. An important aspect of this process isthe ability to capture historical states visually, which provides detailedinformation that is not covered by text and will guide subsequent steps.Therefore, we propose a new task, Multimedia Generative Script Learning, togenerate subsequent steps by tracking historical states in both text and visionmodalities, as well as presenting the first benchmark containing 5,652 tasksand 79,089 multimedia steps. This task is challenging in three aspects: themultimedia challenge of capturing the visual states in images, the inductionchallenge of performing unseen tasks, and the diversity challenge of coveringdifferent information in individual steps. We propose to encode visual statechanges through a selective multimedia encoder to address the multimediachallenge, transfer knowledge from previously observed tasks using aretrieval-augmented decoder to overcome the induction challenge, and furtherpresent distinct information at each step by optimizing a diversity-orientedcontrastive learning objective. We define metrics to evaluate both generationand inductive quality. Experiment results demonstrate that our approachsignificantly outperforms strong baselines.

Multimedia Generative Script Learning for Task Planning