English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Tools annual

Global: Zendy Free Plan

Global: Zendy Tools monthly

Global: Zendy Plus monthly

One of the major challenges of machine translation (MT) is ambiguity, whichcan in some cases be resolved by accompanying context such as images. However,recent work in multimodal MT (MMT) has shown that obtaining improvements fromimages is challenging, limited not only by the difficulty of building effectivecross-modal representations, but also by the lack of specific evaluation andtraining data. We present a new MMT approach based on a strong text-only MTmodel, which uses neural adapters, a novel guided self-attention mechanism andwhich is jointly trained on both visually-conditioned masking and MMT. We alsointroduce CoMMuTE, a Contrastive Multilingual Multimodal Translation Evaluationset of ambiguous sentences and their possible translations, accompanied bydisambiguating images corresponding to each translation. Our approach obtainscompetitive results compared to strong text-only models on standardEnglish-to-French, English-to-German and English-to-Czech benchmarks andoutperforms baselines and state-of-the-art MMT systems by a large margin on ourcontrastive test set. Our code and CoMMuTE are freely available.

Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation