English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

Imagine an interesting multimodal interactive scenario that you can see,hear, and chat with an AI-generated digital character, who is capable ofbehaving like Sheldon from The Big Bang Theory, as a DEEP copy from appearanceto personality. Towards this fantastic multimodal chatting scenario, we proposea novel task, named Deep Personalized Character Creation (DPCC): creatingmultimodal chat personalized characters from multimodal data such as TV shows.Specifically, given a single- or multi-modality input (text, audio, video), thegoal of DPCC is to generate a multi-modality (text, audio, video) response,which should be well-matched the personality of a specific character such asSheldon, and of high quality as well. To support this novel task, we furthercollect a character centric multimodal dialogue dataset, named DeepPersonalized Character Dataset (DPCD), from TV shows. DPCD containscharacter-specific multimodal dialogue data of ~10k utterances and ~6 hours ofaudio/video per character, which is around 10 times larger compared to existingrelated datasets.On DPCD, we present a baseline method for the DPCC task andcreate 5 Deep personalized digital Characters (DeepCharacters) from Big Bang TVShows. We conduct both subjective and objective experiments to evaluate themultimodal response from DeepCharacters in terms of characterization andquality. The results demonstrates that, on our collected DPCD dataset, theproposed baseline can create personalized digital characters for generatingmultimodal response.Our collected DPCD dataset, the code of data collection andour baseline will be published soon.

Hi Sheldon! Creating Deep Personalized Characters from TV Shows