English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Tools annual

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Tools monthly

Global: Zendy Plus monthly

Presents the access of premium content as premium feature

Premium Content

Global: Zendy Plus annual

Global: Zendy Free Plan

Learning a mapping between two unrelated domains-such as image and audio,without any supervision is a challenging task. In this work, we propose adistance-preserving generative adversarial model to translate images of humanfaces into an audio domain. The audio domain is defined by a collection ofmusical note sounds recorded by 10 different instrument families (NSynth\cite{nsynth2017}) and a distance metric where the instrument family classinformation is incorporated together with a mel-frequency cepstral coefficients(MFCCs) feature. To enforce distance-preservation, a loss term that penalizesdifference between pairwise distances of the faces and the translated audiosamples is used. Further, we discover that the distance preservation constraintin the generative adversarial model leads to reduced diversity in thetranslated audio samples, and propose the use of an auxiliary discriminator toenhance the diversity of the translations while using the distance preservationconstraint. We also provide a visual demonstration of the results and numericalanalysis of the fidelity of the translations. A video demo of our proposedmodel's learned translation is available inhttps://www.dropbox.com/s/the176w9obq8465/face_to_musical_note.mov?dl=0.

Face-to-Music Translation Using a Distance-Preserving Generative Adversarial Network with an Auxiliary Discriminator