English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

This work presents our advancements in controlling an articulatory speechsynthesis engine, \textit{viz.}, Pink Trombone, with hand gestures. Ourinterface translates continuous finger movements and wrist flexion intocontinuous speech using vocal tract area-function based articulatory speechsynthesis. We use Cyberglove II with 18 sensors to capture the kinematicinformation of the wrist and the individual fingers, in order to control avirtual tongue. The coordinates and the bending values of the sensors are thenutilized to fit a spline tongue model that smoothens out the noisy values andoutliers. Considering the upper palate as fixed and the spline model as thedynamically moving lower surface (tongue) of the vocal tract, we compute 1Darea functional values that are fed to the Pink Trombone, generating continuousspeech sounds. Therefore, by learning to manipulate one's wrist and fingers,one can learn to produce speech sounds just through one's hands, without theneed for using the vocal tract.

SPEAK WITH YOUR HANDS Using Continuous Hand Gestures to control Articulatory Speech Synthesizer