Open AccessImproving Phoneme to Viseme Mapping for Indonesian Language
Author(s) -
Anung Rachman,
Risanuri Hidayat,
Hanung Adi Nugroho
Publication year - 2020
Publication title -
ijitee (international journal of information technology and electrical engineering)
Language(s) - English
Resource type - Journals
ISSN - 2550-0554
DOI - 10.22146/ijitee.47577
Subject(s) - viseme , computer science , cluster analysis , vowel , speech recognition , artificial intelligence , correctness , feature (linguistics) , pattern recognition (psychology) , natural language processing , speech processing , linguistics , philosophy , speech technology , programming language
The lip synchronization technology of animation can run automatically through the phoneme-to-viseme map. Since the complexity of facial muscles causes the shape of the mouth to vary greatly, phoneme-to-viseme mapping always has challenging problems. One of them is the allophone vowel problem. The resemblance makes many researchers clustering them into one class. This paper discusses the certainty of allophone vowels as a variable of the phoneme-to-viseme map. Vowel allophones pre-processing as a proposed method is carried out through formant frequency feature extraction methods and then compared by t-test to find out the significance of the difference. The results of pre-processing are then used to reference the initial data when building phoneme-to-viseme maps. This research was conducted on maps and allophones of the Indonesian language. Maps that have been built are then compared with other maps using the HMM method in the value of word correctness and accuracy. The results show that viseme mapping preceded by allophonic pre-processing makes map performance more accurate when compared to other maps.