Open AccessSynthesis of 3D pronunciation trajectories of lips in Mandarin Based on HMM model
Author(s) -
Yuanzhi Ye,
Xiangzhen He,
Yihao Zhang,
Yerong Hu,
Jia Zeng
Publication year - 2020
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/1693/1/012185
Subject(s) - pronunciation , mandarin chinese , computer science , animation , trajectory , hidden markov model , speech recognition , artificial intelligence , computer animation , natural language processing , linguistics , computer graphics (images) , philosophy , physics , astronomy
In the era of information technology, human-computer interaction tendings to be multi-modal, and lip animation simulation driven by pronunciation actions has attracted more and more attention. Starting from Mandarin Chinese, this paper establishins a model of the trajectory of the lips during the pronunciation process. The model is based on a motion capture technology, proposes a database collection a processing method, extracts acoustic parameters and text information to establish an HMM prediction model of pronunciation action parameters, and synthesizes the pronunciation movement trajectory, and the average percentage error with the real trajectory is less than 3.42%. The results show that the predicted pronunciation action parameters can effectively synthesize the lip pronunciation movement trajectory, and the use of lip animation can enhance language understanding.