Open AccessAnalysis of Neural Network Based Language Modeling
Author(s) -
Karrupusamy P.
Publication year - 2020
Publication title -
journal of artificial intelligence and copsule networks
Language(s) - English
Resource type - Journals
ISSN - 2582-2012
DOI - 10.36548/jaicn.2020.3.006
Subject(s) - perplexity , computer science , natural language processing , artificial intelligence , language model , artificial neural network , machine translation , cache language model , natural language , computational linguistics , benchmark (surveying) , universal networking language , comprehension approach , geodesy , geography
The fundamental and core process of the natural language processing is the language modelling usually referred as the statistical language modelling. The language modelling is also considered to be vital in the processing the natural languages as the other chores such as the completion of sentences, recognition of speech automatically, translations of the statistical machines, and generation of text and so on. The success of the viable natural language processing totally relies on the quality of the modelling of the language. In the previous spans the research field such as the linguistics, psychology, speech recognition, data compression, neuroscience, machine translation etc. As the neural network are the very good choices for having a quality language modelling the paper presents the analysis of neural networks in the modelling of the language. Utilizing some of the dataset such as the Penn Tree bank, Billion Word Benchmark and the Wiki Test the neural network models are evaluated on the basis of the word error rate, perplexity and the bilingual evaluation under study scores to identify the optimal model.