Premium
A method of generating translations of unseen n‐grams by using proportional analogy
Author(s) -
Luo Juan,
Lepage Yves
Publication year - 2016
Publication title -
ieej transactions on electrical and electronic engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.254
H-Index - 30
eISSN - 1931-4981
pISSN - 1931-4973
DOI - 10.1002/tee.22221
Subject(s) - analogy , phrase , machine translation , computer science , artificial intelligence , translation (biology) , natural language processing , example based machine translation , word (group theory) , statistical model , machine translation system , machine learning , mathematics , linguistics , philosophy , biochemistry , chemistry , geometry , messenger rna , gene
In recent years, statistical machine translation has gained much attention. The phrase‐based statistical machine translation model has made significant advancement in translation quality over the word‐based model. In this paper, we attempt to apply the technique of proportional analogy to statistical machine translation systems. We propose a novel approach to apply proportional analogy to generate translations of unseen n‐grams from the phrase table for phrase‐based statistical machine translation. Experiments are conducted with two datasets of different sizes. We also investigate two methods to integrate n‐grams translations produced by proportional analogy into the state‐of‐the‐art statistical machine translation system, Moses. 1 The experimental results show that unseen n‐grams translations generated using the technique of proportional analogy are rewarding for statistical machine translation systems with small datasets. © 2016 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.