Open AccessNatural Language Identification using Corpus-Based Models
Author(s) -
Clive Souter
Publication year - 2017
Publication title -
hermes
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.759
H-Index - 7
eISSN - 1903-1785
pISSN - 0904-1699
DOI - 10.7146/hjlcb.v7i13.25083
Subject(s) - german , portuguese , natural language processing , computer science , identification (biology) , irish , linguistics , task (project management) , artificial intelligence , set (abstract data type) , language identification , natural language , corpus linguistics , natural (archaeology) , history , engineering , programming language , philosophy , botany , systems engineering , archaeology , biology
This paper describes three approaches to the task of automatically identifying the language a text is written in. We conducted experiments to compare the success of each approach in identifying languages from a set of texts in Dutch/Friesian, English, French, Gaelic (Irish), German, Italian, Portuguese, Serbo-Croat and Spanish