Open AccessIssues of Dialectal Saudi Twitter Corpus
Author(s) -
Meshrif Alruily
Publication year - 2019
Publication title -
the international arab journal of information technology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.227
H-Index - 27
eISSN - 2309-4524
pISSN - 1683-3198
DOI - 10.34028/iajit/17/3/10
Subject(s) - computer science , spelling , natural language processing , artificial intelligence , arabic , concatenation (mathematics) , transliteration , linguistics , philosophy , mathematics , combinatorics
Text mining research relies heavily on the availability of a suitable corpus. This paper presents a dialectal Saudi corpus that contains 207452 tweets generated by Saudi Twitter users. In addition, a comparison between the Saudi tweets dataset, Egyptian Twitter corpus and Arabic top news raw corpus (representing Modern Standard Arabic (MSA) in various aspects, such as the differences between formal and colloquial texts was carried out. Moreover, investigation into the issues and phenomena, such as shortening, concatenation, colloquial language, compounding, foreign language, spelling errors and neologisms on this type of dataset was performed.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom