Premium
Language comprehension as a multi‐label classification problem
Author(s) -
Sering Konstantin,
Milin Petar,
Baayen R. Harald
Publication year - 2018
Publication title -
statistica neerlandica
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.52
H-Index - 39
eISSN - 1467-9574
pISSN - 0039-0402
DOI - 10.1111/stan.12134
Subject(s) - computer science , comprehension , lexicon , utterance , discriminative model , artificial intelligence , natural language processing , linguistics , philosophy , programming language
The initial stage of language comprehension is a multilabel classification problem. Listeners or readers, presented with an utterance, need to discriminate between the intended words and the tens of thousands of other words they know. We propose to address this problem by pairing two networks. The first network is independently learned with the Rescorla Wagner model. The second network is based on the first network and learned with the rule of Widrow and Hoff. The first network has to recover from sublexical input features the meanings encoded in the language signal, resulting in a vector of activations over the lexicon. The second network takes this vector as input and further reduces uncertainty about the intended message. Classification performance for a lexicon with 52,000 entries is good. The model also correctly predicts several aspects of human language comprehension. By rejecting the traditional linguistic assumption that language is a (de)compositional system, and by instead espousing a discriminative approach, a more parsimonious yet highly effective functional characterization of the initial stage of language comprehension is obtained.