Does Syntax Need to Grow on Trees? Sources of Hierarchical Inductive Bias in Sequence-to-Sequence Networks
Author(s) -
R. Thomas McCoy,
Robert Frank,
Tal Linzen
Publication year - 2020
Publication title -
transactions of the association for computational linguistics
Language(s) - English
Resource type - Journals
ISSN - 2307-387X
DOI - 10.1162/tacl_a_00304
Subject(s) - inductive bias , generalization , computer science , sequence (biology) , syntax , natural language processing , artificial neural network , tree (set theory) , artificial intelligence , tree structure , set (abstract data type) , parsing , machine learning , data structure , programming language , multi task learning , mathematics , mathematical analysis , management , biology , economics , task (project management) , genetics
Learners that are exposed to the same training data might generalize differently due to differing inductive biases. In neural network models, inductive biases could in theory arise from any aspect ...
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom