Premium
Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks
Author(s) -
Jacobs Robert A.,
Jordan Michael I.,
Barto Andrew G.
Publication year - 1991
Publication title -
cognitive science
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.498
H-Index - 114
eISSN - 1551-6709
pISSN - 0364-0213
DOI - 10.1207/s15516709cog1502_2
Subject(s) - connectionism , computer science , modular design , architecture , task (project management) , functional decomposition , decomposition , function (biology) , modularity (biology) , artificial intelligence , domain (mathematical analysis) , partition (number theory) , computer architecture , artificial neural network , machine learning , programming language , engineering , mathematics , art , ecology , genetics , systems engineering , visual arts , biology , mathematical analysis , combinatorics , evolutionary biology
A novel modular connectionist architecture is presented in which the networks composing the architecture compete to learn the training patterns. An outcome of the competition is that different networks learn different training patterns and, thus, learn to compute different functions. The architecture performs task decomposition in the sense that it learns to partition a task into two or more functionally independent tasks and allocates distinct networks to learn each task. In addition, the architecture tends to allocate to each task the network whose topology is most appropriate to that task. The architecture's performance on “what” and “where” vision tasks is presented and compared with the performance of two multilayer networks. Finally, it is noted that function decomposition is an underconstrained problem, and, thus, different modular architectures may decompose a function in different ways. A desirable decomposition can be achieved if the architecture is suitably restricted in the types of functions that it can compute. Finding appropriate restrictions is possible through the application of domain knowledge. A strength of the modular architecture is that its structure is well suited for incorporating domain knowledge.