Open AccessA dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgetting
Author(s) -
Wang Meng,
Guo Zhengbing,
Li Huafeng
Publication year - 2022
Publication title -
iet computer vision
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.38
H-Index - 37
eISSN - 1751-9640
pISSN - 1751-9632
DOI - 10.1049/cvi2.12068
Subject(s) - forgetting , computer science , bottleneck , routing (electronic design automation) , cluster analysis , artificial intelligence , task (project management) , adaptive routing , feature (linguistics) , salient , pattern recognition (psychology) , machine learning , static routing , routing protocol , engineering , computer network , philosophy , linguistics , systems engineering , embedded system
In continual learning, previously learnt knowledge tends to be overlapped by the subsequent training tasks. This bottleneck, known as catastrophic forgetting, has recently been relieved between vision tasks involving pixel shuffles etc. Nevertheless, the challenge lies in the continuous classification of the sequential sets discriminated by global transformations, such as excessively spatial rotations. Aim at this, a novel strategy of dynamic memory routing is proposed to dominate the forward paths of capsule network (CapsNet) according to the current input sets. To recall previous knowledge, a binary routing table is maintained among these sequential tasks. Then, an increment procedure of competitive prototype clustering is integrated to update the routing of the current task. Moreover, a sparsity measurement is employed to decouple the salient routing among the different learnt tasks. The experimental results demonstrate the superiority of the proposed memory network over the state–of–the–art approaches by the recalling evaluations on extended sets of Cifar–100, CelebA and Tiny ImageNet etc.