Open AccessEnergy‐Efficient Memristive Euclidean Distance Engine for Brain‐Inspired Competitive Learning
Author(s) -
Zhou Houji,
Chen Jia,
Wang Yinan,
Liu Sen,
Li Yi,
Li Qingjiang,
Liu Qi,
Wang Zhongrui,
He Yuhui,
Xu Hui,
Miao Xiangshui
Publication year - 2021
Publication title -
advanced intelligent systems
Language(s) - English
Resource type - Journals
ISSN - 2640-4567
DOI - 10.1002/aisy.202100114
Subject(s) - computer science , range (aeronautics) , deep learning , artificial neural network , euclidean distance , computer engineering , energy (signal processing) , artificial intelligence , engineering , mathematics , statistics , aerospace engineering
Inspired by competitive rules of the nature, competitive learning contributes to the specialization of the human brain and the general creativity of mankind. However, the construction of hardware competitive learning neural network still faces great challenges due to the lack of an accurate distance computation method and a self‐adaptive in situ training scheme. Herein, a fully memristive Euclidean distance (ED) engine based on analog multiply‐accumulate operation in a 32 × 32 TiN/TaO x /HfO x /TiN 1T1R array is demonstrated. The dual‐layer devices perform multilevel modulation under the target‐aware programming method with excellent read linearity in a dynamic range of 10–100 μS. The ED calculation is verified experimentally on a test board with an O (1) temporal complexity. Furthermore, in situ training and offline inference schemes for competitive learning, based on the ED engine, are developed and the simulated results show comparable success rates with those obtained by the CPU‐based software. Compared with a state‐of‐the‐art RTX6000 GPU (0.5 TOPS W −1 ), the energy efficiency of competitive learning models on ED engines can yield 100× improvements by utilizing optimized memristive devices.