Open AccessEx Situ Transfer of Bayesian Neural Networks to Resistive Memory‐Based Inference Hardware
Author(s) -
Dalgaty Thomas,
Esmanhotto Eduardo,
Castellani Niccolo,
Querlioz Damien,
Vianello Elisa
Publication year - 2021
Publication title -
advanced intelligent systems
Language(s) - English
Resource type - Journals
ISSN - 2640-4567
DOI - 10.1002/aisy.202000103
Subject(s) - computer science , resistive touchscreen , resistive random access memory , artificial neural network , inference , bayesian network , artificial intelligence , bayesian inference , bayesian probability , machine learning , computer hardware , engineering , electrical engineering , computer vision , voltage
Neural networks cannot typically be trained locally in edge‐computing systems due to severe energy constraints. It has, therefore, become commonplace to train them “ex situ” and transfer the resulting model to a dedicated inference hardware. Resistive memory arrays are of particular interest for realizing such inference hardware, because they offer an extremely low‐power implementation of the dot‐product operation. However, the transfer of high‐precision software parameters to the imprecise and random conductance states of resistive memories poses significant challenges. Here, it is proposed that Bayesian neural networks can be more suitable for model transfer, because, such as device conductance states, their parameters are described by random variables. The ex situ training of a Bayesian neural network is performed, and then, the resulting software model is transferred in a single programming step to an array of 16 384 resistive memory devices. On an illustrative classification task, it is observed that the transferred decision boundaries and the prediction uncertainties of the software model are well preserved. This work demonstrates that resistive memory‐based Bayesian neural networks are a promising direction in the development of resistive memory compatible edge inference hardware.