ToFU: Topology functional units for deep learning
Author(s) -
Christopher Oballe,
David L. Boothe,
Piotr J. Franaszczuk,
Vasileios Maroulas
Publication year - 2021
Publication title -
foundations of data science
Language(s) - English
Resource type - Journals
ISSN - 2639-8001
DOI - 10.3934/fods.2021021
Subject(s) - autoencoder , leverage (statistics) , computer science , artificial intelligence , fidelity , autoregressive model , topology (electrical circuits) , function (biology) , pattern recognition (psychology) , high fidelity , artificial neural network , space (punctuation) , machine learning , mathematics , telecommunications , combinatorics , evolutionary biology , electrical engineering , econometrics , biology , engineering , operating system
We propose ToFU, a new trainable neural network unit with a persistence diagram dissimilarity function as its activation. Since persistence diagrams are topological summaries of structures, this new activation measures and learns the topology of data to leverage it in machine learning tasks. We showcase the utility of ToFU in two experiments: one involving the classification of discrete-time autoregressive signals, and another involving a variational autoencoder. In the former, ToFU yields competitive results with networks that use spectral features while outperforming CNN architectures. In the latter, ToFU produces topologically-interpretable latent space representations of inputs without sacrificing reconstruction fidelity.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom