Premium
An Overview of Some Issues in the Theory of Deep Networks
Author(s) -
Poggio Tomaso,
Banburski Andrzej
Publication year - 2020
Publication title -
ieej transactions on electrical and electronic engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.254
H-Index - 30
eISSN - 1931-4981
pISSN - 1931-4973
DOI - 10.1002/tee.23243
Subject(s) - stability (learning theory) , computer science , deep learning , artificial intelligence , management science , operations research , data science , industrial engineering , machine learning , engineering
During the last few years, significant progress has been made in the theoretical understanding of deep networks. We review our contributions in the areas of approximation theory and optimization. We also introduce a new approach based on cross‐validation leave‐one‐out stability to estimate bounds on the expected error of overparametrized classifiers, such as deep networks. © 2020 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC.