Premium
From shallow feature learning to deep learning: Benefits from the width and depth of deep architectures
Author(s) -
Zhong Guoqiang,
Ling Xiao,
Wang LiNa
Publication year - 2018
Publication title -
wiley interdisciplinary reviews: data mining and knowledge discovery
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.506
H-Index - 47
eISSN - 1942-4795
pISSN - 1942-4787
DOI - 10.1002/widm.1255
Subject(s) - deep learning , artificial intelligence , computer science , feature learning , feature (linguistics) , machine learning , pattern recognition (psychology) , philosophy , linguistics
Since Pearson developed principal component analysis (PCA) in 1901, feature learning (or called representation learning) has been studied for more than 100 years. During this period, many “shallow” feature learning methods have been proposed based on various learning criteria and techniques, until the popular deep learning research in recent years. In this advanced review, we describe the historical profile of the shallow feature learning research and introduce the important developments of the deep learning models. Particularly, we survey the deep architectures with benefits from the optimization of their width and depth, as these models have achieved new records in many applications, such as image classification and object detection. Finally, several interesting directions of deep learning are presented and briefly discussed. This article is categorized under: Technologies > Classification Technologies > Machine Learning Technologies > Computational Intelligence