arrow
返回

Stacking-Based Deep Neural Network: Deep Analytic Network for Pattern Classification

delete2020-12-01
delete24
delete
OA
AI
C
Cheng-Yaw Low
J
Jaewoo Park
A
Andrew Beng Jin Teoh *
DOI:10.1109/TCYB.2019.2908387delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Stacking-based deep neural network (S-DNN) is aggregated with pluralities of basic learning modules, one after another, to synthesize a deep neural network (DNN) alternative for pattern classification. Contrary to the DNNs trained from end to end by backpropagation (BP), each S-DNN layer, that is, a self-learnable module, is to be trained decisively and independently without BP intervention. In this paper, a ridge regression-based S-DNN, dubbed deep analytic network (DAN), along with its kernelization (K-DAN), are devised for multilayer feature relearning from the pre-extracted baseline features and the structured features. Our theoretical formulation demonstrates that DAN/K-DAN relearn by perturbing the intra/interclass variations, apart from diminishing the prediction errors. We scrutinize the DAN/K-DAN performance for pattern classification on datasets of varying domains-faces, handwritten digits, generic objects, to name a few. Unlike the typical BP-optimized DNNs to be trained from gigantic datasets by GPU, we reveal that DAN/K-DAN are trainable using only CPU even for small-scale training sets. Our experimental results show that DAN/K-DAN outperform the present S-DNNs and also the BP-trained DNNs, including multiplayer perceptron, deep belief network, etc., without data augmentation applied.
Keyword:
Kernel
Training
Neural networks
Graphics processing units
Principal component analysis
Convolution
Cybernetics
Deep analytic network (DAN)
face recognition
object recognition
pattern classification
stacking-based deep neural network (S-DNN)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

Y
Yonsei University
学者数:
4.8W
论文数: 4.6W
被引数: 5.2W
引用论文

引用论文

Phase matters for aerosols
err2010-10-13
err0
errOAAI
errPaul J. Ziemann
err分享
err收藏
PEMFC Reconfigured Anodes for Enhancing CO Tolerance with Air Bleed
err2004-01-01
err0
errOAAI
errFrancisco A. Uribe; Judith A. Valerio; Fernando H. Garzon; Thomas A. Zawodzinski
err分享
err收藏
In situ Seamless Magnetic Measurements for Solid‐State Electrochemical Processes in Prussian Blue Analogues
err2013-04-25
err0
PREAI
errTetsuya Yamada; Kantaro Morita; Heng Wang; Keita Kume; Hirofumi Yoshikawa; Kunio Awaga
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容