arrow
返回

Marginal Deep Architecture: Stacking Feature Learning Modules to Build Deep Learning Models

delete2019-01-01
delete16
delete
OA
AI
G
Guoqiang Zhong *
K
Kang Zhang
H
Hongxu Wei
郑煜辰 封面图
郑煜辰 (Yuchen Zheng)
J
Junyu Dong
DOI:10.1109/ACCESS.2019.2902631delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Recently, many deep models have been proposed in different fields, such as image classification, object detection, and speech recognition. However, most of these architectures require a large amount of training data and employ random initialization. In this paper, we propose to stack feature learning modules for the design of deep architectures. Specifically, marginal Fisher analysis (MFA) is stacked layer-by-layer for the initialization and we call the constructed deep architecture marginal deep architecture (MDA). When implementing the MDA, the weight matrices of MFA are updated layer-by-layer, which is a supervised pre-training method and does not need a large scale of data. In addition, several deep learning techniques are applied to this architecture, such as backpropagation, dropout, and denoising, to fine-tune the model. We have compared MDA with some feature learning and deep learning models on several practical applications, such as handwritten digits recognition, speech recognition, historical document understanding, and action recognition. The extensive experiments show that the performance of MDA is better than not only shallow feature learning models but also related deep learning models in these tasks.
Keyword:
Deep architectures
feature learning
marginal Fisher analysis
marginal deep architecture
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

O
ocean university of china
学者数:
3.1W
论文数: 2.0W
被引数: 21
K
Kyushu University
学者数:
3.2W
论文数: 2.6W
被引数: 2.8W
引用论文

引用论文

Laser-directed energy deposition of Ni-based superalloys with a high content of γ'-phase using induction heating
err2023-12-01
err0
PREAI
errAnastasiia Dmitrieva; Dmitrii Mukin; Ilya Sorokin; Stanislav Stankevich; Olga Klimova-Korsmik
err分享
err收藏
Deep Neural Network Initialization With Decision Trees
err2019-05-01
err104
errOAAI
errHumbird, Kelli D.; Peterson, J. Luc; McClarren, Ryan G.
err分享
err收藏
学者 查看更多内容