arrow
返回

A structure optimization framework for feed-forward neural networks using sparse representation

delete2016-10-01
delete16
PRE
AI
杨杰 (Jie Yang)
J
Jun Ma *
DOI:10.1016/j.knosys.2016.06.026delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Traditionally, optimizing the structure of a feed-forward neural-network is time-consuming and it needs to balance the trade-off between the network size and network performance. In this paper, a sparse representation based framework, termed SRS, is introduced to generate a small-sized network structure without compromising the network performance. Based on the forward selection strategy, the SRS framework selects significant elements (weights or hidden neurons) from the initial network that minimize the residual output error. The main advantage of the SRS framework is that it is able to optimize the network structure and training performance simultaneously. As a result, the training error is reduced while the number of selected elements increases. The efficiency and robustness of the SRS framework are evaluated based on several benchmark datasets. Experimental results indicate that the SRS framework performs favourably compared to alternative structure optimization algorithms. (C) 2016 Elsevier B.V. All rights reserved.
Keyword:
Neural networks
Structure optimization
Sparse representation
Network pruning
Network construction
Single measurement vector
Multiple measurement vector
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.2W
被引数:
4.5W

机构

U
University of Wollongong
学者数:
1.3W
论文数: 1.6W
被引数: 2.8W
引用论文

引用论文

Detecting the Misfire of Motorcycle Engine with Wide Band Oxygen Sensor
err
IF0
err2013-10-01
err0
PREAI
errYameogo Amadou; Chang-Tai Wu; Yu-Cheng Jiang; Jau-Huai Lu
err分享
err收藏
err分享
err收藏
Effect of homopolymer in polymerization-induced microphase separation process均聚物在聚合诱导微相分离过程中的作用
err2017-09-01
err0
errOAAI
errJongmin Park; Stacey A. Saba; Marc A. Hillmyer; Dong-Chang Kang; Myungeun Seo
err分享
err收藏
Extreme learning machine: Theory and applications极限学习机: 理论与应用
err2006-12-01
err1.1W
PREAI
errHuang, Guang-Bin; Zhu, Qin-Yu; Siew, Chee-Kheong
err分享
err收藏
High-temperature Adhesion Promoter Based on (3-Glycidoxypropyl) Trimethoxysilane for Cu Paste
err2014-10-20
err0
errOAAI
errJianwei Jiang; Yong Hwan Koo; Hye Won Kim; Ji Hyun Park; Hyun Suk Kang; Byung Cheol Lee; Sang-Ho Kim; Hee-Eun Song; Longhai Piao
err分享
err收藏
学者 查看更多内容