arrow
返回

Split and merge algorithm for deep learning and its application for additional classes

delete2015-11-01
delete2
PRE
AI
H
Hongsub An
H
Hyeon-Min Shim
S
Sang-il Na
S
Sangmin Lee *
DOI:10.1016/j.patrec.2015.07.024delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we propose a novel split training and merge algorithm for deep learning. The proposed algorithm improves recognition accuracy and suggests a new approach for retraining. The algorithm is motivated by the genetic algorithm (GA) and is composed of two procedures. The first procedure initializes two individual networks using deep belief networks (DBNs), and the second procedure merges the two networks using the GA. Biases and weights of the network that is trained using DBNs are represented as a matrix between each layer, and each row of this matrix is used as a chromosome in the merge procedure. To evaluate the performance, we conduct two set of experiments. The first set is to recognize accuracy of the proposed algorithm, and the second set is for a new retraining approach. The results show that the proposed algorithm has a lower average error rate (6.34 +/- 4.57%) than the DBNs, and it can add classes at a lower average error rate (9.06 +/- 6.17% and 10.17 +/- 4.51%) without pre-training using the restrict Boltzmann machines (RBMs) for existing classes data. (C) 2015 Elsevier B.V. All rights reserved.
Keyword:
Deep neural networks
Genetic algorithm
Deep belief networks
Feature extractor
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition Letters 封面图
Pattern Recognition Letters
IF:
3.3
论文数:
7.9K
被引数:
1.6W

机构

I
Inha University
学者数:
1.1W
论文数: 1.1W
被引数: 1.1W
引用论文

引用论文

Friction Models and Friction Compensation摩擦模型与摩擦补偿
err1998-01-01
err0
PREAI
errH. Olsson; K.J. Åström; C. Canudas de Wit; M. Gäfvert; P. Lischinsky
err分享
err收藏
A GA-based feature selection approach with an application to handwritten character recognition
err2014-01-01
err94
PREAI
errDe Stefano, C.; Fontanella, F.; Marrocco, C.; di Freca, A. Scotto
err分享
err收藏
Evidence of van Hove Singularities in Ordered Grain Boundaries of Graphene
err2014-06-06
err0
PREAI
errChuanxu Ma; Haifeng Sun; Yeliang Zhao; Bin Li; Qunxiang Li; Aidi Zhao; Xiaoping Wang; Yi Luo; Jinlong Yang; Bing Wang; J. G. Hou
err分享
err收藏
Learning ensemble classifiers via restricted Boltzmann machines
err2014-01-01
err29
PREAI
errZhang, Chun-Xia; Zhang, Jiang-She; Ji, Nan-Nan; Guo, Gao
err分享
err收藏
没有更多内容