.png){kind=icon}
返回
Classification-based objective functions
.png){kind=icon}
OA
AI
DOI：10.1007/s10994-006-6266-6.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Backpropagation, similar to most learning algorithms that can form complex decision Surfaces, is prone to overfitting. This work presents classification-based objective functions, an approach to training artificial neural networks on classification problems. Classification-based learning attempts to guide the network directly to correct pattern classification rather than using common error minimization heuristics, such as sum-squared error (SSE) and cross-entropy (CE), that do not explicitly minimize classification error. CBI is presented here as a novel objective function for learning classification problems. It seeks to directly minimize classification error by backpropagating error only on misclassified patterns from culprit Output nodes. CB1 discourages weight saturation and overfitting and achieves higher accuracy on classification problems than optimizing SSE or CE. Experiments on a large OCR data set have shown CB1 to significantly increase generalization accuracy over SSE or CE optimization, from 97.86% and 98.10%, respectively, to 99.11%. Comparable results are achieved over several data sets from the UC Irvine Machine Learning Database Repository, with an average increase in accuracy from 90.7% and 91.3% using optimized SSE and CE networks, respectively, to 92.1% for CB1. Analysis indicates that CBI performs a fundamentally different search of the feature space than optimizing SSE or CE and produces significantly different solutions.
Keyword:
neural networks
backpropagation
classification
objective functions
期刊
IF:
2.9
论文数:
2.7K
被引数:
3.4W
机构
暂无机构信息
引用论文
.png){kind=icon}
A Comparison ofNannochloropsis salinaGrowth Performance in Two Outdoor Pond Designs: Conventional Raceways versus the ARID Pond with Superior Temperature Management两种室外池塘设计中 Nannochloropsis salina 生长性能的比较: 常规跑道与具有优越温度管理的干旱池塘
OAAI
OAAI分享收藏 没有更多内容
没有更多内容