返回
Stochastic Fixed Point Optimization Algorithm for Classifier Ensemble
DOI:10.1109/TCYB.2019.2921369.png)
摘要
En 中文
This paper considers a classifier ensemble problem with sparsity and diversity learning, which arises in the field of machine learning, and shows that the classifier ensemble problem can be formulated as a convex stochastic optimization problem over the fixed point set of a quasi-nonexpansive mapping. Specifically, for such a problem, this paper proposes an algorithm referred to as the stochastic fixed point optimization algorithm and performs a convergence analysis for three types of step size: 1) constant step size; 2) decreasing step size; and 3) a step size computed by line searches. In the case of a constant step size, the results indicate that a sufficiently small constant step size allows a solution to the problem to be approximated. In the case of a decreasing step size, conditions are shown under which the algorithm converges in probability to a solution. For the third case, a variation of the basic proposed algorithm also achieves convergence in probability to a solution. The high classification accuracies of the proposed algorithms are demonstrated through numerical comparisons with the conventional algorithm.
Keyword:
Optimization
Convergence
Machine learning algorithms
Approximation algorithms
Classification algorithms
Convex functions
Machine learning
Classifier ensemble
convex stochastic optimization
fixed point
quasi-nonexpansive mapping
sparsity and diversity learning
stochastic fixed point optimization algorithm
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Optimality and convergence for convex ensemble learning with sparsity and diversity based on fixed point optimization
NEUROCOMPUTING
IF6.5

