arrow
返回

Stochastic Fixed Point Optimization Algorithm for Classifier Ensemble

delete2020-10-01
delete12
PRE
AI
H
Hideaki Iiduka *
DOI:10.1109/TCYB.2019.2921369delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper considers a classifier ensemble problem with sparsity and diversity learning, which arises in the field of machine learning, and shows that the classifier ensemble problem can be formulated as a convex stochastic optimization problem over the fixed point set of a quasi-nonexpansive mapping. Specifically, for such a problem, this paper proposes an algorithm referred to as the stochastic fixed point optimization algorithm and performs a convergence analysis for three types of step size: 1) constant step size; 2) decreasing step size; and 3) a step size computed by line searches. In the case of a constant step size, the results indicate that a sufficiently small constant step size allows a solution to the problem to be approximated. In the case of a decreasing step size, conditions are shown under which the algorithm converges in probability to a solution. For the third case, a variation of the basic proposed algorithm also achieves convergence in probability to a solution. The high classification accuracies of the proposed algorithms are demonstrated through numerical comparisons with the conventional algorithm.
Keyword:
Optimization
Convergence
Machine learning algorithms
Approximation algorithms
Classification algorithms
Convex functions
Machine learning
Classifier ensemble
convex stochastic optimization
fixed point
quasi-nonexpansive mapping
sparsity and diversity learning
stochastic fixed point optimization algorithm
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

M
Meiji University
学者数:
1.9K
论文数: 1.5K
被引数: 1.1K
引用论文

引用论文

Reoperation for recurrent temporal lobe epilepsy
err1994-07-01
err0
PREAI
errIsabelle M. Germano; Nicole Poulin; André Olivier
err分享
err收藏
Sustained improvement in intraoperative efficiency following implementation of a dedicated surgical team for pediatric spine fusion surgery
err2017-06-01
err0
PREAI
errWallis Muhly; John McCloskey; Jeff Feldman; Barbara Dezayas; Michael Blum; Blair Kraus; Vaidehi Mehta; Devika Singh; Ron Keren; John Flynn
err分享
err收藏
Projection-Based Ensemble Learning for Ordinal Regression基于投影的序数回归集成学习
err2014-05-01
err41
errOAAI
errPerez-Ortiz, Maria; Antonio Gutierrez, Pedro; Hervas-Martinez, Cesar
err分享
err收藏
A novel classifier ensemble method with sparsity and diversity
err2014-06-01
err47
PREAI
errYin, Xu-Cheng; Huang, Kaizhu; Hao, Hong-Wei; Iqbal, Khalid; Wang, Zhi-Bin
err分享
err收藏
Autonomous Thrust-Assisted Perching of a Fixed-Wing UAV on Vertical Surfaces
err2017-07-16
err0
PREAI
errDino Mehanovic; John Bass; Thomas Courteau; David Rancourt; Alexis Lussier Desbiens
err分享
err收藏
学者 查看更多内容