返回
Exploring multiobjective training in multiclass classification
DOI:10.1016/j.neucom.2020.12.087.png)
摘要
En 中文
Multinomial logistic loss and L-2 regularization are often conflicting objectives as more robust regularization leads to restrained multinomial parameters. For many practical problems, leveraging the best of both worlds would be invaluable for better decision-making processes. This research proposes a novel framework to obtain representative and diverse L-2-regularized multinomial models, based on valuable tradeoffs between prediction error and model complexity. The framework relies upon the Non-Inferior Set Estimation (NISE) method - a deterministic multiobjective solver. NISE automatically implements hyperparameter tuning in a multiobjective context. Given the diverse set of efficient learning models, model selection and aggregation of the multiple models in an ensemble framework promote high performance in multiclass classification. Additionally, NISE uses the weighted sum method as scalarization, thus being able to deal with the learning formulation directly. Its deterministic nature and the convexity of the learning problem confer scalability to the proposal. The experiments show competitive performance in various setups, taking a broad set of multiclass classification methods as contenders. (C) 2021 Elsevier B.V. All rights reserved.
Keyword:
Multiclass classification
Ensemble learning
Multiobjective optimization
Diversity of Pareto-optimal models
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Evolutionary multi-objective generation of recurrent neural network ensembles for time series prediction用于时间序列预测的递归神经网络集成的进化多目标生成
NEUROCOMPUTING
IF6.5
Productivity enhancement of solar still by PCM and Nanoparticles miscellaneous basin absorbing materials
Desalination
IF0

