.png){kind=icon}
返回
Deep Neural Network Ensembles Using Class-vs-Class Weighting
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3298057.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Ensembling is a popular and powerful technique to utilize predictions from several different machine learning models. The fundamental precondition of a well-working ensemble model is a diverse set of combined constituents. Rapid development in the deep learning field provides an ever-increasing palette of diverse model architectures. This rich variety of models provides an ideal situation to improve classification accuracy by ensembling. In this regard, we propose a novel weighted ensembling classification approach with unique weights for each combined classifier and each pair of classes. The novel weighting scheme allows us to account for the different abilities of individual classifiers to distinguish between pairs of classes. First, we analyze a theoretical scenario, in which our approach yields optimal classification. Second, we test its practical applicability on computer vision benchmark datasets. We evaluate the effectiveness of our proposed method and averaging ensemble baseline on an image classification task using the CIFAR-100 and ImageNet1k benchmarks. We use deep convolutional neural networks, vision transformers, and an MLP-Mixer as ensemble constituents. Statistical tests show that our proposed method provides higher accuracy gains than a popular baseline ensemble on both datasets. On the CIFAR-100 dataset, the proposed method attains accuracy improvements ranging from 2% to 5% compared to the best ensemble constituent. On the Imagenet dataset, these improvements range from 1% to 3% in most cases. Additionally, we show that when constituent classifiers are well -calibrated and have similar performance, the simple averaging ensemble yields good results.
Keyword:
Couplings
Training
Computational modeling
Task analysis
Predictive models
Benchmark testing
Transformers
Neural networks
Deep learning
Ensemble learning
Linear discriminant analysis
Pairwise coupling
multi-class classification
deep neural networks
deep ensembles
linear discriminant analysis
homoscedastic data
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Bacteriorhodopsin's L550 intermediate contains a C14-C15 s-trans-retinal chromophore.细菌视紫红质的L550中间体含有C14-C15的s-反式-视黄醛发色团。
OAAI
OAAI分享收藏分享收藏HIVE-COTE 2.0: a new meta ensemble for time series classificationHive-cote 2.0: 一种新的时间序列分类元集成.png)
MACHINE LEARNINGOAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
PREAI
分享收藏The Relation between Climatic Temperature and Sudden Infant Death Syndrome Differs among CommunitiesEpidemiologyOAAI
EpidemiologyIF0
OAAI分享收藏
查看更多内容