.png){kind=icon}
返回
Inverse Adversarial Diversity Learning for Network Ensemble
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2022.3222263.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Network ensemble aims to obtain better results by aggregating the predictions of multiple weak networks, in which how to keep the diversity of different networks plays a critical role in the training process. Many existing approaches keep this kind of diversity either by simply using different network initializations or data partitions, which often requires repeated attempts to pursue a relatively high performance. In this article, we propose a novel inverse adversarial diversity learning (IADL) method to learn a simple yet effective ensemble regime, which can be easily implemented in the following two steps. First, we take each weak network as a generator and design a discriminator to judge the difference between the features extracted by different weak networks. Second, we present an inverse adversarial diversity constraint to push the discriminator to cheat generators that all the resulting features of the same image are too similar to distinguish each other. As a result, diverse features will be extracted by these weak networks through a min-max optimization. What is more, our method can be applied to a variety of tasks, such as image classification and image retrieval, by applying a multitask learning objective function to train all these weak networks in an end-to-end manner. We conduct extensive experiments on the CIFAR-10, CIFAR-100, CUB200-2011, and CARS196 datasets, in which the results show that our method significantly outperforms most of the state-of-the-art approaches.
Keyword:
Training
Feature extraction
Generators
Adversarial machine learning
Task analysis
Diversity methods
Computer vision
Adversarial learning
deep neural network
diversity constraint
network ensemble
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Types of Parent Verbal Responsiveness That Predict Language in Young Children With Autism Spectrum Disorder预测自闭症谱系障碍幼儿语言的父母言语反应类型
OAAI
OAAI分享收藏分享收藏Seven-Year Surveillance of emm Types of Pediatric Group A Streptococcal Pharyngitis Isolates in Western Greece.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏
查看更多内容