arrow
Return

Domain Adaptive Ensemble Learning

delete2021-01-01
delete142
delete
OA
AI
K
Kaiyang Zhou *
Y
Yongxin Yang
Y
Yu Qiao
T
Tao Xiang
DOI:10.1109/TIP.2021.3112012delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The problem of generalizing deep neural networks from multiple source domains to a target one is studied under two settings: When unlabeled target data is available, it is a multi-source unsupervised domain adaptation (UDA) problem, otherwise a domain generalization (DG) problem. We propose a unified framework termed domain adaptive ensemble learning (DAEL) to address both problems. A DAEL model is composed of a CNN feature extractor shared across domains and multiple classifier heads each trained to specialize in a particular source domain. Each such classifier is an expert to its own domain but a non-expert to others. DAEL aims to learn these experts collaboratively so that when forming an ensemble, they can leverage complementary information from each other to be more effective for an unseen target domain. To this end, each source domain is used in turn as a pseudo-target-domain with its own expert providing supervisory signal to the ensemble of non-experts learned from the other sources. To deal with unlabeled target data under the UDA setting where real expert does not exist, DAEL uses pseudo labels to supervise the ensemble learning. Extensive experiments on three multi-source UDA datasets and two DG datasets show that DAEL improves the state of the art on both problems, often by significant margins.
Keywords:
Adaptation models
Training
Collaboration
Feature extraction
Computational modeling
Head
Neural networks
Domain adaptation
domain generalization
collaborative ensemble learning

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
U
University of Surrey
Scholars:
1.2W
Papers: 1.3W
Citations: 22
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Expression of programmed cell death ligand 1 in non–small cell lung cancer: Comparison between cytologic smears, core biopsies, and whole sections using the SP263 assay
err2018-11-30
err0
errOAAI
errEnrico Munari; Giuseppe Zamboni; Giorgia Sighele; Marcella Marconi; Marco Sommaggio; Gianluigi Lunardi; Giulio Rossi; Alberto Cavazza; Francesca Moretta; Eliana Gilioli; Anna Caliò; George J. Netto; Mohammad O. Hoque; Guido Martignoni; Matteo Brunelli; Paola Vacca; Lorenzo Moretta; Giuseppe Bogina
errShare
errSave
A cancer pharmacogenomic screen powering crowd-sourced advancement of drug combination prediction
err
IF0
err2017-10-09
err0
errOAAI
errMichael P Menden; Dennis Wang; Yuanfang Guan; Mike J Mason; Bence Szalai; Krishna C Bulusu; Thomas Yu; Jaewoo Kang; Minji Jeon; Russ Wolfinger; Tin Nguyen; Mikhail Zaslavskiy; Sock Jang; Zara Ghazoui; Mehmet Eren Ahsen; Robert Vogel; Elias Chaibub Neto; Thea Norman; Eric KY Tang; Mathew J Garnett; Giovanni Di Veroli; Stephen Fawell; Gustavo Stolovitzky; Justin Guinney; Jonathan R. Dry; Julio Saez-Rodriguez
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Autoimmune encephalitis with coexistent LGI1 and GABABR1 antibodies: case report
err2021-11-27
err0
errOAAI
errYi Xie; Jia Wen; Zhihua Zhao; Hongbo Liu; Nanchang Xie
errShare
errSave
Patterns and motivations of Cannabis use amongst patients with inflammatory bowel disease
err2019-05-29
err0
PREAI
errSteven Pi; Greg Rosenfeld; Robert Enns; Brian Bressler; Amy Wong; Chasyn Enns; Chris MacDonnell; Yvette Leung
errShare
errSave
researcher View more