arrow
返回

Transfer Learning with Dynamic Distribution Adaptation

delete2020-02-06
delete234
delete
OA
AI
J
Jindong Wang
C
Chen, Yiqiang *
冯文杰 (Feng, Wenjie)
Y
Yu, Han
M
Meiyu Huang
Y
Yang, Qiang
DOI:10.1145/3360309delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on adapting the cross-domain marginal or conditional distributions. However, in real applications, the marginal and conditional distributions usually have different contributions to the domain discrepancy. Existing methods fail to quantitatively evaluate the different importance of these two distributions, which will result in unsatisfactory transfer performance. In this article, we propose a novel concept called Dynamic Distribution Adaptation (DDA), which is capable of quantitatively evaluating the relative importance of each distribution. DDA can be easily incorporated into the framework of structural risk minimization to solve transfer learning problems. On the basis of DDA, we propose two novel learning algorithms: (1) ManifoldDynamic DistributionAdaptation (MDDA) for traditional transfer learning, and (2) Dynamic Distribution Adaptation Network (DDAN) for deep transfer learning. Extensive experiments demonstrate that MDDA and DDAN significantly improve the transfer learning performance and set up a strong baseline over the latest deep and adversarial methods on digits recognition, sentiment analysis, and image classification. More importantly, it is shown that marginal and conditional distributions have different contributions to the domain divergence, and our DDA is able to provide good quantitative evaluation of their relative importance, which leads to better performance. We believe this observation can be helpful for future research in transfer learning.
Keyword:
Transfer learning
domain adaptation
distribution alignment
deep learning
subspace learning
kernel method
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Intelligent Systems and Technology 封面图
ACM Transactions on Intelligent Systems and Technology
IF:
6.6
论文数:
1.5K
被引数:
6.2K

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
M
Microsoft Research Asia
学者数:
421
论文数: 407
被引数: 2
I
institute of computing technology, cas
学者数:
1.0K
论文数: 877
被引数: 1
M
Microsoft
学者数:
3.0K
论文数: 2.7K
被引数: 7
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Evolution of structural and optical properties of photocatalytic Fe doped TiO2 thin films prepared by RF magnetron sputtering
err2014-01-01
err0
PREAI
errPrabitha B. Nair; L. V. Maneeshya; V. B. Justinvictor; Georgi P. Daniel; K. Joy; P. V. Thomas
err分享
err收藏
Amyloid Arthropathy: A Review
err2021-09-09
err0
PREAI
errJulio A. Diaz-Perez; Sheila A. Conway; Yiqin Zuo; Gunnlaugur Petur Nielsen; Martin Selig; Andrew E. Rosenberg
err分享
err收藏
Everyday life for users of electric wheelchairs – a qualitative interview study
err2012-03-17
err0
PREAI
errCamilla Blach Rossen; Bodil Sørensen; Bente Würtz Jochumsen; Gitte Wind
err分享
err收藏
学者 查看更多内容