arrow
返回

Substructural Regularization With Data-Sensitive Granularity for Sequence Transfer Learning

delete2018-06-01
delete12
PRE
AI
孙
孙世昌 (Shichang Sun) *
H
Hongbo Liu
J
Jiana Meng
陈晨 封面图
陈晨 (C. L. Philip Chen)
Y
Yu Yang
DOI:10.1109/TNNLS.2016.2638321delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Sequence transfer learning is of interest in both academia and industry with the emergence of numerous new text domains from Twitter and other social media tools. In this paper, we put forward the data-sensitive granularity for transfer learning, and then, a novel substructural regularization transfer learning model (STLM) is proposed to preserve target domain features at substructural granularity in the light of the condition of labeled data set size. Our model is underpinned by hidden Markov model and regularization theory, where the substructural representation can be integrated as a penalty after measuring the dissimilarity of substructures between target domain and STLM with relative entropy. STLM can achieve the competing goals of preserving the target domain substructure and utilizing the observations from both the target and source domains simultaneously. The estimation of STLM is very efficient since an analytical solution can be derived as a necessary and sufficient condition. The relative usability of substructures to act as regularization parameters and the time complexity of STLM are also analyzed and discussed. Comprehensive experiments of part-of-speech tagging with both Brown and Twitter corpora fully justify that our model can make improvements on all the combinations of source and target domains.
Keyword:
Data-sensitive granularity
hidden Markov model (HMM)
relative entropy (RE)
sequence transfer learning
substructural regularization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.8K
被引数:
9.0W

机构

大连海事大学 封面图
大连海事大学
学者数:
2.1K
论文数: 612
被引数: 6.1K
大连理工大学 封面图
大连理工大学
学者数:
6.5K
论文数: 1.8K
被引数: 3.5W
U
University of Macau
学者数:
1.5K
论文数: 706
被引数: 1.2W
学者 查看更多机构
引用论文

引用论文

The Friction and Lubrication of elastomers弹性体的摩擦和润滑
err1995-01-01
err0
PREAI
errA. Arvanitaki; B.J. Briscoe; M.J. Adams; S.A. Johnson
err分享
err收藏
err分享
err收藏
Triplex Transfer Learning: Exploiting Both Shared and Distinct Concepts for Text Classification
err2014-07-01
err56
PREAI
errZhuang, Fuzhen; Luo, Ping; Du, Changying; He, Qing; Shi, Zhongzhi; Xiong, Hui
err分享
err收藏
学者 查看更多内容