arrow
返回

Representation learning with deep sparse auto-encoder for multi-task learning

delete2022-09-01
delete9
PRE
AI
Y
Yi Zhu
X
Xindong Wu
强继朋 封面图
强继朋 (Jipeng Qiang) *
X
Xuegang Hu
Y
Yuhong Zhang
李培培 封面图
李培培 (Peipei Li)
DOI:10.1016/j.patcog.2022.108742delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We demonstrate an effective framework to achieve a better performance based on Deep Sparse auto encoder for Multi-task Learning, called DSML for short. To learn the reconstructed and higher-level features on cross-domain instances for multiple tasks, we combine the labeled and unlabeled data from all tasks to reconstruct the feature representations. Furthermore, we propose the model of Stacked Reconstruction Independence Component Analysis (SRICA for short) for the optimization of feature representations with a large amount of unlabeled data, which can effectively address the redundancy of image data. Our proposed SRICA model is developed from RICA and is based on deep sparse auto-encoder. In addition, we adopt a Semi-Supervised Learning method (SSL for short) based on model parameter regularization to build a unified model for multi-task learning. There are several advantages in our proposed framework as follows: 1) The proposed SRICA makes full use of a large amount of unlabeled data from all tasks. It is used to pursue an optimal sparsity feature representation, which can overcome the over fitting problem effectively. 2) The deep architecture used in our SRICA model is applied for higher-level and better representation learning, which is designed to train on patches for sphering the input data. 3) Training parameters in our proposed framework has lower computational cost compared to other common deep learning methods such as stacked denoising auto-encoders. Extensive experiments on several real image datasets demonstrate our proposed framework outperforms the state-of-the-art methods.(c) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Deep sparse auto-encoder
Multi-task learning
RICA
Labeled and unlabeled data

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

H
hefei university of technology
学者数:
2.5W
论文数: 1.7W
被引数: 35
Y
Yangzhou University
学者数:
2.8W
论文数: 1.9W
被引数: 3.3W
引用论文

引用论文

Deep multi-task learning with relational attention for business success prediction
err2021-02-01
err23
PREAI
errZhao, Jiejie; Du, Bowen; Sun, Leilei; Lv, Weifeng; Liu, Yanchi; Xiong, Hui
err分享
err收藏
Multi-Domain and Multi-Task Learning for Human Action Recognition
err2019-02-01
err41
PREAI
errLiu, An-An; Xu, Ning; Nie, Wei-Zhi; Su, Yu-Ting; Zhang, Yong-Dong
err分享
err收藏
Strong Isotope Effects on Effective Interactions and Phase Behavior in Protein Solutions in the Presence of Multivalent Ions
err2017-02-13
err0
PREAI
errMichal K. Braun; Marcell Wolf; Olga Matsarskaia; Stefano Da Vela; Felix Roosen-Runge; Michael Sztucki; Roland Roth; Fajun Zhang; Frank Schreiber
err分享
err收藏
Knowledge triple mining via multi-task learning
err2019-02-01
err2
PREAI
errZhang, Zhao; Zhuang, Fuzhen; Li, Xuebing; Niu, Zheng-Yu; He, Jia; He, Qing; Xiong, Hui
err分享
err收藏
F
err1975-01-01
err0
PREAI
errARNOLD E. BENDER
err分享
err收藏
Feature Constrained Multi-Task Learning Models for Spatiotemporal Event Forecasting
err2017-05-01
err33
PREAI
errZhao, Liang; Sun, Qian; Ye, Jieping; Chen, Feng; Lu, Chang-Tien; Ramakrishnan, Naren
err分享
err收藏
Sentiment and Sarcasm Classification With Multitask Learning
err2019-05-01
err167
errOAAI
errMajumder, Navonil; Poria, Soujanya; Peng, Haiyun; Chhaya, Niyati; Cambria, Erik; Gelbukh, Alexander
err分享
err收藏
学者 查看更多内容