arrow
Return

Adversarial Learning for Personalized Tag Recommendation

delete2021-01-01
delete19
delete
OA
AI
Y
Yogesh Singh Rawat *
M
Mubarak Shah
M
Mohan Kankanhalli
DOI:10.1109/TMM.2020.2992941delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We have recently seen great progress in image classification due to the success of deep convolutional neural networks and the availability of large-scale datasets. Most of the existing work focuses on single-label image classification. However, there are usually multiple tags associated with an image. The existing works on multi-label classification are mainly based on lab curated labels. Humans assign tags to their images differently, which is mainly based on their interests and personal tagging behavior. In this paper, we address the problem of personalized tag recommendation and propose an end-to-end deep network which can be trained on large-scale datasets. The user-preference is learned within the network in an unsupervised way where the network performs joint optimization for user-preference and visual encoding. A joint training of user-preference and visual encoding allows the network to efficiently integrate the visual preference with tagging behavior for a better user recommendation. In addition, we propose the use of adversarial learning, which enforces the network to predict tags resembling user-generated tags. We demonstrate the effectiveness of the proposed model on two different large-scale and publicly available datasets, YFCC100 M and NUS-WIDE. The proposed method achieves significantly better performance on both the datasets when compared to the baselines and other state-of-the-art methods. The code is publicly available at https://github.com/vyzuer/ALTReco.
Keywords:
Visualization
Tagging
Deep learning
Convolutional neural networks
Encoding
Social networking (online)
Tensors
Deep neural networks
user preference
image tagging
adversarial learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

I
Illinois Institute of Technology
Scholars:
3.8K
Papers: 3.9K
Citations: 4.2K
State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130
U
University of Central Florida
Scholars:
8.6K
Papers: 6.8K
Citations: 1.4W
researcher View more organizations