arrow
返回

Privileged multi-task learning for attribute-aware aesthetic assessment

delete2022-12-01
delete6
PRE
AI
Y
Yangyang Shu
李
李谦 (Qian Li)
L
Lingqiao Liu
G
Guandong Xu *
DOI:10.1016/j.patcog.2022.108921delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Aesthetic attributes are crucial for aesthetics because they explicitly present some photo quality cues that a human expert might use to evaluate a photo's aesthetic quality. However, the aesthetic attributes have not been largely and sufficiently exploited for photo aesthetic assessment. In this paper, we pro-pose a novel approach to photo aesthetic assessment with the help of aesthetic attributes. The aesthetic attributes are used as privileged information (PI), which is often available during training phase but un-available in prediction phase due to the high collection expense. The proposed framework consists of a deep multi-task network as generator and a fully connected network as discriminator. Deep multi-task network learns the aesthetic attributes and score simultaneously to capture their dependencies and ex-tract better feature representations. Specifically, we use ranking constraint in the label space, similarity constraint and prior probabilities loss in the privileged information space to make the output of multi-task network converge to that of ground truth. Adversarial loss is used to identify and distinguish the predicted privileged information of a deep multi-task network from the ground truth PI distribution. Ex-perimental results on two benchmark databases demonstrate the superiority of the proposed method to state-of-the-art.(c) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Aesthetic assessment
Privileged information
Multi -task learning

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
University of Adelaide
学者数:
2.3W
论文数: 2.4W
被引数: 4.2W
C
Curtin University
学者数:
1.5W
论文数: 1.8W
被引数: 2.8W
U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
学者 查看更多机构
引用论文

引用论文

V-SVR plus : Support Vector Regression With Variational Privileged Information
err2022-01-01
err6
errOAAI
errShu, Yangyang; Li, Qian; Xu, Chang; Liu, Shaowu; Xu, Guandong
err分享
err收藏
err分享
err收藏
Distribution-Oriented Aesthetics Assessment With Semantic-Aware Hybrid Network
err2019-05-01
err68
PREAI
errCui, Chaoran; Liu, Huihui; Lian, Tao; Nie, Liqiang; Zhu, Lei; Yin, Yilong
err分享
err收藏
Learning with privileged information for photo aesthetic assessment
err2020-09-01
err19
errOAAI
errShu, Yangyang; Li, Qian; Liu, Shaowu; Xu, Guandong
err分享
err收藏
Handcrafted vs. non-handcrafted features for computer vision classification
err2017-11-01
err378
PREAI
errNanni, Loris; Ghidoni, Stefano; Brahnam, Sheryl
err分享
err收藏
Image Aesthetic Assessment An experimental survey
err2017-07-01
err201
errOAAI
errDeng, Yubin; Loy, Chen Change; Tang, Xiaoou
err分享
err收藏
A Unified Probabilistic Formulation of Image Aesthetic Assessment
err2020-01-01
err61
PREAI
errZeng, Hui; Cao, Zisheng; Zhang, Lei; Bovik, Alan C.
err分享
err收藏
学者 查看更多内容