arrow
Return

Privileged multi-task learning for attribute-aware aesthetic assessment

delete2022-12-01
delete6
PRE
AI
Y
Yangyang Shu
李
李谦 (Qian Li)
L
Lingqiao Liu
G
Guandong Xu *
DOI:10.1016/j.patcog.2022.108921delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Aesthetic attributes are crucial for aesthetics because they explicitly present some photo quality cues that a human expert might use to evaluate a photo's aesthetic quality. However, the aesthetic attributes have not been largely and sufficiently exploited for photo aesthetic assessment. In this paper, we pro-pose a novel approach to photo aesthetic assessment with the help of aesthetic attributes. The aesthetic attributes are used as privileged information (PI), which is often available during training phase but un-available in prediction phase due to the high collection expense. The proposed framework consists of a deep multi-task network as generator and a fully connected network as discriminator. Deep multi-task network learns the aesthetic attributes and score simultaneously to capture their dependencies and ex-tract better feature representations. Specifically, we use ranking constraint in the label space, similarity constraint and prior probabilities loss in the privileged information space to make the output of multi-task network converge to that of ground truth. Adversarial loss is used to identify and distinguish the predicted privileged information of a deep multi-task network from the ground truth PI distribution. Ex-perimental results on two benchmark databases demonstrate the superiority of the proposed method to state-of-the-art.(c) 2022 Elsevier Ltd. All rights reserved.
Keywords:
Aesthetic assessment
Privileged information
Multi -task learning

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
University of Adelaide
Scholars:
2.3W
Papers: 2.4W
Citations: 4.2W
C
Curtin University
Scholars:
1.5W
Papers: 1.8W
Citations: 2.8W
U
university of technology sydney
Scholars:
1.6W
Papers: 2.0W
Citations: 25
researcher View more organizations
Cited Papers

Cited Papers

V-SVR plus : Support Vector Regression With Variational Privileged Information
err2022-01-01
err6
errOAAI
errShu, Yangyang; Li, Qian; Xu, Chang; Liu, Shaowu; Xu, Guandong
errShare
errSave
errShare
errSave
Distribution-Oriented Aesthetics Assessment With Semantic-Aware Hybrid Network
err2019-05-01
err68
PREAI
errCui, Chaoran; Liu, Huihui; Lian, Tao; Nie, Liqiang; Zhu, Lei; Yin, Yilong
errShare
errSave
Learning with privileged information for photo aesthetic assessment
err2020-09-01
err19
errOAAI
errShu, Yangyang; Li, Qian; Liu, Shaowu; Xu, Guandong
errShare
errSave
Handcrafted vs. non-handcrafted features for computer vision classification
err2017-11-01
err378
PREAI
errNanni, Loris; Ghidoni, Stefano; Brahnam, Sheryl
errShare
errSave
Image Aesthetic Assessment An experimental survey
err2017-07-01
err201
errOAAI
errDeng, Yubin; Loy, Chen Change; Tang, Xiaoou
errShare
errSave
errShare
errSave
A Unified Probabilistic Formulation of Image Aesthetic Assessment
err2020-01-01
err61
PREAI
errZeng, Hui; Cao, Zisheng; Zhang, Lei; Bovik, Alan C.
errShare
errSave
Personality-Assisted Multi-Task Learning for Generic and Personalized Image Aesthetics Assessment
err2020-01-01
err88
PREAI
errLi, Leida; Zhu, Hancheng; Zhao, Sicheng; Ding, Guiguang; Lin, Weisi
errShare
errSave
researcher View more