arrow
返回

Aesthetic multi-attributes network for image captioning

delete2025-04-01
delete0
PRE
AI
H
Hongtao Yang
Y
Yuchen Li
X
Xin Jin
X
Xinghui Zhou
S
Shi Ping
Y
Yehui Liu *
DOI:10.1016/j.compeleceng.2025.110103delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Image aesthetic quality assessment has witnessed a remarkable rise in popularity in recent years. Aesthetic captioning has emerged as a novel approach to encapsulate the overall aesthetic impression of an image. However, the inherently challenging task of annotating aesthetic attributes has constrained the scale of existing datasets. To address this limitation, the DPChallenge Multi-Attributes Captions (DPC-MAC) dataset was developed by integrating semiautomatically generated annotations from small-scale, fully annotated datasets with extensive technical reviews sourced from a photography platform. The DPC-MAC dataset encompasses four key aesthetic attributes: composition, lighting, color, and subject. To effectively leverage this data, we introduce an innovative Aesthetic Multi-Attributes Captioning Network (AMACN), comprising the Bottom-Up and Top-Down Attention Network (BUTDAN) and the Object- Semantics Aligned Pretrained Network (OSAPN). Both networks are trained using a combination of small-scale, fully annotated datasets and the large-scale DPC-MAC dataset. The performance of the proposed AMACN model on DPC-MAC surpasses existing methods based on standard image captioning evaluation metrics, demonstrating its efficacy. This groundbreaking task of aesthetic attribute assessment represents a promising avenue for advancing research in this field. By innovatively integrating aesthetic attributes with descriptive commentary, the DPCMAC dataset provides a valuable resource for researchers to develop more precise and nuanced aesthetic models. This work not only paves the way for further exploration of image aesthetics but also holds the potential to enhance the quality and sophistication of aesthetic evaluations.
Keyword:
Image aesthetic quality assessment
Image captioning
Aesthetic attributes assessment
Semi-supervised learning

期刊

C
Computers and Electrical Engineering
IF:
4.9
论文数:
6.7K
被引数:
1.3W

机构

B
beijing polytechnic college
学者数:
62
论文数: 52
被引数: 2
C
Communication University of China
学者数:
1.1K
论文数: 820
被引数: 326
B
Beijing Electronic Science and Technology Institute
学者数:
394
论文数: 214
被引数: 180
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
err分享
err收藏
Incidence of Seizures in Patients With Multiple Sclerosis: A Population-Based Study
err2002-09-01
err0
PREAI
errPaul A. Nyquist; Gregory D. Cascino; Robyn L. McClelland; John F. Annegers; Moses Rodriguez
err分享
err收藏
err分享
err收藏
Gold-to-Boron Aryl Transfer from a T-Shaped Phosphine–Borane Gold(I) Complex
err2021-07-16
err0
errOAAI
errCyril A. Theulier; Yago García-Rodeja; Sonia Mallet-Ladeira; Karinne Miqueu; Ghenwa Bouhadir; Didier Bourissou
err分享
err收藏
err分享
err收藏
学者 查看更多内容