arrow
返回

ABSNet: Aesthetics-Based Saliency Network Using Multi-Task Convolutional Network

delete2020-01-01
delete5
delete
OA
AI
刘
刘静 (Jing Liu)
J
Jincheng Lv
M
Min Yuan *
J
Jing Zhang
苏育挺 封面图
苏育挺 (Yuting Su)
DOI:10.1109/LSP.2020.3035065delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
As a smart visual attention mechanism to analyze visual scenes, visual saliency has been shown to closely correlate with semantic information such as faces. Although many semantic-information-guided saliency models have been proposed, to the best of our knowledge, no semantic information in affective domain has been employed for saliency detection. Aesthetic, the affective perceptual quality that integrates factors like scene composition and contrast, can certainly benefit visual attention that highly depends on these visual factors. In this letter, we propose an end-to-end multi-task framework called aesthetics-based saliency network (ABSNet). We use three commonly-used shared backbones and design two distinct branches for each task. Mean square error (MSE) loss and Earth Mover's Distance (EMD) loss are jointly adopted to alternately train the shared network and individual branch for different tasks, facilitating the proposed model to extract more effective features for visual perception. Moreover, our model is resolution-friendly to predict saliency for images of arbitrary size. It has been shown that the proposed multi-task method is superior over single-task version and outperforms state-of-the-art saliency methods.
Keyword:
Visualization
Task analysis
Feature extraction
Saliency detection
Signal processing algorithms
Prediction algorithms
Semantics
Aesthetics assessment
multi-task learning
visual saliency detection
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

T
Tianjin University
学者数:
6.1K
论文数: 1.7K
被引数: 0
引用论文

引用论文

In situ Seamless Magnetic Measurements for Solid‐State Electrochemical Processes in Prussian Blue Analogues
err2013-04-25
err0
PREAI
errTetsuya Yamada; Kantaro Morita; Heng Wang; Keita Kume; Hirofumi Yoshikawa; Kunio Awaga
err分享
err收藏
Oxamflatin Significantly Improves Nuclear Reprogramming, Blastocyst Quality, and In Vitro Development of Bovine SCNT Embryos
err2011-08-30
err0
errOAAI
errJianmin Su; Yongsheng Wang; Yanyan Li; Ruizhe Li; Qian Li; Yongyan Wu; Fusheng Quan; Jun Liu; Zekun Guo; Yong Zhang
err分享
err收藏
Visual Saliency Detection via Sparsity Pursuit
err2010-08-01
err159
PREAI
errYan, Junchi; Zhu, Mengyuan; Liu, Huanxi; Liu, Yuncai
err分享
err收藏
Meeting the demand: geothermal heat supply rates for an urban quarter in Germany
err2019-03-23
err0
errOAAI
errCarolin Tissen; Kathrin Menberg; Peter Bayer; Philipp Blum
err分享
err收藏
Continuous Live-Cell Culture Monitoring by Compact Lensless LED Microscopes
err2018-12-05
err0
errOAAI
errGregor Scholz; Shinta Mariana; Iqbal Syamsu; Agus Budi Dharmawan; Torben Schulze; Kai Mattern; Philipp Hörmann; Jana Hartmann; Andreas Dietzel; Ingo Rustenbeck; Karsten Hiller; Joan Daniel Prades; Andreas Waag; Hutomo Suryo Wasisto
err分享
err收藏
Saliency Detection by Adaptive Channel Fusion
err2018-07-01
err6
PREAI
errHuang, Kan; Zhu, Chunbiao; Li, Ge
err分享
err收藏
学者 查看更多内容