arrow
返回

Important Region Estimation Using Image Captioning

delete2022-01-01
delete0
delete
OA
AI
T
Taku Suzuki
D
Daisuke Sato
Y
Yoshihiro Sugaya
T
Tomo Miyazaki
S
Shinichiro Omachi *
DOI:10.1109/ACCESS.2022.3211260delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
When storing images and videos on a limited storage device or transmitting them over a narrow-band network, an effective approach is to detect the necessary parts and process them preferentially. Visual saliency has often been used for this purpose, and many methods have been proposed to detect salient objects. However, a salient object is not necessarily the primary subject in an image. Determining the important regions in an image is not clear or easy to achieve because it generally depends on the context of the image. In this study, we propose a novel framework for detecting important image regions. We leverage an image-captioning technique because it interprets the context of an image when generating sentences. The proposed method determines those important regions that are closer to the level of human sensitivity by exploiting semantic information from the image captioning. To evaluate the effectiveness of the proposed method, we created a dataset that defines important regions within images based on experiments using subjective evaluation. Applying this dataset, we confirmed that the accuracy of the proposed approach was higher than that of conventional saliency-based object detection methods.
Keyword:
Feature extraction
Visualization
Videos
Decoding
Object detection
Image edge detection
Estimation
Machine learning
Image storage
Important region estimation
image captioning
visual saliency
machine learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

T
tohoku university
学者数:
4.3W
论文数: 3.6W
被引数: 31
R
Ryukoku University
学者数:
715
论文数: 663
被引数: 599
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Propiedades psicométricas de una versión breve del Driving Anger Expression Inventory en conductores españoles
err2019-05-28
err0
errOAAI
errDavid Herrero Fernández; Mireia Oliva-Macías; Pamela Parada-Fernández
err分享
err收藏
Measurement of Energy Access Using Fuzzy Logic
err2020-06-24
err0
errOAAI
errDiego Seuret-Jimenez; Tiare Robles-Bonilla; Karla G. Cedano
err分享
err收藏
Implications of extreme events on the water balance in Java
err2021-01-01
err0
errOAAI
errIndah Susanti; Sinta Berliana Sipayung; Bambang Siswanto; Edy Maryadi; Hidayatul Latifah; Amalia Nurlatifah; Lilik S. Supriatin; Adi Witono; Mamat Suhermat
err分享
err收藏
Rapid Optimization of Gene Delivery by Parallel End-modification of Poly(β-amino ester)s通过聚(β-氨基酯)的平行末端修饰实现基因递送的快速优化
err2007-03-20
err0
PREAI
errGregory T Zugates; Weidan Peng; Andreas Zumbuehl; Siddharth Jhunjhunwala; Yu-Hung Huang; Robert Langer; Janet A Sawicki; Daniel G Anderson
err分享
err收藏
学者 查看更多内容