arrow
返回

Discriminability objective for training descriptive captions

delete2018-06-01
delete117
PRE
AI
R
Ruotian Luo *
P
Price, Brian
S
Scott Cohen
G
Gregory Shakhnarovich
DOI:10.1109/CVPR.2018.00728delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
One property that remains lacking in image captions generated by contemporary methods is discriminability: being able to tell two images apart given the caption for one of them. We propose a way to improve this aspect of caption generation. By incorporating into the captioning training objective a loss component directly related to ability (by a machine) to disambiguate image/caption matches, we obtain systems that produce much more discriminative caption, according to human evaluation. Remarkably, our approach leads to improvement in other aspects of generated captions, reflected by a battery of standard scores such as BLEU, SPICE etc. Our approach is modular and can be applied to a variety of model/loss combinations commonly proposed for image captioning.

期刊

I
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
IF:
0
论文数:
3
被引数:
0

机构

A
adobe systems inc.
学者数:
273
论文数: 305
被引数: 0
引用论文

引用论文

The aldo-keto reductase superfamily homepage
err2003-02-01
err0
PREAI
errDavid Hyndman; David R Bauman; Vladi V Heredia; Trevor M Penning
err分享
err收藏
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
err2017-02-06
err3.1K
errOAAI
errKrishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei
err分享
err收藏
On the Existence of LiFeVO4 – Tales and Imagination
err2011-04-12
err0
PREAI
errOliver Clemens; Matthias Bauer; Robert Haberkorn; Horst Philipp Beck
err分享
err收藏
学者 查看更多内容