arrow
Return

Implicit visual knowledge enhanced zero-shot image captioning

delete2025-12-17
delete0
PRE
AI
X
Xubo Liu
W
Wenya Guo *
X
Xumeng Liu
R
Ruxue Yan
Y
Ying Zhang
DOI:10.1016/j.eswa.2025.130862delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• We introduce implicit visual knowledge to bridge the gap between CLIP and language models. • A Visual Knowledge Extraction (VKE) module extracts image-related knowledge using GPT-2. • Two integration methods enhance caption accuracy and diversity. • Our framework achieves a 15.9 % improvement in caption diversity on MSCOCO.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

No organization information available
Cited Papers

Cited Papers

Long Short-Term Memory
err1997-11-01
err0
PREAI
errSepp Hochreiter; Jürgen Schmidhuber
errShare
errSave
Dual Global Enhanced Transformer for image captioning
err2022-04-01
err63
PREAI
errXian, Tiantao; Li, Zhixin; Zhang, Canlong; Ma, Huifang
errShare
errSave
Diverse Beam Search for Improved Description of Complex Scenes
err2018-04-27
err0
errOAAI
errAshwin Vijayakumar; Michael Cogswell; Ramprasaath Selvaraju; Qing Sun; Stefan Lee; David Crandall; Dhruv Batra
errShare
errSave
Mining core information by evaluating semantic importance for unpaired image captioning
err2024-11-01
err0
PREAI
errWei, Jiahui; Li, Zhixin; Zhang, Canlong; Ma, Huifang
errShare
errSave
Unified Vision-Language Pre-Training for Image Captioning and VQA
err2020-04-03
err0
errOAAI
errLuowei Zhou; Hamid Palangi; Lei Zhang; Houdong Hu; Jason Corso; Jianfeng Gao
errShare
errSave
Exploring refined dual visual features cross-combination for image captioning
err2024-12-01
err0
PREAI
errHu, Junbo; Li, Zhixin; Su, Qiang; Tang, Zhenjun; Ma, Huifang
errShare
errSave
LCM-Captioner: A lightweight text-based image captioning method with collaborative mechanism between vision and text
err2023-05-01
err11
PREAI
errWang, Qi; Deng, Hongyu; Wu, Xue; Yang, Zhenguo; Liu, Yun; Wang, Yazhou; Hao, Gefei
errShare
errSave
errShare
errSave
no more