arrow
Return

CLIP-based knowledge projector for image–text matching

delete2025-08-23
delete0
PRE
AI
X
Xinfeng Dong
D
Dingwen Zhang
L
Longfei Han
M
Ming Jin *
刘
刘丽 (Li Liu)
J
Junwei Han
DOI:10.1016/j.ipm.2025.104357delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• We put forward a knowledge projector network which regards prior knowledge in CLIP (Radford et al., 2021) as a teacher to guide slot attention generation process. • An adaptive weighted fusion module is used to incorporate global features into slot representations. • An effective similarity calculation method is proposed to compare with fine-grained image–text matching methods. The results indicate that our method outperforms CLIP and the most recent image–text alignment algorithms.
Keywords:
Image–text matching
Multimedia analysis
Slot attention

Journal

I
Information Processing and Management
IF:
6.9
Papers:
5.2K
Citations:
1.4W

Organization

B
Beijing Technology and Business University
Scholars:
4.1K
Papers: 1.7K
Citations: 1.6W
N
Northwestern Polytechnical University
Scholars:
4.6W
Papers: 3.7W
Citations: 5.3W
S
shandong normal university
Scholars:
1.0W
Papers: 8.2K
Citations: 3
researcher View more organizations
Cited Papers

Cited Papers

SCOUTER: Slot Attention-based Classifier for Explainable Image Recognition
err2021-10-01
err0
errOAAI
errLiangzhi Li; Bowen Wang; Manisha Verma; Yuta Nakashima; Ryo Kawasaki; Hajime Nagahara
errShare
errSave
UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
err2021-06-01
err0
errOAAI
errMingyang Zhou; Luowei Zhou; Shuohang Wang; Yu Cheng; Linjie Li; Zhou Yu; Jingjing Liu
errShare
errSave
Rare-aware attention network for image-text matching
err2023-05-01
err11
PREAI
errWang, Yan; Su, Yuting; Li, Wenhui; Sun, Zhengya; Wei, Zhiqiang; Nie, Jie; Li, Xuanya; Liu, An-An
errShare
errSave
Multi-SEA: Multi-stage Semantic Enhancement and Aggregation for image-text retrieval
err2025-06-06
err0
PREAI
errTian, Zijing; Ou, Zhonghong; Zhu, Yifan; Lyu, Shuai; Zhang, Hanyu; Xiao, Jinghua; Song, Meina
errShare
errSave
researcher View more