Scene adaptive dynamic multi-modal knowledge for video captioning

doi:10.1016/j.eswa.2025.130820

2025-12-20

PRE

DOI：10.1016/j.eswa.2025.130820

原文链接

原文求助

摘要

En 中文

• 将静态概念和动态上下文整合到Dynamic Multi-modal Knowledge中。 • 开发带有结构化Dynamic Multi-modal Knowledge的视频字幕模型。 • 引入上下文感知的自适应融合，用于细粒度多模态去噪。 • 应用属性引导的硬负样本对比对齐，进行跨模态匹配。 • 在定量和定性实验中展示了具有竞争力的性能。

期刊

Expert Systems with Applications

IF:

7.5

论文数:

2.9W

被引数:

10.2W

机构

暂无机构信息

引用论文

Retrieval Augmented Convolutional Encoder-decoder Networks for Video Captioning

ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS

IF6

2023-01-23

PREAI

Chen, Jingwen; Pan, Yingwei; Li, Yehao; Yao, Ting; Chao, Hongyang; Mei, Tao

Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks 更快的r-cnn: 基于区域建议网络的实时目标检测

IEEE Transactions on Pattern Analysis and Machine Intelligence

IF0

2017-06-01

OAAI

Shaoqing Ren; Kaiming He; Ross Girshick; Jian Sun

Emotional Video Captioning With Vision-Based Emotion Interpretation Network 基于视觉的情感解释网络的情感视频字幕

IEEE TRANSACTIONS ON IMAGE PROCESSING

IF13.7

2024-01-01

PREAI

Song, Peipei; Guo, Dan; Yang, Xun; Tang, Shengeng; Wang, Meng

Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations 视觉基因组: 使用众包密集图像注释连接语言和视觉

INTERNATIONAL JOURNAL OF COMPUTER VISION

IF9.3

2017-02-06

3.1K

OAAI

Krishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei

Boosting Entity-Aware Image Captioning With Multi-Modal Knowledge Graph 利用多模态知识图谱提升实体感知图像字幕

IEEE TRANSACTIONS ON MULTIMEDIA

IF9.7

2024-01-01