arrow
Return

Zero-shot diverse audio captioning with diffusion models

delete2025-12-29
delete0
PRE
AI
Y
Yonggang Zhu
Z
Zhang, Yiming
L
Li Xiao
W
Wenwu Wang
A
Aidong Men
DOI:10.1016/j.knosys.2025.115205delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• Combine diversity and zero-shot (ZS) abilities in audio captioning for the first time. • Discover noise-induced condition degradation and tackle it with condition tiling. • Adapt alignment models without audio to enable retrieval-guided Langevin dynamics. • On major benchmarks, boost diversity over prior ZS work and fix baseline accuracy gap.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

B
Beijing University of Posts and Telecommunications
Scholars:
2.6K
Papers: 1.2K
Citations: 4.2K
U
University of Surrey
Scholars:
1.2W
Papers: 1.3W
Citations: 22
Cited Papers

Cited Papers

Diff-PC: Identity-preserving and 3D-aware controllable diffusion for zero-shot portrait customization
err2025-05-01
err1
PREAI
errZhai, Benxiang; Zhang, Chenyu; Li, Ming; Li, Yang; Du, Sidan
errShare
errSave
WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Research
err2024-01-01
err8
errOAAI
errMei, Xinhao; Meng, Chutong; Liu, Haohe; Kong, Qiuqiang; Ko, Tom; Zhao, Chengqi; Plumbley, Mark D.; Zou, Yuexian; Wang, Wenwu
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
AudioLDM 2: Learning Holistic Audio Generation With Self-Supervised Pretraining
err2024-01-01
err8
errOAAI
errLiu, Haohe; Yuan, Yi; Liu, Xubo; Mei, Xinhao; Kong, Qiuqiang; Tian, Qiao; Wang, Yuping; Wang, Wenwu; Wang, Yuxuan; Plumbley, Mark D.
errShare
errSave
AudioSetCaps: An Enriched Audio-Caption Dataset Using Automated Generation Pipeline With Large Audio and Language Models
err2025-01-01
err0
PREAI
errBai,Jisheng; Liu,Haohe; Wang,Mou; Shi,Dongyuan; Wang,Wenwu; Plumbley,Mark D.; Gan,Woon-Seng; Chen,Jianfeng
errShare
errSave
researcher View more