logo
科言猫学术研究的AI总结
language
手机端手机端
  • Phone Feature微信小程序
简体中文简体中文
notice消息通知
博客博客
delete
arrow
返回

MARS: Multimodal-Assisted Refined Semantic Alignment

delete2025-08-07
delete0
PRE
AI
J
Junjie Xu
X
Xingjiao Wu *
Z
Zihao Zhang
S
Shuwen Yang
T
Tianlong Ma
D
Daoguo Dong
何亮 封面图
何亮 (Liang He)
DOI：10.1016/j.ipm.2025.104292delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
• MARS优化了基于音频的图像生成的语义对齐。 • 一个基于Mamba的编码器处理长音频序列。 • MLLMs提供丰富的视觉内容以增强语义和美学效果。 • 大量实验证明了其有效性和鲁棒性。
Keyword:
Audio-Based image generation
Audio-visual learning
Multimodal alignment
Contrastive learning

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

E
east china normal university
学者数:
3.1W
论文数: 2.1W
被引数: 25
引用论文

引用论文

Vggsound: A Large-Scale Audio-Visual Dataset
errICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
IF0
err2020-05-01
err0
errOAAI
errHonglie Chen; Weidi Xie; Andrea Vedaldi; Andrew Zisserman
err分享
err收藏
Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation
err2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
IF0
err2021-06-01
err0
errOAAI
errYapeng Tian; Di Hu; Chenliang Xu
err分享
err收藏
High-Resolution Image Synthesis with Latent Diffusion Models具有潜在扩散模型的高分辨率图像合成
err2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
IF0
err2022-06-01
err0
errOAAI
errRobin Rombach; Andreas Blattmann; Dominik Lorenz; Patrick Esser; Bjorn Ommer
err分享
err收藏
Towards Audio to Scene Image Synthesis Using Generative Adversarial Network
errICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
IF0
err2019-05-01
err0
errOAAI
errChia-Hung Wan; Shun-Po Chuang; Hung-Yi Lee
err分享
err收藏
Sound-Guided Semantic Image Manipulation
err2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
IF0
err2022-06-01
err0
errOAAI
errSeung Hyun Lee; Wonseok Roh; Wonmin Byeon; Sang Ho Yoon; Chanyoung Kim; Jinkyu Kim; Sangpil Kim
err分享
err收藏
Wav2CLIP: Learning Robust Audio Representations from Clip
errICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
IF0
err2022-05-23
err0
errOAAI
errHo-Hsiang Wu; Prem Seetharaman; Kundan Kumar; Juan Pablo Bello
err分享
err收藏
Multi-level semantics probability embedding for image-text matching
errINFORMATION PROCESSING & MANAGEMENT
IF6.9
err2025-03-01
err0
PREAI
errLiu, An-An; Yang, Long; Li, Wenhui; Nie, Weizhi; Liu, Xianzhu; Chen, Haipeng
err分享
err收藏
Rare-aware attention network for image-text matching
errINFORMATION PROCESSING & MANAGEMENT
IF6.9
err2023-05-01
err11
PREAI
errWang, Yan; Su, Yuting; Li, Wenhui; Sun, Zhengya; Wei, Zhiqiang; Nie, Jie; Li, Xuanya; Liu, An-An
err分享
err收藏
Learning Relationships between Text, Audio, and Video via Deep Canonical Correlation for Multimodal Language Analysis
errProceedings of the AAAI Conference on Artificial Intelligence
IF0
err2020-04-03
err0
errOAAI
errZhongkai Sun; Prathusha Sarma; William Sethares; Yingyu Liang
err分享
err收藏
Visual to Sound: Generating Natural Sound for Videos in the Wild
err2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
IF0
err2018-06-01
err0
errOAAI
errYipin Zhou; Zhaowen Wang; Chen Fang; Trung Bui; Tamara L. Berg
err分享
err收藏
学者 查看更多内容