arrow
返回

Deep Audio-visual Learning: A Survey

delete2021-04-15
delete95
delete
OA
AI
H
Hao Zhu
M
Mandi Luo
王芮 封面图
王芮 (Rui Wang)
A
Aihua Zheng
赫然 封面图
赫然 (Ran He) *
DOI:10.1007/s11633-021-1293-0delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Audio-visual learning, aimed at exploiting the relationship between audio and visual modalities, has drawn considerable attention since deep learning started to be used successfully. Researchers tend to leverage these two modalities to improve the performance of previously considered single-modality tasks or address new challenging problems. In this paper, we provide a comprehensive survey of recent audio-visual learning development. We divide the current audio-visual learning tasks into four different subfields: audio-visual separation and localization, audio-visual correspondence learning, audio-visual generation, and audio-visual representation learning. State-of-the-art methods, as well as the remaining challenges of each subfield, are further discussed. Finally, we summarize the commonly used datasets and challenges.
Keyword:
Deep audio-visual learning
audio-visual separation and localization
correspondence learning
generative models
representation learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
International Journal of Automation and Computing
IF:
3.7
论文数:
144
被引数:
1.4K

机构

A
anhui university
学者数:
1.9W
论文数: 1.2W
被引数: 24
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Inorganic and organic contaminants in sediments from an urban playa and associated toxicity amongHyalella azteca
err2012-10-05
err0
PREAI
errDerek R. Faust; Nathan Knowles; Elaine Magruder; David A. Haukos; George P. Cobb; Jonathan D. Maul; Todd A. Anderson; Philip N. Smith
err分享
err收藏
Optimum Sensor Placement for Impact Location Using Trilateration
err2014-12-16
err0
errOAAI
errM. De Stefano; M. Gherlone; M. Mattone; M. Di Sciuva; K. Worden
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
学者 查看更多内容