.png){kind=icon}
返回
Audio-Visual Voice Activity Detection Using Diffusion Maps
.png){kind=icon}
PRE
AI
DOI：10.1109/TASLP.2015.2405481.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The performance of traditional voice activity detectors significantly deteriorates in the presence of highly nonstationary noise and transient interferences. One solution is to incorporate a video signal which is invariant to the acoustic environment. Although several voice activity detectors based on the video signal were recently presented, merely few detectors which are based on both the audio and the video signals exist in the literature to date. In this paper, we present an audio-visual voice activity detector and show that the incorporation of both audio and video signals is highly beneficial for voice activity detection. The algorithm is based on a supervised learning procedure, and a labeled training data set is considered. The algorithm comprises a feature extraction procedure, where the features are designed to separate speech from nonspeech frames. Diffusion maps is applied separately and similarly to the features of each modality and builds a low dimensional representation. Using the new representation, we propose a measure for voice activity which is based on a supervised learning procedure and the variability between adjacent frames in time. The measures of the two modalities are merged to provide voice activity detection based on both the audio and the video signals. Experimental results demonstrate the improved performance of the proposed algorithm compared to state-of-the-art detectors.
Keyword:
Audio-visual speech processing
diffusion maps
voice activity detection
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.2W
机构
引用论文
.png){kind=icon}
Der C4-Weg der C-Fixierung bei Spinacea oleracea II. Pulse-chase Experimente mit suspendierten Blattstreifen菠菜（Spinacea oleracea）的C4碳固定途径II.悬浮叶片条带脉冲- chase实验
PREAI
分享收藏Integrating Spectral Information and Meteorological Data to Monitor Wheat Yellow Rust at a Regional Scale: A Case Study整合光谱信息和气象数据以监测区域尺度的小麦黄锈病: 案例研究
OAAI
OAAI分享收藏分享收藏
查看更多内容