.png){kind=icon}
返回
Local Self-attention-based Hybrid Multiple Instance Learning for Partial Spoof Speech Detection
.png){kind=icon}
PRE
AI
DOI：10.1145/3616540.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The development of speech synthesis technology has increased the attention toward the threat of spoofed speech. Although various high-performance spoofing countermeasures have been proposed in recent years, a particular scenario is overlooked: partially spoofed audio, where spoofed utterances may contain both spoofed and bona fide segments. Currently, the research on partially spoofed speech detection is lacking. The existing methods either train with partially spoofed speech at utterance level, resulting in gradient conflicting at the segment level, or directly train with segment level data, which requires segment labels that are difficult to obtain in practice. In this study, to better detect partially spoofed speech when only utterance labels are available, we formulate partially spoofed speech detection into a multiple instance learning (MIL) problem. The typical MIL uses a pooling layer to fuse patch scores as a whole, and we propose a hybrid MIL (H-MIL) framework based on max and log-sum-exp pooling methods, which can learn better segment representations to improve partially spoofed speech detection performance. Theoretical and experimental verification shows that H-MIL can effectively relieve the gradient conflicting and gradient vanishing problems. In addition, we analyze the local correlations between segments and introduce a local self-attention mechanism to enhance segment features, which further promotes the detection performance. In our experiments, we provide not only detection results at the segment and utterance levels but also some detailed visualization analysis, including the effect of spoof ratio and cross-dataset detection. The experimental results demonstrate the effective detection performance of our method at both the utterance and segment levels, especially when dealing with low spoof ratio attacks. The results confirm that our approach can better deal with partially spoofed speech detection than previous methods.
Keyword:
Partial spoof
multiple instance learning
gradient
hybrid
local selfattention
期刊
IF:
6.6
论文数:
1.5K
被引数:
6.2K
机构
引用论文
Constructing interface engineering and tailoring a nanoflower-like FeP/CoP heterostructure for enhanced oxygen evolution reaction.png)
RSC Advances
OAAI
RSC AdvancesIF0
OAAI分享收藏分享收藏分享收藏Integrating Spectral Information and Meteorological Data to Monitor Wheat Yellow Rust at a Regional Scale: A Case Study整合光谱信息和气象数据以监测区域尺度的小麦黄锈病: 案例研究
OAAI
OAAI分享收藏
查看更多内容