.png){kind=icon}
返回
Fast Query-by-Example Speech Search Using Attention-Based Deep Binary Embeddings
.png){kind=icon}
PRE
AI
DOI：10.1109/TASLP.2020.2998277.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
State-of-the-art query-by-example (QbE) speech search approaches usually use recurrent neural network (RNN) based acoustic word embeddings (AWEs) to represent variable-length speech segments with fixed-dimensional vectors, and thus simple cosine distances can be measured over the embedded vectors of both the spoken query and the search content. In this paper, we aim to improve search accuracy and speed for the AWE-based QbE approach in low-resource scenario. First, multi-head self-attentive mechanism is introduced for learning a sequence of attention weights for all time steps of RNN outputs while attending to different positions of a speech segment. Second, as the real-valued AWEs suffer from substantial computation in similarity measure, a hashing layer is adopted for learning deep binary embeddings, and thus binary pattern matching can be directly used for fast QbE speech search. The proposed approach of self-attentive deep hashing network is effectively trained with three specifically-designed objectives: a penalization term, a triplet loss, and a quantization loss. Experiments show that our approach improves the relative search speed by 8 times and mean average precision (MAP) by 18.9%, as compared with the previous best real-valued embedding approach.
Keyword:
Acoustics
Task analysis
Speech processing
Quantization (signal)
Image retrieval
Recurrent neural networks
Pattern matching
Attention mechanism
deep binary embeddings
low-resource
query-by-example
temporal context
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
Total Phenols and Sugar Content in Wheat Cultivars Resistant and Susceptible to Ustilago nuda (JENS.) Rostrup小麦抗病与感病品种中总酚和糖含量
PREAI
分享收藏Classification of genetic diversity for drought tolerance in maize genotypes through principal component analysis通过主成分分析对玉米基因型耐旱性的遗传多样性进行分类
OAAI
OAAI分享收藏A Hierarchical Structured Self-Attentive Model for Extractive Document Summarization (HSSAS).png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏分享收藏Genome-wide analysis of circular RNAs in goat skin fibroblast cells in response to Orf virus infectionPeerJOAAI
PeerJIF0
OAAI分享收藏
查看更多内容