arrow
返回

Multimodal speaker identification using an adaptive classifier cascade based on modality reliability

delete2005-10-01
delete47
delete
OA
AI
E
Engin Erzin
Y
Y. Yemez
A
A. Murat Tekalp
DOI:10.1109/TMM.2005.854464delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We present a multimodal open-set speaker identification system that integrates information coming from audio, face and lip motion modalities. For fusion of multiple modalities, we propose a new adaptive cascade rule that favors reliable modality combinations through a cascade of classifiers. The order of the classifiers in the cascade is adaptively determined based on the reliability of each modality combination. A novel reliability measure, that genuinely fits to the open-set speaker identification problem, is also proposed to assess accept or reject decisions of a classifier. A formal framework is developed based on probability of correct decision for analytical comparison of the proposed adaptive rule with other classifier combination rules. The proposed adaptive rule is more robust in the presence of unreliable modalities, and outperforms the hard-level max rule and soft-level weighted summation rule, provided that the employed reliability measure is effective in assessment of classifier decisions. Experimental results that support this assertion are provided.
Keyword:
classifier combining
modality reliability
multimodal speaker identification
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

暂无机构信息
引用论文

引用论文

Application of Artificial Intelligence in Targeting Retinal Diseases
err2020-09-18
err0
PREAI
errFrancesco Saverio Sorrentino; Giuseppe Jurman; Katia De Nadai; Claudio Campa; Cesare Furlanello; Francesco Parmeggiani
err分享
err收藏
Speaker recognition: A tutorial
err1997-01-01
err1.0K
errOAAI
errCampbell, JP
err分享
err收藏
err分享
err收藏
Photoinduced Electron and Energy Transfer in a Molecular Triad Featuring a Fullerene Redox Mediator
err2016-06-24
err0
errOAAI
errAntaeres Antoniuk-Pablant; Gerdenis Kodis; Ana L. Moore; Thomas A. Moore; Devens Gust
err分享
err收藏
err分享
err收藏
VANDERBILT UNIVERSITY SCHOOL OF MEDICINE
err1989-10-01
err0
PREAI
errARTHUR P. WHEELER; BARNEY S. GRAHAM
err分享
err收藏
Acoustic-labial speaker verification
err1997-09-01
err43
errOAAI
errJourlin, P; Luettin, J; Genoud, D; Wassner, H
err分享
err收藏
Association Between Antimicrobial Resistance inEscherichia coliIsolates from Food Animals and Blood Stream Isolates from Humans in Europe: An Ecological Study
err2011-12-01
err0
PREAI
errAntonio R. Vieira; Peter Collignon; Frank M. Aarestrup; Scott A. McEwen; Rene S. Hendriksen; Tine Hald; Henrik C. Wegener
err分享
err收藏
学者 查看更多内容