arrow
返回

EmbraceNet: A robust deep learning architecture for multimodal classification

delete2019-11-01
delete99
delete
OA
AI
C
Choi, Jun-Ho
L
Lee, Jong-Seok *
DOI:10.1016/j.inffus.2019.02.010delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modalities. In this paper, we propose a novel deep learning-based multimodal fusion architecture for classification tasks, which guarantees compatibility with any kind of learning models, deals with cross-modal information carefully, and prevents performance degradation due to partial absence of data. We employ two datasets for multimodal classification tasks, build models based on our architecture and other state-of-the-art models, and analyze their performance on various situations. The results show that our architecture outperforms the other multimodal fusion architectures when some parts of data are not available.
Keyword:
Multimodal data fusion
deep learning
classification
data loss
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Information Fusion 封面图
Information Fusion
IF:
15.5
论文数:
4.2K
被引数:
2.7W

机构

Y
Yonsei University
学者数:
4.8W
论文数: 4.6W
被引数: 5.2W
引用论文

引用论文

Malfunction of SynchroMed II Baclofen Pump Delivers a Near-Lethal Baclofen Overdose
err2010-06-01
err0
PREAI
errS. Sgouros; C. Charalambides; P. Matsota; I. Tsangaris; G. Kostopanagiotou
err分享
err收藏
Multispectral Periocular Classification With Multimodal Compact Multi-Linear Pooling
err2017-01-01
err16
errOAAI
errAlgashaam, Faisal M.; Kien Nguyen; Alkanhal, Mohamed; Chandran, Vinod; Boles, Wageeh; Banks, Jasmine
err分享
err收藏
QFuse: Online learning framework for adaptive biometric system
err2015-11-01
err17
PREAI
errBharadwaj, Samarth; Bhatt, Himanshu S.; Singh, Richa; Vatsa, Mayank; Noore, Afzel
err分享
err收藏
YFCC100M: The New Data in Multimedia ResearchYFCC100M: 多媒体研究中的新数据
err2016-01-25
err1.1K
errOAAI
errThomee, Bart; Elizalde, Benjamin; Shamma, David A.; Ni, Karl; Friedland, Gerald; Poland, Douglas; Borth, Damian; Li, Li-Jia
err分享
err收藏
Deep Multimodal Fusion: A Hybrid Approach深度多模式融合: 一种混合方法
err2017-02-20
err29
PREAI
errAmer, Mohamed R.; Shields, Timothy; Siddiquie, Behjat; Tamrakar, Amir; Divakaran, Ajay; Chai, Sek
err分享
err收藏
学者 查看更多内容