返回
EmbraceNet: A robust deep learning architecture for multimodal classification
DOI:10.1016/j.inffus.2019.02.010.png)
摘要
En 中文
Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modalities. In this paper, we propose a novel deep learning-based multimodal fusion architecture for classification tasks, which guarantees compatibility with any kind of learning models, deals with cross-modal information carefully, and prevents performance degradation due to partial absence of data. We employ two datasets for multimodal classification tasks, build models based on our architecture and other state-of-the-art models, and analyze their performance on various situations. The results show that our architecture outperforms the other multimodal fusion architectures when some parts of data are not available.
Keyword:
Multimodal data fusion
deep learning
classification
data loss
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
15.5
论文数:
4.2K
被引数:
2.7W
机构
引用论文
Multispectral Periocular Classification With Multimodal Compact Multi-Linear Pooling
IEEE ACCESS
IF3.6
A review of affective computing: From unimodal analysis to multimodal fusion情感计算综述: 从单峰分析到多模态融合
INFORMATION FUSION
IF15.5
Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用
PROCEEDINGS OF THE IEEE
IF25.9

