arrow
返回

Deep mutual information multi-view representation for visual recognition

delete2022-04-27
delete1
PRE
AI
X
Xianfa Xu
陈
陈喆 (Zhe Chen) *
F
Fuliang Yin
DOI:10.1007/s10489-022-03462-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-view representation is a crucial but challenging issue in visual recognition task. To address this issue, a deep mutual information multi-view representation method is proposed in this paper. Firstly, multi-view inputs are fed to the encoder module of the variational auto encoder architecture to extract multi-view latent layer features. Secondly, the correlation between local features and latent layer features of each view is calculated by maximizing the mutual information. Meanwhile, to obtain a robust multi-view representation, the multi-view canonical correlation analysis and the mutual information maximization methods are used to calculate the canonical correlation of different view mean vectors and the information correlation of different view distributions, respectively. Finally, the supervised loss is used to improve the discriminability of the middle feature layers. The proposed method can obtain a more robust hidden layer representations and operate multi-view scenes with more than two views. Experimental results demonstrate that the proposed method achieves better recognition accuracy than other compared methods among five publicly available datasets.
Keyword:
Multi-view representation
Mutual information
Multi-view canonical correlation analysis
Variational auto encoder
Neural network

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

D
Dalian University of Technology
学者数:
6.0W
论文数: 4.4W
被引数: 5.5W
引用论文

引用论文

Generalized Semi-supervised and Structured Subspace Learning for Cross-Modal Retrieval
err2018-01-01
err112
PREAI
errZhang, Liang; Ma, Bingpeng; Li, Guorong; Huang, Qingming; Tian, Qi
err分享
err收藏
Is Mitochondrial Dysfunction a Common Root of Noncommunicable Chronic Diseases?
err2020-03-16
err0
errOAAI
errAlexis Diaz-Vegas; Pablo Sanchez-Aguilera; James R Krycer; Pablo E Morales; Matías Monsalves-Alvarez; Mariana Cifuentes; Beverly A Rothermel; Sergio Lavandero
err分享
err收藏
Use of used clay from oil production
err2006-11-01
err0
PREAI
errG. D. Lyakhevich; V. A. Grechukhin; A. G. Lyakhevich
err分享
err收藏
Reevaluation of the 2-deoxyribose assay for determination of free radical formation
err2009-12-01
err0
errOAAI
errThiago C. Genaro-Mattos; Luana T. Dalvi; Ricardo G. Oliveira; Janini S. Ginani; Marcelo Hermes-Lima
err分享
err收藏
err分享
err收藏
Cross-Modal Hashing via Rank-Order Preserving
err2017-03-01
err63
PREAI
errDing, Kun; Fan, Bin; Huo, Chunlei; Xiang, Shiming; Pan, Chunhong
err分享
err收藏
Upfront FOLFOXIRI plus bevacizumab and reintroduction after progression versus mFOLFOX6 plus bevacizumab followed by FOLFIRI plus bevacizumab in the treatment of patients with metastatic colorectal cancer (TRIBE2): a multicentre, open-label, phase 3, randomised, controlled trial
err2020-04-01
err0
errOAAI
errChiara Cremolini; Carlotta Antoniotti; Daniele Rossini; Sara Lonardi; Fotios Loupakis; Filippo Pietrantonio; Roberto Bordonaro; Tiziana Pia Latiano; Emiliano Tamburini; Daniele Santini; Alessandro Passardi; Federica Marmorino; Roberta Grande; Giuseppe Aprile; Alberto Zaniboni; Sabina Murgioni; Cristina Granetto; Angela Buonadonna; Roberto Moretto; Salvatore Corallo; Stefano Cordio; Lorenzo Antonuzzo; Gianluca Tomasello; Gianluca Masi; Monica Ronzoni; Samantha Di Donato; Chiara Carlomagno; Matteo Clavarezza; Giuliana Ritorto; Andrea Mambrini; Mario Roselli; Samanta Cupini; Serafina Mammoliti; Elisabetta Fenocchio; Enrichetta Corgna; Vittorina Zagonel; Gabriella Fontanini; Clara Ugolini; Luca Boni; Alfredo Falcone; Alfredo Falcone; Sara Lonardi; Filippo Guglielmo Maria De Braud; Roberto Bordonaro; Evaristo Maiello; Emiliano Tamburini; Daniele Santini; Giovanni Luca Frassineti; Teresa Gamucci; Giuseppe Aprile; Alberto Zaniboni; Cristina Granetto; Angela Buonadonna; Francesco Di Costanzo; Gianluca Tomasello; Luca Gianni; Samantha Di Donato; Chiara Carlomagno; Matteo Clavarezza; Patrizia Racca; Andrea Mambrini; Mario Roselli; Giacomo Allegrini; Alberto Sobrero; Massimo Aglietta; Enrichetta Corgna; Enrico Cortesi; Domenico Cristiano Corsi; Alberto Ballestrero; Andrea Bonetti; Francesco Di Clemente; Enzo Ruggeri; Fortunato Ciardiello; Marco Benasso; Stefano Vitello; Saverio Cinieri; Stefania Mosconi; Nicola Silvestris; Antonio Frassoldati; Samantha Cupini; Alessandro Bertolini; Giampaolo Tortora; Carmelo Bengala; Daris Ferrari; Antonia Ardizzoia; Carlo Milandri; Silvana Chiara; Gianpiero Romano; Stefania Miraglia; Laura Scaltriti; Francesca Pucci; Livio Blasi; Silvia Brugnatelli; Luisa Fioretto; Angela Stefania Ribecco; Raffaella Longarini; Michela Frisinghelli; Maria Banzi
err分享
err收藏
学者 查看更多内容