arrow
返回

Multimodal Task-Driven Dictionary Learning for Image Classification

delete2016-01-01
delete138
delete
OA
AI
B
Bahrampour, Soheil *
N
Nasrabadi, Nasser M.
R
Ray, Asok
J
Jenkins, William Kenneth
DOI:10.1109/TIP.2015.2496275delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Dictionary learning algorithms have been successfully used for both reconstructive and discriminative tasks, where an input signal is represented with a sparse linear combination of dictionary atoms. While these methods are mostly developed for single-modality scenarios, recent studies have demonstrated the advantages of feature-level fusion based on the joint sparse representation of the multimodal inputs. In this paper, we propose a multimodal task-driven dictionary learning algorithm under the joint sparsity constraint (prior) to enforce collaborations among multiple homogeneous/heterogeneous sources of information. In this task-driven formulation, the multimodal dictionaries are learned simultaneously with their corresponding classifiers. The resulting multimodal dictionaries can generate discriminative latent features (sparse codes) from the data that are optimized for a given task such as binary or multiclass classification. Moreover, we present an extension of the proposed formulation using a mixed joint and independent sparsity prior, which facilitates more flexible fusion of the modalities at feature level. The efficacy of the proposed algorithms for multimodal classification is illustrated on four different applications-multimodal face recognition, multi-view face recognition, multi-view action recognition, and multimodal biometric recognition. It is also shown that, compared with the counterpart reconstructive-based dictionary learning algorithms, the task-driven formulations are more computationally efficient in the sense that they can be equipped with more compact dictionaries and still achieve superior performance.
Keyword:
Dictionary learning
multimodal classification
sparse representation
feature fusion

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.1W
被引数:
10.8W

机构

P
pennsylvania state university-university park
学者数:
2
论文数: 1
被引数: 1.1W
P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
0
论文数: 1.7K
被引数: 8.3W
引用论文

引用论文

The ISICOM Architecture
err2009-09-01
err0
PREAI
errAlessandro Vanelli-Coralli; Giovanni E. Corazza; Michele Luglio; Stefano Cioni
err分享
err收藏
Dense Trajectories and Motion Boundary Descriptors for Action Recognition
err2013-03-06
err1.3K
errOAAI
errWang, Heng; Klaeser, Alexander; Schmid, Cordelia; Liu, Cheng-Lin
err分享
err收藏
Health related quality of life in patients with Cohn's disease in remission
err2010-11-01
err0
errOAAI
errM. Iglesias; I. Vázquez; M. Barreiro de Acosta; A. Figueiras; L. Nieto; M. Piñeiro; R. Gómez; A. Lorenzo; J. E. Domínguez Muñoz
err分享
err收藏
学者 查看更多内容