arrow
返回

Deep representation design from deep kernel networks

delete2019-04-01
delete12
delete
OA
AI
酒明远 封面图
酒明远 (Mingyuan Jiu) *
H
Hichem Sahbi
DOI:10.1016/j.patcog.2018.12.005delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Deep kernel learning aims at designing nonlinear combinations of multiple standard elementary kernels by training deep networks. This scheme has proven to be effective, but intractable when handling large-scale datasets especially when the depth of the trained networks increases; indeed, the complexity of evaluating these networks scales quadratically w.r.t. the size of training data and linearly w.r.t. the depth of the trained networks. In this paper, we address the issue of efficient computation in Deep Kernel Networks (DKNs) by designing effective maps in the underlying Reproducing Kernel Hilbert Spaces (RKHS). Given a pretrained DKN, our method builds its associated Deep Map Network (DMN) whose inner product approximates the original network while being far more efficient. The design principle of our method is greedy and achieved layer-wise, by finding maps that approximate DKNs at different (input, intermediate and output) layers. This design also considers an extra fine-tuning step based on unsupervised learning, that further enhances the generalization ability of the trained DMNs. When plugged into SVMs, these DMNs turn out to be as accurate as the underlying DKNs while being at least an order of magnitude faster on large-scale datasets, as shown through extensive experiments on the challenging ImageCLEF, COREL5k benchmarks and the Banana dataset. (C) 2018 Elsevier Ltd. All rights reserved.
Keyword:
Multiple kernel learning
Kernel design
Deep networks
Efficient computation
Image annotation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

Z
Zhengzhou University
学者数:
6.8W
论文数: 4.4W
被引数: 8.5W
S
Sorbonne Universite
学者数:
6.2W
论文数: 4.5W
被引数: 605
引用论文

引用论文

Nystrom-based approximate kernel subspace learning
err2016-09-01
err22
PREAI
errIosifidis, Alexandros; Gabbouj, Moncef
err分享
err收藏
err分享
err收藏
Data-independent Random Projections from the feature-space of the homogeneous polynomial kernel
err2018-10-01
err7
errOAAI
errLopez-Sanchez, Daniel; Arrieta, Angelica Gonzalez; Corchado, Juan M.
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容