arrow
Return

Deep multiple multilayer kernel learning in core vector machines

delete2018-04-01
delete13
PRE
AI
S
S. Asharaf
DOI:10.1016/j.eswa.2017.11.058delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Over the last few years, we have been witnessing a dramatic progress of deep learning in many real world applications. Deep learning concepts have been originated in the area of neural network and show a quantum leap in effective feature learning techniques such as auto-encoders, convolutional neural networks, recurrent neural networks etc. In the case of kernel machines, there are several attempts to model learning machines that mimic deep neural networks. In this direction, Multilayer Kernel Machines (MKMs) was an attempt to build a kernel machine architecture with multiple layers of feature extraction. It composed of many layers of kernel PCA based feature extraction units with support vector machine having arc-cosine kernel as the final classifier. The other approaches like Multiple Kernel Learning (MKL) and deep core vector machines solve the fixed kernel computation problem and scalability aspects of MKMs respectively. In addition to this, there are lot of avenues where the use of unsupervised MKL with both single and multilayer kernels in the multilayer feature extraction framework have to be evaluated. In this context, this paper attempts to build a scalable deep kernel machines with multiple layers of feature extraction. Each kernel PCA based feature extraction layer in this framework is modeled by the combination of both single and multilayer kernels in an unsupervised manner. Core vector machine with arc-cosine kernel is used as the final layer classifier which ensure the scalability in this model. The major contribution of this paper is a novel effort to build a deep structured kernel machine architecture similar to deep neural network architecture for classification. It opens up an extendable research avenue for researchers in deep learning based intelligent system leveraging the principles of kernel theory. Experiments show that the proposed method consistently improves the generalization performances of existing deep core vector machine. (C) 2017 Elsevier Ltd. All rights reserved.
Keywords:
Deep kernel machines
Unsupervised MKL
Core vector machines
Scalability
Arc-cosine kernel
Multilayer kernel learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
Fintech, financial inclusion and income inequality: a quantile regression approach
err2020-06-01
err0
errOAAI
errAyse Demir; Vanesa Pesqué-Cela; Yener Altunbas; Victor Murinde
errShare
errSave
errShare
errSave
Chemical Composition and Immunohistological Variations of a Growing Bamboo Shoot
err2013-06-01
err0
PREAI
errWan-Jung Chang; Mao-Ju Chang; Shang-Tzen Chang; Ting-Feng Yeh
errShare
errSave
Friction Models and Friction Compensation
err1998-01-01
err0
PREAI
errH. Olsson; K.J. Åström; C. Canudas de Wit; M. Gäfvert; P. Lischinsky
errShare
errSave
Support-vector networks
err1995-09-01
err0
errOAAI
errCorinna Cortes; Vladimir Vapnik
errShare
errSave
Deep Neural Networks for Acoustic Modeling in Speech Recognition
err2012-11-01
err8.2K
PREAI
errHinton, Geoffrey; Deng, Li; Yu, Dong; Dahl, George E.; Mohamed, Abdel-rahman; Jaitly, Navdeep; Senior, Andrew; Vanhoucke, Vincent; Patrick Nguyen; Sainath, Tara N.; Kingsbury, Brian
errShare
errSave
researcher View more