arrow
返回

Sparse Coding Neural Gas: Learning of overcomplete data representations

delete2009-03-01
delete39
PRE
AI
K
Kai Labusch *
E
Erhardt Barth
T
Thomas Martinetz
DOI:10.1016/j.neucom.2008.11.027delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We consider the problem of learning an unknown (overcomplete) basis from data that are generated from unknown and sparse linear combinations. Introducing the Sparse Coding Neural Gas algorithm, we show how to employ a combination of the original Neural Gas algorithm and Oja's rule in order to learn a simple sparse code that represents each training sample by only one scaled basis vector. We generalize this algorithm by using Orthogonal Matching Pursuit in order to learn a sparse code where each training sample is represented by a linear combination of up to k basis elements. We evaluate the influence of additive noise and the coherence of the original basis on the performance with respect to the reconstruction of the original basis and compare the new method to other state of the art methods. For this analysis, we use artificial data where the original basis is known. Furthermore, we employ our method to learn an overcomplete representation for natural images and obtain an appealing set of basis functions that resemble the receptive fields of neurons in the primary visual cortex. An important result is that the algorithm converges even with a high degree of overcompleteness. A reference implementation of the methods is provided.(1) (C) 2009 Elsevier B.V. All rights reserved.
Keyword:
Sparse coding
Vector quantization
Matching Pursuit
Unsupervised learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
University of Lubeck
学者数:
7.7K
论文数: 5.3K
被引数: 1.5W
引用论文

引用论文

err分享
err收藏
Nicotinamide, a SIRT1 inhibitor, inhibits differentiation and facilitates expansion of hematopoietic progenitor cells with enhanced bone marrow homing and engraftment
err2012-04-01
err0
errOAAI
errTony Peled; Hadas Shoham; Dorit Aschengrau; Dima Yackoubov; Gabi Frei; Noga Rosenheimer G; Batya Lerrer; Haim Y. Cohen; Arnon Nagler; Eitan Fibach; Amnon Peled
err分享
err收藏
学者 查看更多内容