arrow
返回

Additive autoencoder for dimension estimation

delete2023-09-01
delete5
delete
OA
AI
T
Tommi Kärkkäinen *
J
Jan Hänninen
DOI:10.1016/j.neucom.2023.126520delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Dimension reduction is one of the key data transformation techniques in machine learning and knowledge discovery. It can be realized by using linear and nonlinear transformation techniques. An additive autoencoder for dimension reduction, which is composed of a serially performed bias estimation, linear trend estimation, and nonlinear residual estimation, is proposed and analyzed. Compared to the classical model, adding an explicit linear operator to the overall transformation and considering the nonlinear residual estimation in the original data dimension significantly improves the data reproduction capabilities of the proposed model. The computational experiments confirm that an autoencoder of this form, with only a shallow network to encapsulate the nonlinear behavior, is able to identify an intrinsic dimension of a dataset with low autoencoding error. This observation leads to an investigation in which shallow and deep network structures, and how they are trained, are compared. We conclude that the deeper network structures obtain lower autoencoding errors during the identification of the intrinsic dimension. However, the detected dimension does not change compared to a shallow network. As far as we know, this is the first experimental result concluding no benefit from a deep architecture compared to its shallow counterpart.& COPY; 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Keyword:
Autoencoder
Dimension reduction
Intrinsic dimension
Deep learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
university of jyvaskyla
学者数:
6.3K
论文数: 6.8K
被引数: 12
引用论文

引用论文

err分享
err收藏
An Increased Lateral Femoral Condyle Ratio Is a Risk Factor for Anterior Cruciate Ligament Injury
err2018-05-16
err0
PREAI
errThomas R. Pfeiffer; Jeremy M. Burnham; Jonathan D. Hughes; Ajay C. Kanakamedala; Elmar Herbst; Adam Popchak; Sven Shafizadeh; James J. Irrgang; Richard E. Debski; Volker Musahl
err分享
err收藏
Infer-AVAE: An attribute inference model based on adversarial variational autoencoder
err2022-04-01
err4
errOAAI
errZhou, Yadong; Ding, Zhihao; Liu, Xiaoming; Shen, Chao; Tong, Lingling; Guan, Xiaohong
err分享
err收藏
Pediatric Auditory Brainstem Implant Users Compared With Cochlear Implant Users With Additional Disabilities
err2019-08-01
err0
PREAI
errTirza F. K. van der Straaten; Anouk P. Netten; Peter Paul B. M. Boermans; Jeroen J. Briaire; Esther Scholing; Radboud W. Koot; Martijn J. A. Malessy; Andel G. L. van der Mey; Berit M. Verbist; Johan H. M. Frijns
err分享
err收藏
err分享
err收藏
Autoencoder-based unsupervised clustering and hashing
err2020-08-19
err18
PREAI
errZhang, Bolin; Qian, Jiangbo
err分享
err收藏
学者 查看更多内容