arrow
返回

A Tensor-Based Approach for Big Data Representation and Dimensionality Reduction

delete2014-09-01
delete142
delete
OA
AI
L
Liwei Kuang
F
Fei Hao
L
Laurence T. Yang *
M
Man Lin
C
Changqing Luo
G
Geyong Min
DOI:10.1109/TETC.2014.2330516delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Variety and veracity are two distinct characteristics of large-scale and heterogeneous data. It has been a great challenge to efficiently represent and process big data with a unified scheme. In this paper, a unified tensor model is proposed to represent the unstructured, semistructured, and structured data. With tensor extension operator, various types of data are represented as subtensors and then are merged to a unified tensor. In order to extract the core tensor which is small but contains valuable information, an incremental high order singular value decomposition (IHOSVD) method is presented. By recursively applying the incremental matrix decomposition algorithm, IHOSVD is able to update the orthogonal bases and compute the new core tensor. Analyzes in terms of time complexity, memory usage, and approximation accuracy of the proposed method are provided in this paper. A case study illustrates that approximate data reconstructed from the core set containing 18% elements can guarantee 93% accuracy in general. Theoretical analyzes and experimental results demonstrate that the proposed unified tensor model and IHOSVD method are efficient for big data representation and dimensionality reduction.
Keyword:
Tensor
HOSVD
dimensionality reduction
data representation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Emerging Topics in Computing 封面图
IEEE Transactions on Emerging Topics in Computing
IF:
5.4
论文数:
1.1K
被引数:
3.4K

机构

S
saint francis xavier university - canada
学者数:
761
论文数: 911
被引数: 0
U
University of Exeter
学者数:
2.0W
论文数: 2.1W
被引数: 3.6W
引用论文

引用论文

Protein-Protein Interactions During Starch Biosynthesis
err2015-01-01
err0
PREAI
errIan J. Tetlow; Fushan Liu; Michael J. Emes
err分享
err收藏
Tensor Decompositions and Applications张量分解及其应用
err2009-08-05
err7.5K
PREAI
errKolda, Tamara G.; Bader, Brett W.
err分享
err收藏
GATE Validation of Standard Dual Energy Corrections in Small Animal SPECT-CT
err2015-04-07
err0
errOAAI
errSanghyeb Lee; Jens Gregor; Stephen J. Kennel; Dustin R. Osborne; Jonathan Wall
err分享
err收藏
Genetic changes in localized prostate cancer of Japanese patients shown by comparative genomic hybridization
err2005-05-01
err0
PREAI
errKotaro Kasahara; Takahiro Taguchi; Ichiro Yamasaki; Masayuki Kamada; Taro Shuin
err分享
err收藏
Unmeasured Investment and the Puzzling U.S. Boom in the 1990s
err
IF0
err2007-10-01
err0
errOAAI
errEllen McGrattan; Edward Prescott
err分享
err收藏
On the rate of successful transmissions in finite slotted Aloha MANETs
err2017-07-01
err0
PREAI
errYin Chen; Jinxiao Zhu; Yulong Shen; Xiaohong Jiang; Hideyuki Tokuda
err分享
err收藏
Pilot Study of Corneal Sensitivity and Its Association in Keratoconus
err2017-02-01
err0
PREAI
errPreeji S. Mandathara; Fiona J. Stapleton; Jim Kokkinakis; Mark D. P. Willcox
err分享
err收藏
The H.264/MP.EG4 advanced video coding standard and its applications
err2006-08-01
err329
PREAI
errMarpe, Detlev; Wiegand, Thomas; Sullivan, Gary J.
err分享
err收藏
学者 查看更多内容