.png){kind=icon}
返回
Multi-Label Classification With Hyperdimensional Representations
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3299881.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Hyperdimensional computing (HDC) is a computational paradigm that leverages the mathematical properties of high-dimensional vector spaces to manipulate data as symbolic entities using a set of neurally plausible operations. Although HDC has demonstrated remarkable success in cognitive tasks, its potential in complex applications such as multi-label classificati has yet to be explored. In this research paper, we introduce three approaches to multi-label classification that strike a balance between computational efficiency and accuracy, based on the complexity of the problem. The first approach we propose is Power Set HD, a transformation method that is ideal for small-scale multi-label classification with label cardinality less than four and label set size less than ten. The second approach, One-vs-All HD, is another transformation method that is suitable for slightly more complex tasks with higher label cardinality, providing a better efficiency-accuracy trade-off over Power Set HD. However, due to the expensive linear complexity scaling of One-vs-All HD, we propose a novel neural approach called TinyXML HD for extreme scale tasks. This method learns hyperdimensional representations by decomposing the learning problem into multiple sub-problems, which are solved neurally through gradient-based optimization. Importantly, TinyXML HD fixes the output size of the model to the dimensionality of the hypervector, regardless of the label size, thereby scaling only by a small constant when evaluated on datasets with extremely large label spaces. Our approaches offer a valuable trade-off between computational efficiency and accuracy. We show that our methods provide a speedup of 16-60x on state of the art datasets, while maintaining comparable accuracy. Furthermore, our methods yield models that are 56x smaller on medium-scale tasks and up to 836x smaller on extreme-scale datasets, which is a significant reduction in model size while still achieving high accuracy.
Keyword:
Hyperdimensional computing
multi-label classification
deep learning
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Definitive evidence that a single N-glycan among three glycans on inducible costimulator is required for proper protein trafficking and ligand binding明确的证据表明，在可诱导的共刺激物上的三个聚糖中，单个N-聚糖对于适当的蛋白质运输和配体结合是必需的
PREAI
分享收藏Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random Vectors超维计算: 高维随机向量分布式表示计算简介
PREAI
分享收藏GeneMANIA: a real-time multiple association network integration algorithm for predicting gene functionGeneMANIA: 一种预测基因功能的实时多关联网络集成算法.png)
GENOME BIOLOGY
OAAI
GENOME BIOLOGYIF9.4
OAAI分享收藏Improved Particle Size Control for the Dispersion Polymerization of Methyl methacrylate in Supercritical Carbon Dioxide超临界二氧化碳中甲基丙烯酸甲酯分散聚合的改进粒度控制OAAI
OAAI分享收藏Impact of Age at Administration, Lysosomal Storage, and Transgene Regulatory Elements on AAV2/8-Mediated Rat Liver TransductionPLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏
查看更多内容