Margin-Based Training of HDC Classifiers

Laura Smets

doi:10.3390/bdcc9030068

Margin-Based Training of HDC Classifiers

2025-03-14

0

OA

AI

L

Laura Smets *

D

Dmitri A. Rachkovskij

DOI：10.3390/bdcc9030068

原文链接

原文求助

摘要

En 中文

The explicit kernel transformation of input data vectors to their distributed high-dimensional representations has recently been receiving increasing attention in the field of hyperdimensional computing (HDC). The main argument is that such representations endow simpler last-leg classification models, often referred to as HDC classifiers. HDC models have obvious advantages over resource-intensive deep learning models for use cases requiring fast, energy-efficient computations both for model training and deploying. Recent approaches to training HDC classifiers have primarily focused on various methods for selecting individual learning rates for incorrectly classified samples. In contrast to these methods, we propose an alternative strategy where the decision to learn is based on a margin applied to the classifier scores. This approach ensures that even correctly classified samples within the specified margin are utilized in training the model. This leads to improved test performances while maintaining a basic learning rule with a fixed (unit) learning rate. We propose and empirically evaluate two such strategies, incorporating either an additive or multiplicative margin, on the standard subset of the UCI collection, consisting of 121 datasets. Our approach demonstrates superior mean accuracy compared to other HDC classifiers with iterative error-correcting training.

Keyword:

hyperdimensional computing

HDC classifier

compositional representation

hypervector

margin classifier

confidence

Margin-Based Training of HDC Classifiers

摘要

期刊

机构

引用论文