Quaternion Vector Quantized Variational Autoencoder

doi:10.1109/LSP.2024.3504374

Quaternion Vector Quantized Variational Autoencoder

2025-01-01

0

PRE

AI

DOI：10.1109/LSP.2024.3504374

Original

Original request for help

Save

Abstract

En 中文

Vector quantized variational autoencoders, as variants of variational autoencoders, effectively capture discrete representations by quantizing continuous latent spaces and are widely used in generative tasks. However, these models still face limitations in handling complex image reconstruction, particularly in preserving high-quality details. Moreover, quaternion neural networks have shown unique advantages in handling multi-dimensional data, indicating that integrating quaternion approaches could potentially improve the performance of these autoencoders. To this end, we propose QVQ-VAE, a lightweight network in the quaternion domain that introduces a quaternion-based quantization layer and training strategy to improve reconstruction precision. By fully leveraging quaternion operations, QVQ-VAE reduces the number of model parameters, thereby lowering computational resource demands. Extensive evaluations on face and general object reconstruction tasks show that QVQ-VAE consistently outperforms existing methods while using significantly fewer parameters.

Keywords:

Quaternions

Vectors

Image reconstruction

Convolution

Neural networks

Face recognition

Quantization (signal)

Decoding

Training

Indexes

quaternion generative models

quaternion neural networks

vector quantized variational autoencoder

Quaternion Vector Quantized Variational Autoencoder

Abstract

Journal

Organization