arrow
返回

Learnable product quantization for anomaly detection

delete2024-05-01
delete0
PRE
AI
S
Shi Zhang
W
Weilin Chen
B
Binlong Lu
H
Huixia Lai *
DOI:10.1016/j.neucom.2024.127532delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In many anomaly detection applications, anomaly samples are difficult to obtain. We propose a novel product quantization (PQ) -based anomaly detection scheme: Learnable Product Quantization (LPQ), which only requires very few abnormal samples to train the model. The scheme extracts feature from high -dimensional data using the deep learning network, decomposes the feature space into a Cartesian product of low dimensional subspaces using PQ, and then produces sub-codebooks consisting of sub-codewords with clustering techniques. As a result, the extracted features with similar sub -vector are mapped into the same bucket, which reduces the time complexity of nearest neighbor retrieval significantly. In order to achieve reasonable codebooks, a PQ Table is embedded into the network. While training, we propose a novel metric learning strategy that makes the semantically similar (normal) samples closer and dissimilar (outlier) samples farther. The experimental results on benchmark datasets demonstrate that our metric learning strategy is better than the triplet loss and the sigmoid cross -entropy loss on the anomaly detection task. In general, LPQ shows excellent performance and high efficiency in anomaly detection.
Keyword:
Anomaly detection
Product quantization
Deep learning
Quantization error

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

F
Fujian Normal University
学者数:
1.2W
论文数: 8.0K
被引数: 1.3W
引用论文

引用论文

Inhibition of Sirtuin 3 prevents titanium particle-induced bone resorption and osteoclastsogenesis via suppressing ERK and JNK signaling
err2021-01-01
err0
errOAAI
errNing Li; Xiaoping Li; Kai Zheng; Jiaxiang Bai; Weicheng Zhang; Houyi Sun; Gaoran Ge; Wei Wang; Zhen Wang; Ye Gu; Yi Xue; Yaozeng Xu; Dechun Geng; Jun Zhou
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
A review of novelty detection新颖性检测综述
err2014-06-01
err1.2K
PREAI
errPimentel, Marco A. F.; Clifton, David A.; Clifton, Lei; Tarassenko, Lionel
err分享
err收藏
err分享
err收藏
Larynx‐preserving esophagectomy and jejunal transfer for cervical esophageal carcinoma颈段食管癌的保留喉食管切除术和空肠转移
err2009-05-14
err0
PREAI
errHideki Kadota; Minoru Sakuraba; Yoshihiro Kimata; Ryuichi Hayashi; Satoshi Ebihara; Hoichi Kato
err分享
err收藏
学者 查看更多内容