arrow
Return

Vector Database Benchmarking: A Face Retrieval Use Case

delete2026-01-01
delete0
PRE
AI
T
Teodor Sakal Francišković *
N
Nikola Todorović
J
Jelena Hrnjak
V
Vladimir Dimitrieski
DOI:10.1007/978-3-032-05281-0_3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, several database management systems shave been developed to support the efficient handling of high-dimensional vector data and fast and accurate similarity searches. These systems differ significantly in their overall architecture and implementation of indexing and querying techniques, which may impact their performance in real-world scenarios. However, no official performance comparison exists to guide users in selecting the right system. We present a controlled experiment evaluating six widely used vector database management systems in a real-world face retrieval scenario to fill this gap. Although the use case involves face retrieval, the results are broadly applicable, as the core evaluation focuses on database performance over vector embeddings, regardless of their origin. The scenario utilises a dataset of 1TB of images from which a total of 1,730,000 face vector embeddings were identified and extracted; the extraction was performed using two different vectorisation techniques, resulting in vectors of two different dimensions, i.e., sizes. The evaluation is conducted for both vector sizes on the dataset divided into small, medium, and large subsets to investigate the impact of different data processing loads on system performance. The evaluated performance aspects include insertion and deletion times, initialisation overhead, and search latency. In addition to performance metrics, face retrieval quality is assessed using precision, F1, and specificity.
Keywords:
Benchmarking
Vector Databases
Face Retrieval
Similarity Search
HNSW
High-Dimensional Data

Journal

A
ADVANCES IN DATABASES AND INFORMATION SYSTEMS, ADBIS 2025
IF:
0
Papers:
19
Citations:
0

Organization

U
University of Novi Sad
Scholars:
9.3K
Papers: 6.2K
Citations: 5.0K
Cited Papers

Cited Papers

Emerging Properties in Self-Supervised Vision Transformers
err2021-10-01
err0
errOAAI
errMathilde Caron; Hugo Touvron; Ishan Misra; Herve Jegou; Julien Mairal; Piotr Bojanowski; Armand Joulin
errShare
errSave
ANN-Benchmarks: A benchmarking tool for approximate nearest neighbor algorithms
err2020-01-01
err112
errOAAI
errAumuller, Martin; Bernhardsson, Erik; Faithfull, Alexander
errShare
errSave
Approximate Nearest Neighbor Search on High Dimensional Data - Experiments, Analyses, and Improvement
err2020-08-01
err208
PREAI
errLi, Wen; Zhang, Ying; Sun, Yifang; Wang, Wei; Li, Mingjie; Zhang, Wenjie; Lin, Xuemin
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
Milvus
err2021-06-18
err0
errOAAI
errJianguo Wang; Xiaomeng Yi; Rentong Guo; Hai Jin; Peng Xu; Shengjun Li; Xiangyu Wang; Xiangzhou Guo; Chengming Li; Xiaohai Xu; Kun Yu; Yuxing Yuan; Yinghao Zou; Jiquan Long; Yudong Cai; Zhenxiang Li; Zhifeng Zhang; Yihua Mo; Jun Gu; Ruiyi Jiang; Yi Wei; Charles Xie
errShare
errSave
researcher View more