返回
摘要
En 中文
With the explosive growth of unstructured data (such as images, videos, and audios), unstructured data analytics is widespread in a rich vein of real-world applications. Many database systems start to incorporate unstructured data analysis to meet such demands. However, queries over unstructured and structured data are often treated as disjoint tasks in most systems, where
hybrid queries
(
i.e.
, involving both data types) are not yet fully supported.
In this paper, we present a hybrid analytic engine developed at Alibaba, named
AnalyticDB-V
(ADBV), to fulfill such emerging demands. ADBV offers an interface that enables users to express
hybrid queries
using SQL semantics by converting unstructured data to high dimensional vectors. ADBV adopts the
lambda
framework and leverages the merits of approximate nearest neighbor search (ANNS) techniques to support hybrid data analytics. Moreover, a novel ANNS algorithm is proposed to improve the accuracy on large-scale vectors representing massive unstructured data. All ANNS algorithms are implemented as physical operators in ADBV, meanwhile, accuracy-aware cost-based optimization techniques are proposed to identify effective execution plans. Experimental results on both public and in-house datasets show the superior performance achieved by ADBV and its effectiveness. ADBV has been successfully deployed on Alibaba Cloud to provide hybrid query processing services for various real-world applications.
期刊
暂无期刊信息
机构
暂无机构信息
引用论文
暂无论文信息

