返回
GaussDB-AISQL: a composable cloud-native SQL system with AI capabilities
DOI:10.1007/s11704-024-40624-2.png)
摘要
En 中文
Cloud-native data warehouses have revolutionized data analysis by enabling elasticity, high availability and lower costs. And the increasing popularity of artificial intelligence (AI) drives data warehouses to provide predictive analytics besides the existing descriptive analytics. Consequently, more vendors start to support training and inference of AI models in data warehouses, exploiting the benefits of near-data processing for fast model development and deployment. However, most of the existing solutions are limited by a complex syntax or slow data transportation across engines.In this paper, we present GaussDB-AISQL, a composable SQL system with AI capabilities. GaussDB-AISQL adopts a composable system design that decouples computing, storage, caching, DB engine and AI engine. Our system offers all the functionality needed by end-to-end model training and inference during the model lifecycle. It also enjoys the simplicity and efficiency by providing a SQL-like syntax and removes the burden of manual model management. When training an AI model, GaussDB-AISQL benefits from highly parallel data transportation by concurrent data pulling from the distributed shared memory. The feature selection algorithms in GaussDB-AISQL make the training more data-efficient. When running model inference, GaussDB-AISQL registers the trained model object in the local data warehouse as a user-defined-function, which avoids moving inference data out of the data warehouse to an external AI engine. Experiments show that GaussDB-AISQL is up to 19x faster than baseline approaches.
Keyword:
database system
data management
OLAP
cloud computing
AI
machine learning
期刊
IF:
4.6
论文数:
1.6K
被引数:
2.8K
机构
引用论文
Artificial Bee Colony Algorithm for Economic Load Dispatch Problem with Non-smooth Cost Functions非平稳成本函数经济负荷分配问题的人工蜂群算法
Right and Coercion: Can Kant’s Conception of Right be Derived from his Moral Theory?权利与强制:康德的法权概念是否可从其道德理论中推导出来?

