.png){kind=icon}
返回
Scalable architecture for Big Data financial analytics: user-defined functions vs. SQL
.png){kind=icon}
OA
AI
DOI：10.1186/s40537-019-0209-0.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Large financial organizations have hundreds of millions of financial contracts on their balance sheets. Moreover, highly volatile financial markets and heterogeneous data sets within and across banks world-wide make near real-time financial analytics very challenging and their handling thus requires cutting edge financial algorithms. However, due to a lack of data modeling standards, current financial risk algorithms are typically inconsistent and non-scalable. In this paper, we present a novel implementation of a real-world use case for performing large-scale financial analytics leveraging Big Data technology. We first provide detailed background information on the financial underpinnings of our framework along with the major financial calculations. Afterwards we analyze the performance of different parallel implementations in Apache Spark based on existing computation kernels that apply the ACTUS data and algorithmic standard for financial contract modeling. The major contribution is a detailed discussion of the design trade-offs between applying user-defined functions on existing computation kernels vs. partially re-writing the kernel in SQL and thus taking advantage of the underlying SQL query optimizer. Our performance evaluation demonstrates almost linear scalability for the best design choice.
Keyword:
Financial analytics
Query processing
User-defined functions
Performance evaluation
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.4
论文数:
1.5K
被引数:
1.1W
机构
引用论文
Double-Pass Retina Point Imaging for the Evaluation of Optical Light Scatter, Retinal Image Quality, and Staging of Keratoconus双通视网膜点成像用于评估光学光散射，视网膜图像质量和圆锥角膜分期
OAAI
.png){kind=icon}
OAAI分享收藏
查看更多内容