arrow
Return

Real-time intelligent big data processing: technology, platform, and applications

delete2019-07-12
delete33
delete
OA
AI
T
Tongya Zheng
G
Gang Chen
王新宇 (Xinyu Wang)
C
Chun Chen
X
Xingen Wang *
S
Sihui Luo
DOI:10.1007/s11432-018-9834-8delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Human beings keep exploring the physical space using information means. Only recently, with the rapid development of information technologies and the increasing accumulation of data, human beings can learn more about the unknown world with data-driven methods. Given data timeliness, there is a growing awareness of the importance of real-time data. There are two categories of technologies accounting for data processing: batching big data and streaming processing, which have not been integrated well. Thus, we propose an innovative incremental processing technology named after Stream Cube to process both big data and stream data. Also, we implement a real-time intelligent data processing system, which is based on real-time acquisition, real-time processing, real-time analysis, and real-time decision-making. The real-time intelligent data processing technology system is equipped with a batching big data platform, data analysis tools, and machine learning models. Based on our applications and analysis, the real-time intelligent data processing system is a crucial solution to the problems of the national society and economy.
Keywords:
batching big data
streaming processing technology
real-time data processing
incremental computation
intelligent data processing system
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Science China Information Sciences cover
Science China Information Sciences
IF:
7.6
Papers:
4.9K
Citations:
8.9K

Organization

Z
zhejiang university
Scholars:
17.4W
Papers: 12.0W
Citations: 152