arrow
Return

In-Memory Big Data Management and Processing: A Survey

delete2015-07-01
delete270
delete
OA
AI
H
Hao Zhang *
G
Gang Chen
B
Beng Chin Ooi
K
Kian‐Lee Tan
张美慧 cover
张美慧 (Meihui Zhang)
DOI:10.1109/TKDE.2015.2427795delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Growing main memory capacity has fueled the development of in-memory big data management and processing. By eliminating disk I/O bottleneck, it is now possible to support interactive data analytics. However, in-memory systems are much more sensitive to other sources of overhead that do not matter in traditional I/O-bounded disk-based systems. Some issues such as fault-tolerance and consistency are also more challenging to handle in in-memory environment. We are witnessing a revolution in the design of database systems that exploits main memory as its data storage layer. Many of these researches have focused along several dimensions: modern CPU and memory hierarchy utilization, time/space efficiency, parallelism, and concurrency control. In this survey, we aim to provide a thorough review of a wide range of in-memory data management and processing proposals and systems, including both data storage systems and data processing frameworks. We also give a comprehensive presentation of important technology in memory management, and some key factors that need to be considered in order to achieve efficient in-memory data management and processing.
Keywords:
Primary memory
DRAM
relational databases
distributed databases
query processing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

S
singapore university of technology & design
Scholars:
2.8K
Papers: 3.6K
Citations: 5
Z
zhejiang university
Scholars:
17.6W
Papers: 12.1W
Citations: 152
N
National University of Singapore
Scholars:
7.5W
Papers: 6.5W
Citations: 11.4W
researcher View more organizations