arrow
Return

A parallel computing framework for big data

delete2016-11-15
delete5
PRE
AI
G
Guoliang Chen
毛睿 (Rui Mao) *
陆克中 (Kezhong Lu)
DOI:10.1007/s11704-016-5003-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Big data has received great attention in research and application. However, most of the current efforts focus on system and application to handle the challenges of volume and velocity, and not much has been done on the theoretical foundation and to handle the challenge of variety. Based on metric-space indexing and computationalcomplexity theory, we propose a parallel computing framework for big data. This framework consists of three components, i.e., universal representation of big data by abstracting various data types into metric space, partitioning of big data based on pair-wise distances in metric space, and parallel computing of big data with the NC-class computing theory.
Keywords:
NC-computing
metric space
data partitioning
parallel computing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Frontiers of Computer Science cover
Frontiers of Computer Science
IF:
4.6
Papers:
1.6K
Citations:
2.8K

Organization

S
shenzhen university
Scholars:
4.5W
Papers: 3.4W
Citations: 72