arrow
Return

Diversification on big data in query processing

delete2020-01-03
delete5
PRE
AI
M
Meifan Zhang
王
王宏志 (Hongzhi Wang) *
李
李建忠 (Jianzhong Li)
H
Hong Gao
DOI:10.1007/s11704-019-8324-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, in the area of big data, some popular applications such as web search engines and recommendation systems, face the problem to diversify results during query processing. In this sense, it is both significant and essential to propose methods to deal with big data in order to increase the diversity of the result set. In this paper, we firstly define the diversity of a set and the ability of an element to improve the overall diversity. Based on these definitions, we propose a diversification framework which has good performance in terms of effectiveness and efficiency. Also, this framework has theoretical guarantee on probability of success. Secondly, we design implementation algorithms based on this framework for both numerical and string data. Thirdly, for numerical and string data respectively, we carry out extensive experiments on real data to verify the performance of our proposed framework, and also perform scalability experiments on synthetic data.
Keywords:
diversification
query processing
big data
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Frontiers of Computer Science cover
Frontiers of Computer Science
IF:
4.6
Papers:
1.6K
Citations:
2.8K

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
A novel impact hardening polymer with negative Poisson's ratio for impact protection
err2015-12-01
err0
PREAI
errKun Xu; Ying Tan; John H. Xin; Yanping Liu; Cuige Lu; Yukun Deng; Changyu Han; Hong Hu; Pixin Wang
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
researcher View more