arrow
返回

D&A: Resource Optimization in Personalized PageRank Computations Using Multi-Core Machines

delete2024-11-01
delete0
PRE
AI
K
Kai Siong Yow *
C
Chunbo Li
DOI:10.1109/TKDE.2024.3417264delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Resource optimization is commonly used in workload management, ensuring efficient and timely task completion utilising available resources. It serves to minimise costs, prompting the development of numerous algorithms tailored to this end. The majority of these techniques focus on scheduling and executing workloads effectively within the provided resource constraints. In this paper, we tackle this problem using another approach. We propose a novel framework D&A to determine the number of cores required in completing a workload under time constraint. We first preprocess a small portion of queries to derive the number of required slots, allowing for the allocation of the remaining workloads into each slot. We introduce a scaling factor in handling the time fluctuation issue caused by random functions. We further establish a lower bound of the number of cores required under this scenario, serving as a baseline for comparison purposes. We examine the framework by computing personalized PageRank values involving intensive computations. Our experimental results show that D&A surpasses the baseline, achieving reductions in the required number of cores ranging from 38.89%38.89% to 73.68%73.68% across benchmark datasets comprising millions of vertices and edges.
Keyword:
Optimization
Task analysis
Multicore processing
Cloud computing
Processor scheduling
Parallel processing
Time factors
multi-core machine
parallel computing
personalized PageRank
resource optimization

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

err
IF0
err
err0
errOAAI
err
err分享
err收藏
err分享
err收藏
err分享
err收藏
Biologically Inspired Soft Robot for Thumb Rehabilitation1
err2014-04-28
err0
PREAI
errPaxton Maeder-York; Tyler Clites; Emily Boggs; Ryan Neff; Panagiotis Polygerinos; Dónal Holland; Leia Stirling; Kevin Galloway; Catherine Wee; Conor Walsh
err分享
err收藏
Impact of dehydration and fasting on intraocular pressure and corneal biomechanics measured by the Ocular Response Analyzer
err2017-03-02
err0
PREAI
errBetul Seher Uysal; Necati Duru; Umut Ozen; Mucella Arikan Yorgun; Emine Akcay; Mehtap Caglayan; Nurullah Cagil
err分享
err收藏
Perceived Racism as a Predictor of Paranoia Among African Americans
err2006-02-01
err0
PREAI
errDennis R. Combs; David L. Penn; Jeffrey Cassisi; Chris Michael; Terry Wood; Jill Wanner; Scott Adams
err分享
err收藏
学者 查看更多内容