arrow
返回

Speeding Up Data Manipulation Tasks with Alternative Implementations: An Exploratory Study

delete2021-07-23
delete1
PRE
AI
Y
Yida Tao
唐
唐山 (Shan Tang)
Y
Yepang Liu
Z
Zhiwu Xu
S
Shengchao Qin *
DOI:10.1145/3456873delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
As data volume and complexity grow at an unprecedented rate, the performance of data manipulation programs is becoming a major concern for developers. In this article, we study how alternative API choices could improve data manipulation performance while preserving task-specific input/output equivalence. We propose a lightweight approach that leverages the comparative structures in Q&A sites to extracting alternative implementations. On a large dataset of Stack Overflow posts, our approach extracts 5,080 pairs of alternative implementations that invoke different data manipulation APIs to solve the same tasks, with an accuracy of 86%. Experiments show that for 15% of the extracted pairs, the faster implementation achieved >10x speedup over its slower alternative. We also characterize 68 recurring alternative API pairs from the extraction results to understand the type of APIs that can be used alternatively. To put these findings into practice, we implement a tool, AlterApi, to automatically optimize real-world data manipulation programs. In the 1,267 optimization attempts on the Kaggle dataset, 76% achieved desirable performance improvements with up to orders-of-magnitude speedup. Finally, we discuss notable challenges of using alternative APIs for optimizing data manipulation programs. We hope that our study offers a new perspective on API recommendation and automatic performance optimization.
Keyword:
API selection
data manipulation
performance optimization
mining software repository
empirical study
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
论文数:
1.2K
被引数:
3.4K

机构

U
university of teesside
学者数:
1.6K
论文数: 1.8K
被引数: 3
S
shenzhen university
学者数:
4.6W
论文数: 3.4W
被引数: 72
引用论文

引用论文

Green Corrosion Inhibition
err2024-02-02
err0
PREAI
errBharti Sheokand; Seema R. Pathak; Chandan K. Mandal; Drishti Gupta; Deepti Verma; Kamalakanta Behera; Ambrish Kumar; Monika Vats; Shruti Trivedi
err分享
err收藏
The nature of the relationship of psychomotor slowing with negative symptomatology in schizophrenia
err2013-06-03
err0
PREAI
errChris Bervoets; Lise Docx; Bernard Sabbe; Sara Vermeylen; Maarten J. Van Den Bossche; Anne Morsel; Manuel Morrens
err分享
err收藏
A Systematic Evaluation of Static API-Misuse Detectors静态API误用检测器的系统评估
err2019-12-01
err73
errOAAI
errAmann, Sven; Hoan Anh Nguyen; Nadi, Sarah; Nguyen, Tien N.; Mezini, Mira
err分享
err收藏
SciPy 1.0: fundamental algorithms for scientific computing in PythonSciPy 1.0: Python中科学计算的基本算法
err2020-02-03
err2.1W
errOAAI
errVirtanen, Pauli; Gommers, Ralf; Oliphant, Travis E.; Haberland, Matt; Reddy, Tyler; Cournapeau, David; Burovski, Evgeni; Peterson, Pearu; Weckesser, Warren; Bright, Jonathan; van der Walt, Stefan J.; Brett, Matthew; Wilson, Joshua; Millman, K. Jarrod; Mayorov, Nikolay; Nelson, Andrew R. J.; Jones, Eric; Kern, Robert; Larson, Eric; Carey, C. J.; Polat, Ilhan; Feng, Yu; Moore, Eric W.; VanderPlas, Jake; Laxalde, Denis; Perktold, Josef; Cimrman, Robert; Henriksen, Ian; Quintero, E. A.; Harris, Charles R.; Archibald, Anne M.; Ribeiro, Antonio H.; Pedregosa, Fabian; van Mulbregt, Paul
err分享
err收藏
Swarming and Behaviour in Antarctic Krill
err2016-08-04
err0
PREAI
errGeraint A. Tarling; Sophie Fielding
err分享
err收藏
Neonatal Characteristics as Risk Factors for Preschool Asthma
err2009-07-02
err0
PREAI
errDouglas Schaubel; Helen Johansen; Mrinal Dutta; Marie Desmeules; Allan Becker; Yang Mao
err分享
err收藏
学者 查看更多内容