arrow
返回

Constraint-Driven Complexity-Aware Data Science Workflow for AutoBDA

delete2023-12-01
delete1
PRE
AI
I
Incheon Paik
黄华威 封面图
黄华威 (Huawei Huang)
DOI:10.1109/TBDATA.2023.3256043delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The Internet of Things, privacy, and technical constraints increase the demand for edge-based data-driven services, which is one of the major goals of Industry 4.0 and Society 5.0. Big data analysis (BDA) is the preferred approach to unleash hidden knowledge. However, BDA consumes excessive resources and time. These limitations hamper the meaningful adoption of BDA, especially the time and situation critical edge use cases, and hinder the goals of Industry 4.0 and Society 5.0. Automating the BDA process at the edge is a cognitive approach to address the aforementioned concerns. Data science workflow is an indispensable challenge for successful automation. Therefore, we conducted a systematic literature survey on data science workflow platforms as the first contribution. Moreover, we learned that the BDA workflow depends on diversified constraints and undergoes rigorous data-mining stages. These caused an increase in the solution space, dynamic constraints, complexity issues, and NP-hardness of BDA workflow. Graphplan is a heuristic AI-planning technique that can address concerns associated with BDA workflow. Therefore, as the second contribution, we adopted the graphplan to generate a workflow for edge-based BDA automation. Experiments demonstrate that the proposed method achieved our objectives.
Keyword:
AutoBDA
data science workflow
edge-computing
industry 4.0
society 5.0

期刊

I
IEEE Transactions on Big Data
IF:
5.7
论文数:
860
被引数:
3.0K

机构

S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
U
University of Aizu
学者数:
768
论文数: 1.0K
被引数: 302
引用论文

引用论文

CRISP-DM Twenty Years Later: From Data Mining Processes to Data Science Trajectories
err2021-08-01
err148
errOAAI
errMartinez-Plumed, Fernando; Contreras-Ochando, Lidia; Ferri, Cesar; Hernandez-Orallo, Jose; Kull, Meelis; Lachiche, Nicolas; Ramirez-Quintana, Maria Jose; Flach, Peter
err分享
err收藏
Big Data and Emergency Management: Concepts, Methodologies, and Applications
err2020-01-01
err24
PREAI
errSong, Xuan; Zhang, Haoran; Akerkar, Rajendra; Huang, Huawei; Guo, Song; Zhong, Lei; Ji, Yusheng; Opdahl, Andreas L.; Purohit, Hemant; Skupin, Andre; Pottathil, Akshay; Culotta, Aron
err分享
err收藏
Taming System Dynamics on Resource Optimization for Data Processing Workflows: A Probabilistic Approach
err2022-01-01
err4
PREAI
errZhou, Amelie Chi; Xue, Weilin; Xiao, Yao; He, Bingsheng; Ibrahim, Shadi; Cheng, Reynold
err分享
err收藏
Anomaly Detection and Repair for Accurate Predictions in Geo-distributed Big Data
err2019-07-01
err37
errOAAI
errCorizzo, Roberto; Ceci, Michelangelo; Japkowicz, Nathalie
err分享
err收藏
err分享
err收藏
err
IF0
err2024-03-01
err0
PREAI
err
err分享
err收藏
Effect of acrylonitrile content of acrylonitrile butadiene rubber on mechanical and thermal properties of dynamically vulcanized poly(lactic acid) blends
err2019-09-30
err0
PREAI
errChavakorn Samthong; Nappaphan Kunanusont; Chutimar Deetuam; Tanchanok Wongkhan; Thanapat Supannasud; Anongnat Somwangthanaroj
err分享
err收藏
Dual luminophore polystyrene microspheres for pressure-sensitive luminescent imaging
err2006-04-26
err0
PREAI
errFletcher Kimura; Gamal Khalil; Nobuyuki Zettsu; Younan Xia; James Callis; Martin Gouterman; Larry Dalton; Dana Dabiri; Miguel Rodriguez
err分享
err收藏
学者 查看更多内容