.png){kind=icon}
返回
Auto-Prep: Efficient and Automated Data Preprocessing Pipeline
.png){kind=icon}
PRE
AI
DOI：10.1109/ACCESS.2022.3198662.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Data preprocessing is crucial in the Machine Learning pipeline because the models' learning ability directly affects the quality of data and the underlying information acquired from this stage. Nevertheless, surprisingly, there are many alternatives for each transformation task, which makes an inexperienced user overwhelmed. A simple Python-based Auto-preprocessing architecture for Automated Machine Learning is developed to offer automated, interactive, and data-driven support to help the users perform data preprocessing tasks efficiently. The suggested method provides valuable insights into a dataset and can handle standard data preprocessing tasks adeptly. Initially, it detects the data problem and presents it to the end-user using compelling visualizations. Then, it recommends the most effective data cleaning and preparation method to the user after evaluating the state-of-the-art candidate techniques. For evaluation, the proposed architecture is employed on ten different and diverse datasets for automatic data preprocessing before passing it to an ML algorithm. The results are then compared with the results generated by the same ML algorithm but implemented on manually preprocessed data. The results have shown that not only did this approach make the whole process uncomplicated and facile, but it was also able to improve the performance of the model significantly.
Keyword:
Encoding
Data preprocessing
Machine learning
Feature extraction
Data models
Dimensionality reduction
Support vector machines
Pipelines
Automated machine learning
data preprocessing
feature engineering
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
.png){kind=icon}
The preoperative platelet distribution width: A predictive factor of the prognosis in patients with non‐small cell lung cancer术前血小板分布宽度：非小细胞肺癌患者预后的预测因素
OAAI
OAAI分享收藏分享收藏
查看更多内容