Knowledge Discovery: Methods from data mining and machine learning

doi:10.1016/j.ssresearch.2022.102817

Return

Knowledge Discovery: Methods from data mining and machine learning

2023-02-01

Xiaoling Shu *

Yiwan Ye

DOI：10.1016/j.ssresearch.2022.102817

Original

Original request for help

Save

Abstract

En 中文

The interdisciplinary field of knowledge discovery and data mining emerged from a necessity of big data requiring new analytical methods beyond the traditional statistical approaches to discover new knowledge from the data mine. This emergent approach is a dialectic research process that is both deductive and inductive. The data mining approach automatically or semi-automatically considers a larger number of joint, interactive, and independent predictors to address causal heterogeneity and improve prediction. Instead of challenging the conventional model-building approach, it plays an important complementary role in improving model good-ness of fit, revealing valid and significant hidden patterns in data, identifying nonlinear and non -additive effects, providing insights into data developments, methods, and theory, and enriching scientific discovery. Machine learning builds models and algorithms by learning and improving from data when the explicit model structure is unclear and algorithms with good performance are difficult to attain. The most recent development is to incorporate this new paradigm of predictive modeling with the classical approach of parameter estimation regressions to produce improved models that combine explanation and prediction.

Keywords:

Knowledge discovery

data mining

machine learning

causal discovery

predition

big data