arrow
返回

Transforming variables to central normality

delete2021-03-21
delete30
delete
OA
AI
J
Jakob Raymaekers
P
Peter J. Rousseeuw *
DOI:10.1007/s10994-021-05960-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Many real data sets contain numerical features (variables) whose distribution is far from normal (Gaussian). Instead, their distribution is often skewed. In order to handle such data it is customary to preprocess the variables to make them more normal. The Box-Cox and Yeo-Johnson transformations are well-known tools for this. However, the standard maximum likelihood estimator of their transformation parameter is highly sensitive to outliers, and will often try to move outliers inward at the expense of the normality of the central part of the data. We propose a modification of these transformations as well as an estimator of the transformation parameter that is robust to outliers, so the transformed data can be approximately normal in the center and a few outliers may deviate from it. It compares favorably to existing techniques in an extensive simulation study and on real data.
Keyword:
Anomaly detection
Data preprocessing
Feature transformation
Outliers
Symmetrization

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

K
KU Leuven
学者数:
5.7W
论文数: 5.2W
被引数: 8.1W
引用论文

引用论文

Lithium in Paediatric Patients with Bipolar Disorder: Implications for Selection of Dosage Regimens via Population Pharmacokinetics/Pharmacodynamics
err2016-07-08
err0
PREAI
errCornelia B. Landersdorfer; Robert L. Findling; Jean A. Frazier; Vivian Kafantaris; Carl M. J. Kirkpatrick
err分享
err收藏
err分享
err收藏
Posttraumatic Stress Disorder and Cannabis Use Characteristics among Military Veterans with Cannabis Dependence
err2013-04-25
err0
PREAI
errMatthew Tyler Boden; Kimberly A. Babson; Anka A. Vujanovic; Nicole A. Short; Marcel O. Bonn‐Miller
err分享
err收藏
Cochlear implants and brain plasticity人工耳蜗植入与脑可塑性
err2008-04-01
err0
errOAAI
errJames B. Fallon; Dexter R.F. Irvine; Robert K. Shepherd
err分享
err收藏
学者 查看更多内容