arrow
返回

Median-Based Classifiers for High-Dimensional Data

delete2009-12-01
delete31
PRE
AI
P
Peter Hall *
D
D. M. Titterington
J
Jing‐Hao Xue
DOI:10.1198/jasa.2009.tm08107delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Conventional distance-based classifiers use standard Euclidean distance, and so can suffer from excessive volatility if vector components have heavy-tailed distributions. This difficulty can be alleviated by replacing the L-2 distance by its L-1 counterpart. For example, the L-1 version of the popular centroid classifier would allocate a new data value to the population to whose centroid it was closest in L-1 terms. However, this approach can lead to inconsistency, because the centroid is defined using L-2, rather than L-1, distance. In particular, by mixing L-1 and L-2 approaches, we produce a classifier that can seriously misidentify data in cases where the means and medians of marginal distributions take different values. These difficulties motivate replacing centroids by medians. However, in the very-high-dimensional settings commonly encountered today, this can be problematic if we attempt to work with a conventional spatial median. Therefore, we suggest using componentwise medians to construct a robust classifier that is relatively insensitive to the difficulties caused by heavy-tailed data and entails straightforward computation. We also consider generalizations and extensions of this approach based on, for example, using data truncation to achieve additional robustness. Using both empirical and theoretical arguments, we explore the properties of these methods, and show that the resulting classifiers can be particularly effective. Supplementary materials are available online.
Keyword:
Centroid classifier
Componentwise median
Data depth
Distance-based classifier
High-dimensional data
L-1 method
Robust method
Sample median
Spatial median
Strength of dependence
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
U
university of glasgow
学者数:
3.5W
论文数: 3.1W
被引数: 37
U
university of melbourne
学者数:
5.7W
论文数: 5.4W
被引数: 69
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Retrobulbar haemodynamic changes studied by colour Doppler imaging in glaucoma
errEye
IF0
err1997-11-01
err0
errOAAI
errCatherine J Liu; Yi-Hong Chou; Joe C Chou; Hong-Jen Chiou; Shu-Chiung Chiang; Jorn-Horn Liu
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Classification methods for the development of genomic signatures from high-dimensional data
err2006-12-20
err18
errOAAI
errMoon, Hojin; Ahn, Hongshik; Kodell, Ralph L.; Lin, Chien-Ju; Baek, Songjoon; Chen, James J.
err分享
err收藏
err分享
err收藏
学者 查看更多内容