arrow
Return

Testing Randomness Online

delete2021-11-01
delete17
delete
OA
AI
V
Vladimir Vovk *
DOI:10.1214/20-STS817delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
The hypothesis of randomness is fundamental in statistical machine learning and in many areas of nonparametric statistics; it says that the observations are assumed to be independent and coming from the same unknown probability distribution. This hypothesis is close, in certain respects, to the hypothesis of exchangeability, which postulates that the distribution of the observations is invariant with respect to their permutations. This paper reviews known methods of testing the two hypotheses concentrating on the online mode of testing, when the observations arrive sequentially. All known online methods for testing these hypotheses are based on conformal martingales, which are defined and studied in detail. An important variety of online testing is change detection, where the use of conformal martingales leads to conformal versions of the CUSUM and Shiryaev-Roberts procedures; these versions work in the nonparametric setting where the data is assumed IID according to a completely unknown distribution before the change. The paper emphasizes conceptual and practical aspects and states two kinds of results. Validity results limit the probability of a false alarm or, in the case of change detection, the frequency of false alarms for various procedures based on conformal martingales. Efficiency results establish connections between randomness, exchangeability, and conformal martingales.
Keywords:
Change detection
conformal prediction
exchangeability
martingale
online setting
testing randomness

Journal

Statistical Science cover
Statistical Science
IF:
3.4
Papers:
1.0K
Citations:
8.7K

Organization

U
University of London
Scholars:
1.7K
Papers: 724
Citations: 0
Cited Papers

Cited Papers

Manganese, Mn-dependent peroxidases, and the biodegradation of lignin
err1988-12-01
err0
PREAI
errIan T. Forrester; Anthony C. Grabski; Richard R. Burgess; Gary F. Leatham
errShare
errSave
errShare
errSave
The sources of Kolmogorov's Grundbegriffe
err2006-02-01
err68
errOAAI
errShafer, Glenn; Vovk, Vladimir
errShare
errSave
errShare
errSave
Molecular Differences and Similarities between Alzheimer's Disease and the 5XFAD Transgenic Mouse Model of Amyloidosis
err2013-11-21
err0
errOAAI
errChera L. Maarouf; Tyler A. Kokjohn; Charisse M. Whiteside; MiMi P. Macias; Walter M. Kalback; Marwan N. Sabbagh; Thomas G. Beach; Robert Vassar; Alex E. Roher
errShare
errSave
Polypodium leucotomos targets multiple aspects of oral carcinogenesis and it is a potential antitumor phytotherapy against tongue cancer growth
err2023-01-05
err0
errOAAI
errPammela A. Lacerda; Luan C. Oenning; Guilherme Cuoghi Bellato; Lucilene Lopes-Santos; Natalícia de Jesus Antunes; Bruno Augusto Linhares Almeida Mariz; Gabriela Teixeira; Rafael Vasconcelos; Gustavo Ferreira Simões; Ivani Aparecida de Souza; Clóvis Antônio Lopes Pinto; Tuula Salo; Ricardo D. Coletta; Taize M. Augusto; Carine Ervolino de Oliveira; Nilva K. Cervigne
errShare
errSave
researcher View more