arrow
Return

Online supervised spam filter evaluation

delete2007-07-01
delete58
PRE
AI
G
Gordon V. Cormack *
T
Thomas R. Lynam
DOI:10.1145/1247715.1247717delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Eleven variants of six widely used open-source spam filters are tested on a chronological sequence of 49086 e-mail messages received by an individual from August 2003 through March 2004. Our approach differs from those previously reported in that the test set is large, comprises uncensored raw messages, and is presented to each filter sequentially with incremental feedback. Misclassification rates and Receiver Operating Characteristic Curve measurements are reported, with statistical confidence intervals. Quantitative results indicate that content-based filters can eliminate 98% of spam while incurring 0.1% legitimate email loss. Qualitative results indicate that the risk of loss depends on the nature of the message, and that messages likely to be lost may be those that are less critical. More generally, our methodology has been encapsulated in a free software toolkit, which may used to conduct similar experiments.
Keywords:
experimentation
measurement
spam
email
text classification
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Information Systems cover
ACM Transactions on Information Systems
IF:
9.1
Papers:
1.2K
Citations:
4.7K

Organization

No organization information available
Cited Papers

Cited Papers

M Pathway and Areas 44 and 45 Are Involved in Stereoscopic Recognition Based on Binocular Disparity.
err2002-01-01
err0
errOAAI
errTsuneo Negawa; Shinji Mizuno; Tomoya Hahashi; Hiromi Kuwata; Mihoko Tomida; Hiroaki Hoshi; Seiichi Era; Kazuo Kuwata
errShare
errSave
errShare
errSave
errShare
errSave
Brigatinib (BRG) in patients (pts) with crizotinib (CRZ)-refractory ALK+ non-small cell lung cancer (NSCLC): First report of efficacy and safety from a pivotal randomized phase (ph) 2 trial (ALTA).
err2016-05-20
err0
PREAI
errDong-Wan Kim; Marcello Tiseo; Myung-Ju Ahn; Karen L. Reckamp; Karin Holmskov Hansen; Sang-We Kim; Rudolf M. Huber; Howard Jack West; Harry J.M. Groen; Maximilian J. Hochmair; Natasha B. Leighl; Scott N. Gettinger; Corey J. Langer; Luis G. Paz-Ares; Egbert F. Smit; Edward S. Kim; William G Reichmann; David Kerstein; Frank G. Haluska; D. Ross Camidge
errShare
errSave
no more