arrow
Return

Using machine learning for discovery in synoptic survey imaging data

delete2013-08-29
delete103
delete
OA
AI
H
Henrik Brink *
D
D. Poznanski
J
J. S. Bloom
J
John Rice
S
Sahand Negahban
M
Martin J. Wainwright
DOI:10.1093/mnras/stt1306delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Modern time-domain surveys continuously monitor large swaths of the sky to look for astronomical variability. Astrophysical discovery in such data sets is complicated by the fact that detections of real transient and variable sources are highly outnumbered by 'bogus' detections caused by imperfect subtractions, atmospheric effects and detector artefacts. In this work, we present a machine-learning (ML) framework for discovery of variability in time-domain imaging surveys. Our ML methods provide probabilistic statements, in near real time, about the degree to which each newly observed source is an astrophysically relevant source of variable brightness. We provide details about each of the analysis steps involved, including compilation of the training and testing sets, construction of descriptive image-based and contextual features, and optimization of the feature subset and model tuning parameters. Using a validation set of nearly 30 000 objects from the Palomar Transient Factory, we demonstrate a missed detection rate of at most 7.7 per cent at our chosen false-positive rate of 1 per cent for an optimized ML classifier of 23 features, selected to avoid feature correlation and overfitting from an initial library of 42 attributes. Importantly, we show that our classification methodology is insensitive to mislabelled training data up to a contamination of nearly 10 per cent, making it easier to compile sufficient training sets for accurate performance in future surveys. This ML framework, if so adopted, should enable the maximization of scientific gain from future synoptic survey and enable fast follow-up decisions on the vast amounts of streaming data produced by such experiments.
Keywords:
methods: data analysis
methods: statistical
techniques: image processing
surveys
supernovae: general
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Monthly Notices of the Royal Astronomical Society cover
Monthly Notices of the Royal Astronomical Society
IF:
4.8
Papers:
7.0W
Citations:
25.0W

Organization

U
University of California Berkeley
Scholars:
3.5W
Papers: 2.8W
Citations: 11.3W
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K