arrow
Return

Optimizing sparse RFI prediction using deep learning

delete2019-07-08
delete35
delete
OA
AI
J
Joshua Kerrigan *
P
Paul La Plante
S
Saul A. Kohn
J
Jonathan C. Pober
J
James Aguirre
Z
Zara Abdurashidova
P
Paul Alexander
Z
Zaki S. Ali
Y
Yanga Balfour
A
Adam P. Beardsley
G
G. Bernardi
J
Judd D. Bowman
R
Richard F. Bradley
J
Jacob Burba
C
C. L. Carilli
C
Carina Cheng
D
David R. DeBoer
M
Matt Dexter
E
Eloy de Lera Acedo
J
Joshua S. Dillon
J
Julia Estrada
A
Aaron Ewall‐Wice
N
Nicolas Fagnoni
R
Randall Fritz
S
Steve R. Furlanetto
B
Brian Glendenning
B
Bradley Greig
J
Jasper Grobbelaar
D
Deepthi Gorthi
Z
Ziyaad Halday
B
B. J. Hazelton
J
J. Hickish
D
Daniel Jacobs
A
Austin Julius
N
Nicholas S. Kern
P
Piyanat Kittiwisit
M
Matthew Kolopanis
A
Adam Lanman
T
Telalo Lekalake
A
Adrian Liu
D
David H. E. MacMahon
L
Lourence Malan
C
Cresshim Malgas
M
Matthys Maree
Z
Zachary E. Martinot
E
Eunice Matsetela
A
Andrei Mesinger
M
Mathakane Molewa
M
M. F. Morales
T
Tshegofalang Mosiane
A
Aaron R. Parsons
N
Nipanjana Patra
S
Samantha Pieterse
N
N. Razavi‐Ghods
J
Jon Ringuette
K
Kathryn Rosie
P
Peter Sims
C
Craig Smith
A
Angelo Syce
N
Nithyanandan Thyagarajan
P
Peter K. G. Williams
H
Haoxuan Zheng
DOI:10.1093/mnras/stz1865delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Radio frequency interference (RFI) is an ever-present limiting factor among radio telescopes even in the most remote observing locations. When looking to retain the maximum amount of sensitivity and reduce contamination for Epoch of Reionization studies, the identification and removal of RFI is especially important. In addition to improved RFI identification, we must also take into account computational efficiency of the RFI-Identification algorithm as radio interferometer arrays such as the Hydrogen Epoch of Reionization Array (HERA) grow larger in number of receivers. To address this, we present a deep fully convolutional neural network (DFCN) that is comprehensive in its use of interferometric data, where both amplitude and phase information are used jointly for identifying RFI. We train the network using simulated HERA visibilities containing mock RFI, yielding a known 'ground truth' data set for evaluating the accuracy of various RFI algorithms. Evaluation of the DFCN model is performed on observations from the 67 dish build-out, HERA-67, and achieves a data throughput of 1.6 x 10(5) HERA time-ordered 1024 channelled visibilities per hour per GPU. We determine that relative to an amplitude only network including visibility phase adds important adjacent time-frequency context which increases discrimination between RFI and non-RFI. The inclusion of phase when predicting achieves a recall of 0.81, precision of 0.58, and F-2 score of 0.75 as applied to our HERA-67 observations.
Keywords:
methods: data analysis
techniques: interferometric

Journal

Monthly Notices of the Royal Astronomical Society cover
Monthly Notices of the Royal Astronomical Society
IF:
4.8
Papers:
7.1W
Citations:
25.0W

Organization

B
brown university
Scholars:
1.1K
Papers: 444
Citations: 0
U
University of Melbourne
Scholars:
2.3K
Papers: 950
Citations: 0
I
istituto nazionale astrofisica (inaf)
Scholars:
0
Papers: 86
Citations: 0
N
national radio astronomy observatory (nrao)
Scholars:
0
Papers: 17
Citations: 0
R
Rhodes University
Scholars:
112
Papers: 53
Citations: 0
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
U
University of Cambridge
Scholars:
5.1K
Papers: 1.9K
Citations: 0
U
University of Pennsylvania
Scholars:
4.3K
Papers: 1.3K
Citations: 0
S
ska south africa
Scholars:
313
Papers: 125
Citations: 0
U
university of washington
Scholars:
4.5K
Papers: 1.5K
Citations: 0
U
university of california berkeley
Scholars:
462
Papers: 194
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Hydrogen Epoch of Reionization Array (HERA)
err2017-03-02
err570
errOAAI
errDeBoer, David R.; Parsons, Aaron R.; Aguirre, James E.; Alexander, Paul; Ali, Zaki S.; Beardsley, Adam P.; Bernardi, Gianni; Bowman, Judd D.; Bradley, Richard F.; Carilli, Chris L.; Cheng, Carina; Acedo, Eloy de Lera; Dillon, Joshua S.; Ewall-Wice, Aaron; Fadana, Gcobisa; Fagnoni, Nicolas; Fritz, Randall; Furlanetto, Steve R.; Glendenning, Brian; Greig, Bradley; Grobbelaar, Jasper; Hazelton, Bryna J.; Hewitt, Jacqueline N.; Hickish, Jack; Jacobs, Daniel C.; Julius, Austin; Kariseb, MacCalvin; Kohn, Saul A.; Lekalake, Telalo; Liu, Adrian; Loots, Anita; MacMahon, David; Malan, Lourence; Malgas, Cresshim; Maree, Matthys; Martinot, Zachary; Mathison, Nathan; Matsetela, Eunice; Mesinger, Andrei; Morales, Miguel F.; Neben, Abraham R.; Patra, Nipanjana; Pieterse, Samantha; Pober, Jonathan C.; Razavi-Ghods, Nima; Ringuette, Jon; Robnett, James; Rosie, Kathryn; Sell, Raddwine; Smith, Craig; Syce, Angelo; Tegmark, Max; Thyagarajan, Nithyanandan; Williams, Peter K. G.; Zheng, Haoxuan
errShare
errSave
A model of diffuse Galactic radio emission from 10 MHz to 100 GHz
err2008-07-21
err388
errOAAI
errde Oliveira-Costa, Angelica; Tegmark, Max; Gaensler, B. M.; Jonas, Justin; Landecker, T. L.; Reich, Patricia
errShare
errSave
A PER-BASELINE, DELAY-SPECTRUM TECHNIQUE FOR ACCESSING THE 21 cm COSMIC REIONIZATION SIGNATURE
err2012-08-24
err268
errOAAI
errParsons, Aaron R.; Pober, Jonathan C.; Aguirre, James E.; Carilli, Christopher L.; Jacobs, Daniel C.; Moore, David F.
errShare
errSave
GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey - I. A low-frequency extragalactic catalogue
err2016-09-16
err425
errOAAI
errHurley-Walker, N.; Callingham, J. R.; Hancock, P. J.; Franzen, T. M. O.; Hindson, L.; Kapinska, A. D.; Morgan, J.; Offringa, A. R.; Wayth, R. B.; Wu, C.; Zheng, Q.; Murphy, T.; Bell, M. E.; Dwarakanath, K. S.; For, B.; Gaensler, B. M.; Johnston-Hollitt, M.; Lenc, E.; Procopio, P.; Staveley-Smith, L.; Ekers, R.; Bowman, J. D.; Briggs, F.; Cappallo, R. J.; Deshpande, A. A.; Greenhill, L.; Hazelton, B. J.; Kaplan, D. L.; Lonsdale, C. J.; McWhirter, S. R.; Mitchell, D. A.; Morales, M. F.; Morgan, E.; Oberoi, D.; Ord, S. M.; Prabu, T.; Shankar, N. Udaya; Srivani, K. S.; Subrahmanyan, R.; Tingay, S. J.; Webster, R. L.; Williams, A.; Williams, C. L.
errShare
errSave
Traces of her workings
err1992-09-01
err0
PREAI
errGeoffrey Duyk; Julie M. Gastier; Robert F. Mueller
errShare
errSave
ImageNet Classification with Deep Convolutional Neural Networks
err2017-05-24
err8.3W
errOAAI
errKrizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E.
errShare
errSave
A SEARCH FOR FAST RADIO BURSTS AT LOW FREQUENCIES WITH MURCHISON WIDEFIELD ARRAY HIGH TIME RESOLUTION IMAGING
err2015-12-10
err57
errOAAI
errTingay, S. J.; Trott, C. M.; Wayth, R. B.; Bernardi, G.; Bowman, J. D.; Briggs, F.; Cappallo, R. J.; Deshpande, A. A.; Feng, L.; Gaensler, B. M.; Greenhill, L. J.; Hancock, P. J.; Hazelton, B. J.; Johnston-Hollitt, M.; Kaplan, D. L.; Lonsdale, C. J.; McWhirter, S. R.; Mitchell, D. A.; Morales, M. F.; Morgan, E.; Murphy, T.; Oberoi, D.; Prabu, T.; Shankar, N. Udaya; Srivani, K. S.; Subrahmanyan, R.; Webster, R. L.; Williams, A.; Williams, C. L.
errShare
errSave
Fast Radio Burst 121102 Pulse Detection and Periodicity: A Machine Learning Approach
err2018-10-23
err154
errOAAI
errZhang, Yunfan Gerry; Gajjar, Vishal; Foster, Griffin; Siemion, Andrew; Cordes, James; Law, Casey; Wang, Yu
errShare
errSave
researcher View more