Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study With the Hydrogen Epoch of Reionization Array

Dara Storer; Joshua S. Dillon; Daniel C. Jacobs; Miguel F. Morales; Bryna J. Hazelton; Aaron Ewall-Wice; Zara Abdurashidova; James E. Aguirre; Paul Alexander; Zaki S. Ali; Yanga Balfour; Adam P. Beardsley; Gianni Bernardi; Tashalee S. Billings; Judd D. Bowman; Richard F. Bradley; Philip Bull; Jacob Burba; Steven Carey; Chris L. Carilli; Carina Cheng; David R. DeBoer; Eloy de Lera Acedo; Matt Dexter; Scott Dynes; John Ely; Nicolas Fagnoni; Randall Fritz; Steven R. Furlanetto; Kingsley Gale-Sides; Brian Glendenning; Deepthi Gorthi; Bradley Greig; Jasper Grobbelaar; Ziyaad Halday; Jacqueline N. Hewitt; Jack Hickish; Tian Huang; Alec Josaitis; Austin Julius; MacCalvin Kariseb; Nicholas S. Kern; Joshua Kerrigan; Piyanat Kittiwisit; Saul A. Kohn; Matthew Kolopanis; Adam Lanman; Paul La Plante; Adrian Liu; Anita Loots; David MacMahon; Lourence Malan; Cresshim Malgas; Zachary E. Martinot; Andrei Mesinger; Mathakane Molewa; Tshegofalang Mosiane; Steven G. Murray; Abraham R. Neben; Bojan Nikolic; Chuneeta Devi Nunhokee; Aaron R. Parsons; Robert Pascua; Nipanjana Patra; Samantha Pieterse; Jonathan C. Pober; Nima Razavi-Ghods; Daniel Riley; James Robnett; Kathryn Rosie; Mario G. Santos; Peter Sims; Saurabh Singh; Craig Smith; Jianrong Tan; Nithyanandan Thyagarajan; Peter K.G. Williams; Haoxuan Zheng

doi:10.1029/2021RS007376

Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study With the Hydrogen Epoch of Reionization Array

Dara Storer, Joshua S. Dillon, Daniel C. Jacobs, Miguel F. Morales, Bryna J. Hazelton, Aaron Ewall-Wice, Zara Abdurashidova, James E. Aguirre, Paul Alexander, Zaki S. Ali, Yanga Balfour, Adam P. Beardsley, Gianni Bernardi, Tashalee S. Billings, Judd D. Bowman, Richard F. Bradley, Philip Bull, Jacob Burba, Steven Carey, Chris L. CarilliCarina Cheng, David R. DeBoer, Eloy de Lera Acedo, Matt Dexter, Scott Dynes, John Ely, Nicolas Fagnoni, Randall Fritz, Steven R. Furlanetto, Kingsley Gale-Sides, Brian Glendenning, Deepthi Gorthi, Bradley Greig, Jasper Grobbelaar, Ziyaad Halday, Jacqueline N. Hewitt, Jack Hickish, Tian Huang, Alec Josaitis, Austin Julius, MacCalvin Kariseb, Nicholas S. Kern, Joshua Kerrigan, Piyanat Kittiwisit, Saul A. Kohn, Matthew Kolopanis, Adam Lanman, Paul La Plante, Adrian Liu, Anita Loots, David MacMahon, Lourence Malan, Cresshim Malgas, Zachary E. Martinot, Andrei Mesinger, Mathakane Molewa, Tshegofalang Mosiane, Steven G. Murray, Abraham R. Neben, Bojan Nikolic, Chuneeta Devi Nunhokee, Aaron R. Parsons, Robert Pascua, Nipanjana Patra, Samantha Pieterse, Jonathan C. Pober, Nima Razavi-Ghods, Daniel Riley, James Robnett, Kathryn Rosie, Mario G. Santos, Peter Sims, Saurabh Singh, Craig Smith, Jianrong Tan, Nithyanandan Thyagarajan, Peter K.G. Williams, Haoxuan Zheng

Earth and Space Exploration, School of (SESE)

Research output: Contribution to journal › Article › peer-review

2 Scopus citations

Abstract

We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.

Original language	English (US)
Article number	e2021RS007376
Journal	Radio Science
Volume	57
Issue number	1
DOIs	https://doi.org/10.1029/2021RS007376
State	Published - Jan 2022

Keywords

flagging
interferometry
radio cosmology
reionization
systematics

ASJC Scopus subject areas

Condensed Matter Physics
General Earth and Planetary Sciences
Electrical and Electronic Engineering

Access to Document

10.1029/2021RS007376

Cite this

Storer, D., Dillon, J. S., Jacobs, D. C., Morales, M. F., Hazelton, B. J., Ewall-Wice, A., Abdurashidova, Z., Aguirre, J. E., Alexander, P., Ali, Z. S., Balfour, Y., Beardsley, A. P., Bernardi, G., Billings, T. S., Bowman, J. D., Bradley, R. F., Bull, P., Burba, J., Carey, S., ... Zheng, H. (2022). Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study With the Hydrogen Epoch of Reionization Array. Radio Science, 57(1), Article e2021RS007376. https://doi.org/10.1029/2021RS007376

Storer, D, Dillon, JS, Jacobs, DC, Morales, MF, Hazelton, BJ, Ewall-Wice, A, Abdurashidova, Z, Aguirre, JE, Alexander, P, Ali, ZS, Balfour, Y, Beardsley, AP, Bernardi, G, Billings, TS, Bowman, JD, Bradley, RF, Bull, P, Burba, J, Carey, S, Carilli, CL, Cheng, C, DeBoer, DR, de Lera Acedo, E, Dexter, M, Dynes, S, Ely, J, Fagnoni, N, Fritz, R, Furlanetto, SR, Gale-Sides, K, Glendenning, B, Gorthi, D, Greig, B, Grobbelaar, J, Halday, Z, Hewitt, JN, Hickish, J, Huang, T, Josaitis, A, Julius, A, Kariseb, M, Kern, NS, Kerrigan, J, Kittiwisit, P, Kohn, SA, Kolopanis, M, Lanman, A, La Plante, P, Liu, A, Loots, A, MacMahon, D, Malan, L, Malgas, C, Martinot, ZE, Mesinger, A, Molewa, M, Mosiane, T, Murray, SG, Neben, AR, Nikolic, B, Nunhokee, CD, Parsons, AR, Pascua, R, Patra, N, Pieterse, S, Pober, JC, Razavi-Ghods, N, Riley, D, Robnett, J, Rosie, K, Santos, MG, Sims, P, Singh, S, Smith, C, Tan, J, Thyagarajan, N, Williams, PKG & Zheng, H 2022, 'Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study With the Hydrogen Epoch of Reionization Array', Radio Science, vol. 57, no. 1, e2021RS007376. https://doi.org/10.1029/2021RS007376

@article{a93a585c834b494ca99ce4f7110a6a62,

title = "Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study With the Hydrogen Epoch of Reionization Array",

abstract = "We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.",

keywords = "flagging, interferometry, radio cosmology, reionization, systematics",

author = "Dara Storer and Dillon, {Joshua S.} and Jacobs, {Daniel C.} and Morales, {Miguel F.} and Hazelton, {Bryna J.} and Aaron Ewall-Wice and Zara Abdurashidova and Aguirre, {James E.} and Paul Alexander and Ali, {Zaki S.} and Yanga Balfour and Beardsley, {Adam P.} and Gianni Bernardi and Billings, {Tashalee S.} and Bowman, {Judd D.} and Bradley, {Richard F.} and Philip Bull and Jacob Burba and Steven Carey and Carilli, {Chris L.} and Carina Cheng and DeBoer, {David R.} and {de Lera Acedo}, Eloy and Matt Dexter and Scott Dynes and John Ely and Nicolas Fagnoni and Randall Fritz and Furlanetto, {Steven R.} and Kingsley Gale-Sides and Brian Glendenning and Deepthi Gorthi and Bradley Greig and Jasper Grobbelaar and Ziyaad Halday and Hewitt, {Jacqueline N.} and Jack Hickish and Tian Huang and Alec Josaitis and Austin Julius and MacCalvin Kariseb and Kern, {Nicholas S.} and Joshua Kerrigan and Piyanat Kittiwisit and Kohn, {Saul A.} and Matthew Kolopanis and Adam Lanman and {La Plante}, Paul and Adrian Liu and Anita Loots and David MacMahon and Lourence Malan and Cresshim Malgas and Martinot, {Zachary E.} and Andrei Mesinger and Mathakane Molewa and Tshegofalang Mosiane and Murray, {Steven G.} and Neben, {Abraham R.} and Bojan Nikolic and Nunhokee, {Chuneeta Devi} and Parsons, {Aaron R.} and Robert Pascua and Nipanjana Patra and Samantha Pieterse and Pober, {Jonathan C.} and Nima Razavi-Ghods and Daniel Riley and James Robnett and Kathryn Rosie and Santos, {Mario G.} and Peter Sims and Saurabh Singh and Craig Smith and Jianrong Tan and Nithyanandan Thyagarajan and Williams, {Peter K.G.} and Haoxuan Zheng",

year = "2022",

month = jan,

doi = "10.1029/2021RS007376",

language = "English (US)",

volume = "57",

journal = "Radio Science",

issn = "0048-6604",

publisher = "American Geophysical Union",

number = "1",

}

TY - JOUR

T1 - Automated Detection of Antenna Malfunctions in Large-N Interferometers

T2 - A Case Study With the Hydrogen Epoch of Reionization Array

AU - Storer, Dara

AU - Dillon, Joshua S.

AU - Jacobs, Daniel C.

AU - Morales, Miguel F.

AU - Hazelton, Bryna J.

AU - Ewall-Wice, Aaron

AU - Abdurashidova, Zara

AU - Aguirre, James E.

AU - Alexander, Paul

AU - Ali, Zaki S.

AU - Balfour, Yanga

AU - Beardsley, Adam P.

AU - Bernardi, Gianni

AU - Billings, Tashalee S.

AU - Bowman, Judd D.

AU - Bradley, Richard F.

AU - Bull, Philip

AU - Burba, Jacob

AU - Carey, Steven

AU - Carilli, Chris L.

AU - Cheng, Carina

AU - DeBoer, David R.

AU - de Lera Acedo, Eloy

AU - Dexter, Matt

AU - Dynes, Scott

AU - Ely, John

AU - Fagnoni, Nicolas

AU - Fritz, Randall

AU - Furlanetto, Steven R.

AU - Gale-Sides, Kingsley

AU - Glendenning, Brian

AU - Gorthi, Deepthi

AU - Greig, Bradley

AU - Grobbelaar, Jasper

AU - Halday, Ziyaad

AU - Hewitt, Jacqueline N.

AU - Hickish, Jack

AU - Huang, Tian

AU - Josaitis, Alec

AU - Julius, Austin

AU - Kariseb, MacCalvin

AU - Kern, Nicholas S.

AU - Kerrigan, Joshua

AU - Kittiwisit, Piyanat

AU - Kohn, Saul A.

AU - Kolopanis, Matthew

AU - Lanman, Adam

AU - La Plante, Paul

AU - Liu, Adrian

AU - Loots, Anita

AU - MacMahon, David

AU - Malan, Lourence

AU - Malgas, Cresshim

AU - Martinot, Zachary E.

AU - Mesinger, Andrei

AU - Molewa, Mathakane

AU - Mosiane, Tshegofalang

AU - Murray, Steven G.

AU - Neben, Abraham R.

AU - Nikolic, Bojan

AU - Nunhokee, Chuneeta Devi

AU - Parsons, Aaron R.

AU - Pascua, Robert

AU - Patra, Nipanjana

AU - Pieterse, Samantha

AU - Pober, Jonathan C.

AU - Razavi-Ghods, Nima

AU - Riley, Daniel

AU - Robnett, James

AU - Rosie, Kathryn

AU - Santos, Mario G.

AU - Sims, Peter

AU - Singh, Saurabh

AU - Smith, Craig

AU - Tan, Jianrong

AU - Thyagarajan, Nithyanandan

AU - Williams, Peter K.G.

AU - Zheng, Haoxuan

PY - 2022/1

Y1 - 2022/1

N2 - We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.

AB - We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.

KW - flagging

KW - interferometry

KW - radio cosmology

KW - reionization

KW - systematics

UR - http://www.scopus.com/inward/record.url?scp=85123737423&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85123737423&partnerID=8YFLogxK

U2 - 10.1029/2021RS007376

DO - 10.1029/2021RS007376

M3 - Article

SN - 0048-6604

VL - 57

JO - Radio Science

JF - Radio Science

IS - 1

M1 - e2021RS007376

ER -

Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study With the Hydrogen Epoch of Reionization Array

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this