-
Investigating Mutual Coupling in the Hydrogen Epoch of Reionization Array and Mitigating its Effects on the 21-cm Power Spectrum
Authors:
E. Rath,
R. Pascua,
A. T. Josaitis,
A. Ewall-Wice,
N. Fagnoni,
E. de Lera Acedo,
Z. E. Martinot,
Z. Abdurashidova,
T. Adams,
J. E. Aguirre,
R. Baartman,
A. P. Beardsley,
L. M. Berkhout,
G. Bernardi,
T. S. Billings,
J. D. Bowman,
P. Bull,
J. Burba,
R. Byrne,
S. Carey,
K. -F. Chen,
S. Choudhuri,
T. Cox,
D. R. DeBoer,
M. Dexter
, et al. (56 additional authors not shown)
Abstract:
Interferometric experiments designed to detect the highly redshifted 21-cm signal from neutral hydrogen are producing increasingly stringent constraints on the 21-cm power spectrum, but some k-modes remain systematics-dominated. Mutual coupling is a major systematic that must be overcome in order to detect the 21-cm signal, and simulations that reproduce effects seen in the data can guide strategi…
▽ More
Interferometric experiments designed to detect the highly redshifted 21-cm signal from neutral hydrogen are producing increasingly stringent constraints on the 21-cm power spectrum, but some k-modes remain systematics-dominated. Mutual coupling is a major systematic that must be overcome in order to detect the 21-cm signal, and simulations that reproduce effects seen in the data can guide strategies for mitigating mutual coupling. In this paper, we analyse 12 nights of data from the Hydrogen Epoch of Reionization Array and compare the data against simulations that include a computationally efficient and physically motivated semi-analytic treatment of mutual coupling. We find that simulated coupling features qualitatively agree with coupling features in the data; however, coupling features in the data are brighter than the simulated features, indicating the presence of additional coupling mechanisms not captured by our model. We explore the use of fringe-rate filters as mutual coupling mitigation tools and use our simulations to investigate the effects of mutual coupling on a simulated cosmological 21-cm power spectrum in a "worst case" scenario where the foregrounds are particularly bright. We find that mutual coupling contaminates a large portion of the "EoR Window", and the contamination is several orders-of-magnitude larger than our simulated cosmic signal across a wide range of cosmological Fourier modes. While our fiducial fringe-rate filtering strategy reduces mutual coupling by roughly a factor of 100 in power, a non-negligible amount of coupling cannot be excised with fringe-rate filters, so more sophisticated mitigation strategies are required.
△ Less
Submitted 12 June, 2024;
originally announced June 2024.
-
21cmSense v2: A modular, open-source 21cm sensitivity calculator
Authors:
Steven G. Murray,
Jonathan Pober,
Matthew Kolopanis
Abstract:
The 21cm line of neutral hydrogen is a powerful probe of the high-redshift universe (Cosmic Dawn and the Epoch of Reionization), with an unprecedented potential to inform us about key processes of early galaxy formation, the first stars and even cosmology and structure formation, via intensity mapping. It is the subject of a number of current and upcoming low-frequency radio experiments. This pape…
▽ More
The 21cm line of neutral hydrogen is a powerful probe of the high-redshift universe (Cosmic Dawn and the Epoch of Reionization), with an unprecedented potential to inform us about key processes of early galaxy formation, the first stars and even cosmology and structure formation, via intensity mapping. It is the subject of a number of current and upcoming low-frequency radio experiments. This paper presents 21cmSense v2.0, which is a Python package that provides a modular framework for calculating the sensitivity of these experiments, in order to enhance the process of their design and forecasting their power for parameter inference. Version 2.0 of 21cmSense has been re-written from the ground up to be more modular and extensible than its venerable predecessor (Pober et al., 2013, 2014), and to provide a more user-friendly interface. The package is freely available both to use and contribute towards at https://github.com/rasg-affiliates/21cmSense.
△ Less
Submitted 4 June, 2024;
originally announced June 2024.
-
A Multi-Model Ensemble System for the outer Heliosphere (MMESH): Solar Wind Conditions near Jupiter
Authors:
M. J. Rutala,
C. M. Jackman,
M. J. Owens,
C. Tao,
A. R. Fogg,
S. A. Murray,
L. Barnard
Abstract:
How the solar wind influences the magnetospheres of the outer planets is a fundamentally important question, but is difficult to answer in the absence of consistent, simultaneous monitoring of the upstream solar wind and the large-scale dynamics internal to the magnetosphere. To compensate for the relative lack of in-situ data, propagation models are often used to estimate the ambient solar wind c…
▽ More
How the solar wind influences the magnetospheres of the outer planets is a fundamentally important question, but is difficult to answer in the absence of consistent, simultaneous monitoring of the upstream solar wind and the large-scale dynamics internal to the magnetosphere. To compensate for the relative lack of in-situ data, propagation models are often used to estimate the ambient solar wind conditions at the outer planets for comparison to remote observations or in-situ measurements. This introduces another complication: the propagation of near-Earth solar wind measurements introduces difficult-to-assess uncertainties. Here, we present the Multi-Model Ensemble System for the outer Heliosphere (MMESH) to begin to address these issues, along with the resultant multi-model ensemble (MME) of the solar wind conditions near Jupiter. MMESH accepts as input any number of solar wind models together with contemporaneous in-situ spacecraft data. From these, the system characterizes typical uncertainties in model timing, quantifies how these uncertainties vary under different conditions, attempts to correct for systematic biases in the input model timing, and composes a MME with uncertainties from the results. For the case of the Jupiter-MME presented here, three solar wind propagation models were compared to in-situ measurements from the near-Jupiter spacecraft Ulysses and Juno which span diverse geometries and phases of the solar cycle, amounting to more than 14,000 hours of data over 2.5 decades. The MME gives the most-probable near-Jupiter solar wind conditions for times within the tested epoch, outperforming the input models and returning quantified estimates of uncertainty.
△ Less
Submitted 29 February, 2024;
originally announced February 2024.
-
A demonstration of the effect of fringe-rate filtering in the Hydrogen Epoch of Reionization Array delay power spectrum pipeline
Authors:
Hugh Garsden,
Philip Bull,
Mike Wilensky,
Zuhra Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Lindsay M. Berkhout,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Kai-Feng Chen,
Carina Cheng,
Samir Choudhuri,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter
, et al. (72 additional authors not shown)
Abstract:
Radio interferometers targeting the 21cm brightness temperature fluctuations at high redshift are subject to systematic effects that operate over a range of different timescales. These can be isolated by designing appropriate Fourier filters that operate in fringe-rate (FR) space, the Fourier pair of local sidereal time (LST). Applications of FR filtering include separating effects that are correl…
▽ More
Radio interferometers targeting the 21cm brightness temperature fluctuations at high redshift are subject to systematic effects that operate over a range of different timescales. These can be isolated by designing appropriate Fourier filters that operate in fringe-rate (FR) space, the Fourier pair of local sidereal time (LST). Applications of FR filtering include separating effects that are correlated with the rotating sky vs. those relative to the ground, down-weighting emission in the primary beam sidelobes, and suppressing noise. FR filtering causes the noise contributions to the visibility data to become correlated in time however, making interpretation of subsequent averaging and error estimation steps more subtle. In this paper, we describe fringe rate filters that are implemented using discrete prolate spheroidal sequences, and designed for two different purposes -- beam sidelobe/horizon suppression (the `mainlobe' filter), and ground-locked systematics removal (the `notch' filter). We apply these to simulated data, and study how their properties affect visibilities and power spectra generated from the simulations. Included is an introduction to fringe-rate filtering and a demonstration of fringe-rate filters applied to simple situations to aid understanding.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
Hydrogen Epoch of Reionization Array (HERA) Phase II Deployment and Commissioning
Authors:
Lindsay M. Berkhout,
Daniel C. Jacobs,
Zuhra Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Kai-Feng Chen,
Carina Cheng,
Samir Choudhuri,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Joshua S. Dillon
, et al. (71 additional authors not shown)
Abstract:
This paper presents the design and deployment of the Hydrogen Epoch of Reionization Array (HERA) phase II system. HERA is designed as a staged experiment targeting 21 cm emission measurements of the Epoch of Reionization. First results from the phase I array are published as of early 2022, and deployment of the phase II system is nearing completion. We describe the design of the phase II system an…
▽ More
This paper presents the design and deployment of the Hydrogen Epoch of Reionization Array (HERA) phase II system. HERA is designed as a staged experiment targeting 21 cm emission measurements of the Epoch of Reionization. First results from the phase I array are published as of early 2022, and deployment of the phase II system is nearing completion. We describe the design of the phase II system and discuss progress on commissioning and future upgrades. As HERA is a designated Square Kilometer Array (SKA) pathfinder instrument, we also show a number of "case studies" that investigate systematics seen while commissioning the phase II system, which may be of use in the design and operation of future arrays. Common pathologies are likely to manifest in similar ways across instruments, and many of these sources of contamination can be mitigated once the source is identified.
△ Less
Submitted 8 January, 2024;
originally announced January 2024.
-
matvis: A matrix-based visibility simulator for fast forward modelling of many-element 21 cm arrays
Authors:
Piyanat Kittiwisit,
Steven G. Murray,
Hugh Garsden,
Philip Bull,
Christopher Cain,
Aaron R. Parsons,
Jackson Sipple,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Lindsay M. Berkhout,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Kai-Feng Chen,
Carina Cheng
, et al. (73 additional authors not shown)
Abstract:
Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionisation will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability…
▽ More
Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionisation will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability to perform high-fidelity simulations of the kinds of data that are produced by the large, many-element, radio interferometric arrays that have been purpose-built for these studies. The large scale of these arrays presents a computational challenge, as one must simulate a detailed sky and instrumental model across many hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines for arrays with hundreds of antennas. In this paper, we present a fast matrix-based method for simulating radio interferometric measurements (visibilities) at the necessary scale. We achieve this through judicious use of primary beam interpolation, fast approximations for coordinate transforms, and a vectorised outer product to expand per-antenna quantities to per-baseline visibilities, coupled with standard parallelisation techniques. We validate the results of this method, implemented in the publicly-available matvis code, against a high-precision reference simulator, and explore its computational scaling on a variety of problems.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
Bayesian estimation of cross-coupling and reflection systematics in 21cm array visibility data
Authors:
Geoff G. Murphy,
Philip Bull,
Mario G. Santos,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Christopher Cain,
Steven Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Joshua S. Dillon,
Nico Eksteen
, et al. (54 additional authors not shown)
Abstract:
Observations with radio arrays that target the 21-cm signal originating from the early Universe suffer from a variety of systematic effects. An important class of these are reflections and spurious couplings between antennas. We apply a Hamiltonian Monte Carlo sampler to the modelling and mitigation of these systematics in simulated Hydrogen Epoch of Reionisation Array (HERA) data. This method all…
▽ More
Observations with radio arrays that target the 21-cm signal originating from the early Universe suffer from a variety of systematic effects. An important class of these are reflections and spurious couplings between antennas. We apply a Hamiltonian Monte Carlo sampler to the modelling and mitigation of these systematics in simulated Hydrogen Epoch of Reionisation Array (HERA) data. This method allows us to form statistical uncertainty estimates for both our models and the recovered visibilities, which is an important ingredient in establishing robust upper limits on the Epoch of Reionisation (EoR) power spectrum. In cases where the noise is large compared to the EoR signal, this approach can constrain the systematics well enough to mitigate them down to the noise level for both systematics studied. Where the noise is smaller than the EoR, our modelling can mitigate the majority of the reflections with there being only a minor level of residual systematics, while cross-coupling sees essentially complete mitigation. Our approach performs similarly to existing filtering/fitting techniques used in the HERA pipeline, but with the added benefit of rigorously propagating uncertainties. In all cases it does not significantly attenuate the underlying signal.
△ Less
Submitted 6 December, 2023;
originally announced December 2023.
-
Direct Optimal Mapping Image Power Spectrum and its Window Functions
Authors:
Zhilei Xu,
Honggeun Kim,
Jacqueline N. Hewitt,
Kai-Feng Chen,
Nicholas S. Kern,
Eleanor Rath,
Ruby Byrne,
Adélie Gorce,
Robert Pascua,
Zachary E. Martinot,
Joshua S. Dillon,
Bryna J. Hazelton,
Adrian Liu,
Miguel F. Morales,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman
, et al. (57 additional authors not shown)
Abstract:
The key to detecting neutral hydrogen during the epoch of reionization (EoR) is to separate the cosmological signal from the dominating foreground radiation. We developed direct optimal mapping (DOM) to map interferometric visibilities; it contains only linear operations, with full knowledge of point spread functions from visibilities to images. Here, we demonstrate a fast Fourier transform-based…
▽ More
The key to detecting neutral hydrogen during the epoch of reionization (EoR) is to separate the cosmological signal from the dominating foreground radiation. We developed direct optimal mapping (DOM) to map interferometric visibilities; it contains only linear operations, with full knowledge of point spread functions from visibilities to images. Here, we demonstrate a fast Fourier transform-based image power spectrum and its window functions computed from the DOM images. We use noiseless simulation, based on the Hydrogen Epoch of Reionization Array Phase I configuration, to study the image power spectrum properties. The window functions show $<10^{-11}$ of the integrated power leaks from the foreground-dominated region into the EoR window; the 2D and 1D power spectra also verify the separation between the foregrounds and the EoR.
△ Less
Submitted 5 July, 2024; v1 submitted 17 November, 2023;
originally announced November 2023.
-
21cmEMU: an emulator of 21cmFAST summary observables
Authors:
Daniela Breitman,
Andrei Mesinger,
Steven Murray,
David Prelogovic,
Yuxiang Qin,
Roberto Trotta
Abstract:
Recent years have witnessed rapid progress in observations of the Epoch of Reionization (EoR). These have enabled high-dimensional inference of galaxy and intergalactic medium (IGM) properties during the first billion years of our Universe. However, even using efficient, semi-numerical simulations, traditional inference approaches that compute 3D lightcones on-the-fly can take $10^5$ core hours. H…
▽ More
Recent years have witnessed rapid progress in observations of the Epoch of Reionization (EoR). These have enabled high-dimensional inference of galaxy and intergalactic medium (IGM) properties during the first billion years of our Universe. However, even using efficient, semi-numerical simulations, traditional inference approaches that compute 3D lightcones on-the-fly can take $10^5$ core hours. Here we present 21cmEMU: an emulator of several summary observables from the popular 21cmFAST simulation code. 21cmEMU takes as input nine parameters characterizing EoR galaxies, and outputs the following summary statistics: (i) the IGM mean neutral fraction; (ii) the 21-cm power spectrum; (iii) the mean 21-cm spin temperature; (iv) the sky-averaged (global) 21-cm signal; (vi) the ultraviolet (UV) luminosity functions (LFs); and (vii) the Thomson scattering optical depth to the cosmic microwave background (CMB). All observables are predicted with sub-percent median accuracy, with a reduction of the computational cost by a factor of over 10$^4$. After validating inference results, we showcase a few applications, including: (i) quantifying the relative constraining power of different observational datasets; (ii) seeing how recent claims of a late EoR impact previous inferences; and (iii) forecasting upcoming constraints from the sixth observing season of the Hydrogen Epoch of Reionization Array (HERA) telescope. 21cmEMU is publicly-available, and is included as an alternative simulator in the public 21CMMC sampler.
△ Less
Submitted 11 September, 2023;
originally announced September 2023.
-
The science behind SURROUND: a constellation of CubeSats around the Sun
Authors:
D. M. Weigt,
L. A. Cañizares,
S. A. Maloney,
S. A. Murray,
E. P. Carley,
P. T. Gallagher,
A. Macario-Rojas,
N. Crisp,
C. McGrath
Abstract:
One of the greatest challenge facing current space weather monitoring operations is forecasting the arrival of coronal mass ejections (CMEs) and Solar Energetic Particles (SEPs) within their Earth-Sun propagation timescales. Current campaigns mainly rely on extreme ultra-violet and white light observations to create forecasts, missing out many potential events that may be hazardous to Earth's infr…
▽ More
One of the greatest challenge facing current space weather monitoring operations is forecasting the arrival of coronal mass ejections (CMEs) and Solar Energetic Particles (SEPs) within their Earth-Sun propagation timescales. Current campaigns mainly rely on extreme ultra-violet and white light observations to create forecasts, missing out many potential events that may be hazardous to Earth's infrastructure undetectable at these wavelengths. Here we introduce the SURROUND mission, a constellation of CubeSats each with identical radio spectrometers, and the results of the initial Phase-0 study for the concept. The main goal of SURROUND is to monitor and track solar radio bursts (SRBs), widely utilised as a useful diagnostic for space weather activity, and revolutionise current forecasting capabilities. The Phase-0 study concludes that SURROUND can achieve its mission objectives using 3 - 5 spacecraft using current technologies with feasible SEP and CME forecasting potential: a first for heliospheric monitors.
△ Less
Submitted 9 August, 2023; v1 submitted 8 August, 2023;
originally announced August 2023.
-
Low-Frequency Radio Recombination Lines Away From the Inner Galactic Plane
Authors:
Akshatha K. Vydula,
Judd D. Bowman,
David Lewis,
Kelsie Crawford,
Matthew Kolopanis,
Alan E. E. Rogers,
Steven G. Murray,
Nivedita Mahesh,
Raul A. Monsalve,
Peter Sims,
Titu Samson
Abstract:
Diffuse radio recombination lines (RRLs) in the Galaxy are possible foregrounds for redshifted 21~cm experiments. We use EDGES drift scans centered at $-26.7^o$~declination to characterize diffuse RRLs across the southern sky. We find RRLs averaged over the large antenna beam ($ 72^o \times 110^o $) reach minimum amplitudes between right ascensions~2-6~h. In this region, the C$α$ absorption amplit…
▽ More
Diffuse radio recombination lines (RRLs) in the Galaxy are possible foregrounds for redshifted 21~cm experiments. We use EDGES drift scans centered at $-26.7^o$~declination to characterize diffuse RRLs across the southern sky. We find RRLs averaged over the large antenna beam ($ 72^o \times 110^o $) reach minimum amplitudes between right ascensions~2-6~h. In this region, the C$α$ absorption amplitude is $33\pm11$~mK (1$σ$) averaged over 50-87~MHz ($27\gtrsim z \gtrsim15$ for the 21~cm line) and increases strongly as frequency decreases. C$β$ and H$α$ lines are consistent with no detection with amplitudes of $13\pm14$ and $12\pm10$~mK (1$σ$), respectively. At 108-124.5~MHz ($z\approx11$) in the same region, we find no evidence for carbon or hydrogen lines at the noise level of 3.4~mK (1$σ$). Conservatively assuming observed lines come broadly from the diffuse interstellar medium, as opposed to a few compact regions, these amplitudes provide upper limits on the intrinsic diffuse lines. The observations support expectations that Galactic RRLs can be neglected as significant foregrounds for a large region of sky until redshifted 21~cm experiments, particularly those targeting Cosmic Dawn, move beyond the detection phase. We fit models of the spectral dependence of the lines averaged over the large beam of EDGES, which may contain multiple line sources with possible line blending, and find that including degrees of freedom for expected smooth, frequency-dependent deviations from local thermodynamic equilibrium (LTE) is preferred over simple LTE assumptions for C$α$ and H$α$ lines. For C$α$ we estimate departure coefficients $0.79<b_nβ_n<4.5$ along the inner Galactic Plane and $0<b_nβ_n<2.3$ away from the inner Galactic Plane.
△ Less
Submitted 1 November, 2023; v1 submitted 27 February, 2023;
originally announced February 2023.
-
Search for the Epoch of Reionisation with HERA: Upper Limits on the Closure Phase Delay Power Spectrum
Authors:
Pascal M. Keller,
Bojan Nikolic,
Nithyanandan Thyagarajan,
Chris L. Carilli,
Gianni Bernardi,
Ntsikelelo Charles,
Landman Bester,
Oleg M. Smirnov,
Nicholas S. Kern,
Joshua S. Dillon,
Bryna J. Hazelton,
Miguel F. Morales,
Daniel C. Jacobs,
Aaron R. Parsons,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley
, et al. (58 additional authors not shown)
Abstract:
Radio interferometers aiming to measure the power spectrum of the redshifted 21 cm line during the Epoch of Reionisation (EoR) need to achieve an unprecedented dynamic range to separate the weak signal from overwhelming foreground emissions. Calibration inaccuracies can compromise the sensitivity of these measurements to the effect that a detection of the EoR is precluded. An alternative to standa…
▽ More
Radio interferometers aiming to measure the power spectrum of the redshifted 21 cm line during the Epoch of Reionisation (EoR) need to achieve an unprecedented dynamic range to separate the weak signal from overwhelming foreground emissions. Calibration inaccuracies can compromise the sensitivity of these measurements to the effect that a detection of the EoR is precluded. An alternative to standard analysis techniques makes use of the closure phase, which allows one to bypass antenna-based direction-independent calibration. Similarly to standard approaches, we use a delay spectrum technique to search for the EoR signal. Using 94 nights of data observed with Phase I of the Hydrogen Epoch of Reionization Array (HERA), we place approximate constraints on the 21 cm power spectrum at $z=7.7$. We find at 95% confidence that the 21 cm EoR brightness temperature is $\le$(372)$^2$ "pseudo" mK$^2$ at 1.14 "pseudo" $h$ Mpc$^{-1}$, where the "pseudo" emphasises that these limits are to be interpreted as approximations to the actual distance scales and brightness temperatures. Using a fiducial EoR model, we demonstrate the feasibility of detecting the EoR with the full array. Compared to standard methods, the closure phase processing is relatively simple, thereby providing an important independent check on results derived using visibility intensities, or related.
△ Less
Submitted 15 February, 2023;
originally announced February 2023.
-
Heliophysics Discovery Tools for the 21st Century: Data Science and Machine Learning Structures and Recommendations for 2020-2050
Authors:
R. M. McGranaghan,
B. Thompson,
E. Camporeale,
J. Bortnik,
M. Bobra,
G. Lapenta,
S. Wing,
B. Poduval,
S. Lotz,
S. Murray,
M. Kirk,
T. Y. Chen,
H. M. Bain,
P. Riley,
B. Tremblay,
M. Cheung,
V. Delouille
Abstract:
Three main points: 1. Data Science (DS) will be increasingly important to heliophysics; 2. Methods of heliophysics science discovery will continually evolve, requiring the use of learning technologies [e.g., machine learning (ML)] that are applied rigorously and that are capable of supporting discovery; and 3. To grow with the pace of data, technology, and workforce changes, heliophysics requires…
▽ More
Three main points: 1. Data Science (DS) will be increasingly important to heliophysics; 2. Methods of heliophysics science discovery will continually evolve, requiring the use of learning technologies [e.g., machine learning (ML)] that are applied rigorously and that are capable of supporting discovery; and 3. To grow with the pace of data, technology, and workforce changes, heliophysics requires a new approach to the representation of knowledge.
△ Less
Submitted 26 December, 2022;
originally announced December 2022.
-
Analytic approximations of scattering effects on beam chromaticity in 21-cm global experiments
Authors:
Alan E. E. Rogers,
John P. Barrett,
Judd D. Bowman,
Rigel Cappallo,
Colin J. Lonsdale,
Nivedita Mahesh,
Raul A. Monsalve,
Steven G. Murray,
Peter H. Sims
Abstract:
Scattering from objects near an antenna produce correlated signals from strong compact radio sources in a manner similar to those used by the Sea Interferometer to measure the radio source positions using the fine frequency structure in the total power spectrum of a single antenna. These fringes or ripples due to correlated signal interference are present at a low level in the spectrum of any sing…
▽ More
Scattering from objects near an antenna produce correlated signals from strong compact radio sources in a manner similar to those used by the Sea Interferometer to measure the radio source positions using the fine frequency structure in the total power spectrum of a single antenna. These fringes or ripples due to correlated signal interference are present at a low level in the spectrum of any single antenna and are a major source of systematics in systems used to measure the global redshifted 21-cm signal from the early universe. In the Sea Interferometer a single antenna on a cliff above the sea is used to add the signal from the direct path to the signal from the path reflected from the sea thereby forming an interferometer. This was used for mapping radio sources with a single antenna by Bolton and Slee in the 1950s. In this paper we derive analytic expressions to determine the level of these ripples and compare these results in a few simple cases with electromagnetic modeling software to verify that the analytic calculations are sufficient to obtain the magnitude of the scattering effects on the measurements of the global 21-cm signal. These analytic calculations are needed to evaluate the magnitude of the effects in cases that are either too complex or take too much time to be modeled using software.
△ Less
Submitted 8 December, 2022;
originally announced December 2022.
-
A Bayesian approach to modelling spectrometer data chromaticity corrected using beam factors -- I. Mathematical formalism
Authors:
Peter H. Sims,
Judd D. Bowman,
Nivedita Mahesh,
Steven G. Murray,
John P. Barrett,
Rigel Cappallo,
Raul A. Monsalve,
Alan E. E. Rogers,
Titu Samson,
Akshatha K. Vydula
Abstract:
Accurately accounting for spectral structure in spectrometer data induced by instrumental chromaticity on scales relevant for detection of the 21-cm signal is among the most significant challenges in global 21-cm signal analysis. In the publicly available EDGES low-band data set, this complicating structure is suppressed using beam-factor based chromaticity correction (BFCC), which works by dividi…
▽ More
Accurately accounting for spectral structure in spectrometer data induced by instrumental chromaticity on scales relevant for detection of the 21-cm signal is among the most significant challenges in global 21-cm signal analysis. In the publicly available EDGES low-band data set, this complicating structure is suppressed using beam-factor based chromaticity correction (BFCC), which works by dividing the data by a sky-map-weighted model of the spectral structure of the instrument beam. Several analyses of this data have employed models that start with the assumption that this correction is complete. However, while BFCC mitigates the impact of instrumental chromaticity on the data, given realistic assumptions regarding the spectral structure of the foregrounds, the correction is only partial. This complicates the interpretation of fits to the data with intrinsic sky models (models that assume no instrumental contribution to the spectral structure of the data). In this paper, we derive a BFCC data model from an analytic treatment of BFCC and demonstrate using simulated observations that, in contrast to using an intrinsic sky model for the data, the BFCC data model enables unbiased recovery of a simulated global 21-cm signal from beam-factor chromaticity corrected data in the limit that the data is corrected with an error-free beam-factor model.
△ Less
Submitted 28 March, 2023; v1 submitted 7 December, 2022;
originally announced December 2022.
-
Improved Constraints on the 21 cm EoR Power Spectrum and the X-Ray Heating of the IGM with HERA Phase I Observations
Authors:
The HERA Collaboration,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Rennan Barkana,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Daniela Breitman,
Philip Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
Samir Choudhuri,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Joshua S. Dillon
, et al. (70 additional authors not shown)
Abstract:
We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $Δ^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that…
▽ More
We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $Δ^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that $Δ^2 (k = 0.36$ $h$ Mpc$^{-1}) \leq 3,496$ mK$^2$ at $z = 10.4$, an improvement by a factor of 2.1 and 2.6 respectively. These limits are mostly consistent with thermal noise over a wide range of $k$ after our data quality cuts, despite performing a relatively conservative analysis designed to minimize signal loss. Our results are validated with both statistical tests on the data and end-to-end pipeline simulations. We also report updated constraints on the astrophysics of reionization and the cosmic dawn. Using multiple independent modeling and inference techniques previously employed by HERA Collaboration (2022b), we find that the intergalactic medium must have been heated above the adiabatic cooling limit at least as early as $z = 10.4$, ruling out a broad set of so-called "cold reionization" scenarios. If this heating is due to high-mass X-ray binaries during the cosmic dawn, as is generally believed, our result's 99% credible interval excludes the local relationship between soft X-ray luminosity and star formation and thus requires heating driven by evolved low-metallicity stars.
△ Less
Submitted 19 January, 2023; v1 submitted 10 October, 2022;
originally announced October 2022.
-
Impact of instrument and data characteristics in the interferometric reconstruction of the 21 cm power spectrum
Authors:
Adélie Gorce,
Samskruthi Ganjam,
Adrian Liu,
Steven G. Murray,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Joshua S. Dillon
, et al. (53 additional authors not shown)
Abstract:
Combining the visibilities measured by an interferometer to form a cosmological power spectrum is a complicated process. In a delay-based analysis, the mapping between instrumental and cosmological space is not a one-to-one relation. Instead, neighbouring modes contribute to the power measured at one point, with their respective contributions encoded in the window functions. To better understand t…
▽ More
Combining the visibilities measured by an interferometer to form a cosmological power spectrum is a complicated process. In a delay-based analysis, the mapping between instrumental and cosmological space is not a one-to-one relation. Instead, neighbouring modes contribute to the power measured at one point, with their respective contributions encoded in the window functions. To better understand the power measured by an interferometer, we assess the impact of instrument characteristics and analysis choices on these window functions. Focusing on the Hydrogen Epoch of Reionization Array (HERA) as a case study, we find that long-baseline observations correspond to enhanced low-k tails of the window functions, which facilitate foreground leakage, whilst an informed choice of bandwidth and frequency taper can reduce said tails. With simple test cases and realistic simulations, we show that, apart from tracing mode mixing, the window functions help accurately reconstruct the power spectrum estimator of simulated visibilities. The window functions depend strongly on the beam chromaticity, and less on its spatial structure - a Gaussian approximation, ignoring side lobes, is sufficient. Finally, we investigate the potential of asymmetric window functions, down-weighting the contribution of low-k power to avoid foreground leakage. The window functions presented here correspond to the latest HERA upper limits for the full Phase I data. They allow an accurate reconstruction of the power spectrum measured by the instrument and will be used in future analyses to confront theoretical models and data directly in cylindrical space.
△ Less
Submitted 11 January, 2023; v1 submitted 7 October, 2022;
originally announced October 2022.
-
A Bayesian Calibration Framework for EDGES
Authors:
Steven G. Murray,
Judd D. Bowman,
Peter H. Sims,
Nivedita Mahesh,
Alan E. E. Rogers,
Raul A. Monsalve,
Titu Samson,
Akshatha Konakondula Vydula
Abstract:
We develop a Bayesian model that jointly constrains receiver calibration, foregrounds and cosmic 21cm signal for the EDGES global 21\,cm experiment. This model simultaneously describes calibration data taken in the lab along with sky-data taken with the EDGES low-band antenna. We apply our model to the same data (both sky and calibration) used to report evidence for the first star formation in 201…
▽ More
We develop a Bayesian model that jointly constrains receiver calibration, foregrounds and cosmic 21cm signal for the EDGES global 21\,cm experiment. This model simultaneously describes calibration data taken in the lab along with sky-data taken with the EDGES low-band antenna. We apply our model to the same data (both sky and calibration) used to report evidence for the first star formation in 2018. We find that receiver calibration does not contribute a significant uncertainty to the inferred cosmic signal (<1%), though our joint model is able to more robustly estimate the cosmic signal for foreground models that are otherwise too inflexible to describe the sky data. We identify the presence of a significant systematic in the calibration data, which is largely avoided in our analysis, but must be examined more closely in future work. Our likelihood provides a foundation for future analyses in which other instrumental systematics, such as beam corrections and reflection parameters, may be added in a modular manner.
△ Less
Submitted 7 September, 2022;
originally announced September 2022.
-
Multi-frequency angular power spectrum of the 21~cm signal from the Epoch of Reionisation using the Murchison Widefield Array
Authors:
Cathryn M. Trott,
Rajesh Mondal,
Garrelt Mellema,
Steven G. Murray,
Bradley Greig,
Jack L. B. Line,
Nichole Barry,
Miguel F. Morales
Abstract:
The Multi-frequency Angular Power Spectrum (MAPS) is an alternative to spherically-averaged power spectra, and computes local fluctuations in the angular power spectrum without need for line-of-sight spectral transform. To test different approaches to MAPS and treatment of the foreground contamination, and compare with the spherically-averaged power spectrum, and the single-frequency angular power…
▽ More
The Multi-frequency Angular Power Spectrum (MAPS) is an alternative to spherically-averaged power spectra, and computes local fluctuations in the angular power spectrum without need for line-of-sight spectral transform. To test different approaches to MAPS and treatment of the foreground contamination, and compare with the spherically-averaged power spectrum, and the single-frequency angular power spectrum. We apply the MAPS to 110~hours of data in $z=6.2-7.5$ obtained for the Murchison Widefield Array Epoch of Reionisation experiment to compute the statistical power of 21~cm brightness temperature fluctuations. In the presence of bright foregrounds, a filter is applied to remove large-scale modes prior to MAPS application, significantly reducing MAPS power due to systematics. The MAPS shows a contrast of 10$^2$--10$^3$ to a simulated 21~cm cosmological signal for spectral separations of 0--4~MHz after application of the filter, reflecting results for the spherically-averaged power spectrum. The single-frequency angular power spectrum is also computed. At $z=7.5$ and $l=200$, we find an angular power of 53~mK$^2$, exceeding a simulated cosmological signal power by a factor of one thousand. Residual spectral structure, inherent to the calibrated data, and not spectral leakage from large-scale modes, is the dominant source of systematic power bias. The single-frequency angular power spectrum yields slightly poorer results compared with the spherically-averaged power spectrum, having applied a spectral filter to reduce foregrounds. Exploration of other filters may improve this result, along with consideration of wider bandwidths.
△ Less
Submitted 11 August, 2022;
originally announced August 2022.
-
Generating extremely large-volume reionisation simulations
Authors:
Bradley Greig,
J. Stuart B. Wyithe,
Steven G. Murray,
Simon J. Mutch,
Cathryn M. Trott
Abstract:
Preparing for the first detection of the cosmic 21-cm signal from large-scale interferometer experiments requires rigorous testing of the data analysis and reduction pipelines. To validate that these pipelines do not erroneously remove or add features that can mimic the cosmic signal (e.g. from side-lobes or large-scale power leakage), we require reionisation simulations larger than the experiment…
▽ More
Preparing for the first detection of the cosmic 21-cm signal from large-scale interferometer experiments requires rigorous testing of the data analysis and reduction pipelines. To validate that these pipelines do not erroneously remove or add features that can mimic the cosmic signal (e.g. from side-lobes or large-scale power leakage), we require reionisation simulations larger than the experiments primary field of view. For an experiment such as the MWA, with a field of view of $\sim25^{2}$ deg.$^{2}$, this would require a simulation of several Gpcs, which is currently infeasible. To overcome this, we developed a simplified version of the semi-numerical reionisation simulation code 21CMFAST preferencing large volumes over some physical accuracy by assuming linear theory for structure formation. With this, we constructed a 7.5 Gpc comoving volume with voxel resolution of $\sim1.17$ cMpc tailored specifically to the binned spectral resolution of the MWA. This simulation was used for validating the pipelines for the 2020 MWA 21-cm power spectrum (PS) upper limits (Trott et al.). We then use this large-volume simulation to explore: (i) whether smaller volume simulations are biased by the missing large-scale modes, (ii) non-Gaussianity in estimates of the cosmic variance, (iii) biases in the recovered 21-cm PS following foreground wedge removal and (iv) the impact of tiling smaller volume simulations to achieve extremely large volumes. In summary, we find: (i) no biases from missing large-scale power, (ii) significant contribution from non-Gaussianity in the cosmic variance as expected following Mondal et al. (iii) an over-estimate of the 21-cm PS of 10-20 per cent following wedge mode excision for our particular model and (iv) tiling smaller volume simulations under-estimates the large-scale power and also the estimated cosmic variance.
△ Less
Submitted 20 May, 2022;
originally announced May 2022.
-
Direct Optimal Mapping for 21cm Cosmology: A Demonstration with the Hydrogen Epoch of Reionization Array
Authors:
Zhilei Xu,
Jacqueline N. Hewitt,
Kai-Feng Chen,
Honggeun Kim,
Joshua S. Dillon,
Nicholas S. Kern,
Miguel F. Morales,
Bryna J. Hazelton,
Ruby Byrne,
Nicolas Fagnoni,
Eloy de Lera Acedo,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba
, et al. (56 additional authors not shown)
Abstract:
Motivated by the desire for wide-field images with well-defined statistical properties for 21cm cosmology, we implement an optimal mapping pipeline that computes a maximum likelihood estimator for the sky using the interferometric measurement equation. We demonstrate this direct optimal mapping with data from the Hydrogen Epoch of Reionization (HERA) Phase I observations. After validating the pipe…
▽ More
Motivated by the desire for wide-field images with well-defined statistical properties for 21cm cosmology, we implement an optimal mapping pipeline that computes a maximum likelihood estimator for the sky using the interferometric measurement equation. We demonstrate this direct optimal mapping with data from the Hydrogen Epoch of Reionization (HERA) Phase I observations. After validating the pipeline with simulated data, we develop a maximum likelihood figure-of-merit for comparing four sky models at 166MHz with a bandwidth of 100kHz. The HERA data agree with the GLEAM catalogs to <10%. After subtracting the GLEAM point sources, the HERA data discriminate between the different continuum sky models, providing most support for the model of Byrne et al. 2021. We report the computation cost for mapping the HERA Phase I data and project the computation for the HERA 320-antenna data; both are feasible with a modern server. The algorithm is broadly applicable to other interferometers and is valid for wide-field and non-coplanar arrays.
△ Less
Submitted 26 October, 2022; v1 submitted 12 April, 2022;
originally announced April 2022.
-
Measurements of one-point statistics in 21 cm intensity maps via foreground avoidance strategy
Authors:
Piyanat Kittiwisit,
Judd D. Bowman,
Steven G. Murray,
Bharat K. Gehlot,
Daniel C. Jacobs,
Adam P. Beardsley
Abstract:
Measurements of the one-point probability distribution function and higher-order moments (variance, skewness, and kurtosis) of the high-redshift 21 cm fluctuations are among the most direct statistical probes of the non-Gaussian nature of structure formation and evolution during reionization. However, contamination from astrophysical foregrounds and instrument systematics pose significant challeng…
▽ More
Measurements of the one-point probability distribution function and higher-order moments (variance, skewness, and kurtosis) of the high-redshift 21 cm fluctuations are among the most direct statistical probes of the non-Gaussian nature of structure formation and evolution during reionization. However, contamination from astrophysical foregrounds and instrument systematics pose significant challenges in measuring these statistics in real observations. In this work, we use forward modelling to investigate the feasibility of measuring 21 cm one-point statistics through a foreground avoidance strategy. Leveraging the characteristic wedge-shape of the foregrounds in k-space, we apply a wedge-cut filter that removes the foreground contaminated modes from a mock data set based on the Hydrogen Epoch of Reionization Array (HERA) instrument, and measure the one-point statistics from the image-space representation of the remaining non-contaminated modes. We experiment with varying degrees of wedge-cutting over different frequency bandwidths and find that the centre of the band is the least susceptible to bias from wedge-cutting. Based on this finding, we introduce a rolling filter method that allows reconstruction of an optimal wedge-cut 21~cm intensity map over the full bandwidth using outputs from wedge-cutting over multiple sub-bands. We perform Monte Carlo simulations to show that HERA should be able to measure the rise in skewness and kurtosis near the end of reionization with the rolling wedge-cut method if foreground leakage from the Fourier transform window function can be controlled.
△ Less
Submitted 29 September, 2022; v1 submitted 3 April, 2022;
originally announced April 2022.
-
The multi-frequency angular power spectrum in parameter studies of the cosmic 21-cm signal
Authors:
Rajesh Mondal,
Garrelt Mellema,
Steven G. Murray,
Bradley Greig
Abstract:
The light-cone effect breaks the periodicity and statistical homogeneity (ergodicity) along the line-of-sight direction of cosmological emission/absorption line surveys. The spherically averaged power spectrum (SAPS), which by definition assumes ergodicity and periodicity in all directions, can only quantify some of the second-order statistical information in the 3D light-cone signals and therefor…
▽ More
The light-cone effect breaks the periodicity and statistical homogeneity (ergodicity) along the line-of-sight direction of cosmological emission/absorption line surveys. The spherically averaged power spectrum (SAPS), which by definition assumes ergodicity and periodicity in all directions, can only quantify some of the second-order statistical information in the 3D light-cone signals and therefore gives a biased estimate of the true statistics. The multi-frequency angular power spectrum (MAPS), by extracting more information from the data, does not rely on these assumptions. It is therefore better aligned with the properties of the signal. We have compared the performance of the MAPS and SAPS metrics for parameter estimation for a mock 3D light-cone observation of the 21-cm signal from the Epoch of Reionization. Our investigation is based on a simplified 3-parameter 21cmFAST model. We find that the MAPS produces parameter constraints which are a factor of $\sim 2$ more stringent than when the SAPS is used. The significance of this result does not change much even in the presence of instrumental noise expected for 128 hours of SKA-Low observations. Our results therefore suggest that a parameter estimation framework based on the MAPS metric would yield superior results over one using the SAPS metric.
△ Less
Submitted 12 May, 2022; v1 submitted 21 March, 2022;
originally announced March 2022.
-
Estimating the Feasibility of 21cm-Ly$α$ Synergies using the Hydrogen Epoch of Reionization Array
Authors:
Tyler A. Cox,
Daniel C. Jacobs,
Steven G. Murray
Abstract:
Cross-correlating 21cm and Ly$α$ intensity maps of the Epoch of Reionization (EoR) promises to be a powerful tool for exploring the properties of the first galaxies. Next-generation intensity mapping experiments such as the Hydrogen Epoch of Reionization Array (HERA) and SPHEREx will individually probe reionization through the power spectra of the 21cm and Ly$α$ lines respectively, but will be lim…
▽ More
Cross-correlating 21cm and Ly$α$ intensity maps of the Epoch of Reionization (EoR) promises to be a powerful tool for exploring the properties of the first galaxies. Next-generation intensity mapping experiments such as the Hydrogen Epoch of Reionization Array (HERA) and SPHEREx will individually probe reionization through the power spectra of the 21cm and Ly$α$ lines respectively, but will be limited by bright foregrounds and instrumental systematics. Cross-correlating these measurements could reduce systematics, potentially tightening constraints on the inferred astrophysical parameters. In this study, we present forecasts of cross-correlation taking into account the effects of exact uv-sampling and foreground filtering to estimate the feasibility of HERAxSPHEREx making a detection of the 21cm-Ly$α$ cross-power spectrum. We also project the sensitivity of a cross-power spectrum between HERA and the proposed next-generation Cosmic Dawn Intensity Mapper. By isolating the sources of uncertainty, we explore the impacts of experimental limitations such as foreground filtering and Ly$α$ thermal noise uncertainty have on making a detection of the cross-power spectrum. We then implement this strategy in a simulation of the cross-power spectrum and observational error to identify redshifts where fiducial 21cmFAST models predict the highest signal-to-noise detection ($z \sim 8$). We conclude that detection of the SPHEREx-HERA cross-correlation will require an optimistic level of 21cm foreground filtering, as well as deeper thermal noise integrations due to a lack of overlapping sensitive modes but for CDIM with its larger range of scales and lower noise forecast detection levels, may be possible even with stricter 21cm foreground filtering.
△ Less
Submitted 17 February, 2022;
originally announced February 2022.
-
Characterizing Beam Errors for Radio Interferometric Observations of Reionization
Authors:
Ainulnabilah Nasirudin,
David Prelogovic,
Steven G. Murray,
Andrei Mesinger,
Gianni Bernardi
Abstract:
A limiting systematic effect in 21-cm interferometric experiments is the chromaticity due to the coupling between the sky and the instrument. This coupling is sourced by the instrument primary beam; therefore it is important to know the beam to extremely high precision. Here we demonstrate how known beam uncertainties can be characterized using databases of beam models. In this introductory work,…
▽ More
A limiting systematic effect in 21-cm interferometric experiments is the chromaticity due to the coupling between the sky and the instrument. This coupling is sourced by the instrument primary beam; therefore it is important to know the beam to extremely high precision. Here we demonstrate how known beam uncertainties can be characterized using databases of beam models. In this introductory work, we focus on beam errors arising from physically offset and/or broken antennas within a station. We use the public code OSKAR to generate an "ideal" SKA beam formed from 256 antennas regularly-spaced in a 35-m circle, as well as a large database of "perturbed" beams sampling distributions of broken/offset antennas. We decompose the beam errors ("ideal" minus "perturbed") using Principal Component Analysis (PCA) and Kernel PCA (KPCA). Using 20 components, we find that PCA/KPCA can reduce the residual of the beam in our datasets by 60-90% compared with the assumption of an ideal beam. Using a simulated observation of the cosmic signal plus foregrounds, we find that assuming the ideal beam can result in 1% error in the EoR window and 10% in the wedge of the 2D power spectrum. When PCA/KPCA is used to characterize the beam uncertainties, the error in the power spectrum shrinks to below 0.01% in the EoR window and <1% in the wedge. Our framework can be used to characterize and then marginalize over uncertainties in the beam for robust next-generation 21-cm parameter estimation.
△ Less
Submitted 26 January, 2022;
originally announced January 2022.
-
Validation Solutions to the Full-Sky Radio Interferometry Measurement Equation for Diffuse Emission
Authors:
Adam E. Lanman,
Steven G. Murray,
Daniel C. Jacobs
Abstract:
Low-frequency radio observatories are reaching unprecedented levels of sensitivity in an effort to detect the 21 cm signal from the Cosmic Dawn. High precision is needed because the expected signal is overwhelmed by foreground contamination, largely from so-called diffuse emission -- a non-localized glow comprising Galactic synchrotron emission and radio galaxies. The impact of this diffuse emissi…
▽ More
Low-frequency radio observatories are reaching unprecedented levels of sensitivity in an effort to detect the 21 cm signal from the Cosmic Dawn. High precision is needed because the expected signal is overwhelmed by foreground contamination, largely from so-called diffuse emission -- a non-localized glow comprising Galactic synchrotron emission and radio galaxies. The impact of this diffuse emission on observations may be better understood through detailed simulations, which evaluate the Radio Interferometry Measurement Equation (RIME) for a given instrument and sky model. Evaluating the RIME involves carrying out an integral over the full sky, which is naturally discretized for point sources but must be approximated for diffuse emission. The choice of integration scheme can introduce errors that must be understood and isolated from the instrumental effects under study. In this paper, we present several analytically-defined patterns of unpolarized diffuse sky emission for which the RIME integral is manageable, yielding closed-form or series visibility functions. We demonstrate the usefulness of these RIME solutions for validation by comparing them to simulated data, and show that the remaining differences behave as expected with varied sky resolution and baseline orientation and length.
△ Less
Submitted 21 December, 2021;
originally announced December 2021.
-
The Impact of the First Galaxies on Cosmic Dawn and Reionization
Authors:
Julian B. Muñoz,
Yuxiang Qin,
Andrei Mesinger,
Steven G. Murray,
Bradley Greig,
Charlotte Mason
Abstract:
The formation of the first galaxies during cosmic dawn and reionization (at redshifts $z=5-30$), triggered the last major phase transition of our universe, as hydrogen evolved from cold and neutral to hot and ionized. The 21-cm line of neutral hydrogen will soon allow us to map these cosmic milestones and study the galaxies that drove them. To aid in interpreting these observations, we upgrade the…
▽ More
The formation of the first galaxies during cosmic dawn and reionization (at redshifts $z=5-30$), triggered the last major phase transition of our universe, as hydrogen evolved from cold and neutral to hot and ionized. The 21-cm line of neutral hydrogen will soon allow us to map these cosmic milestones and study the galaxies that drove them. To aid in interpreting these observations, we upgrade the publicly available code {\tt 21cmFAST}. We introduce a new, flexible parametrization of the additive feedback from: an inhomogeneous, $H_2$-dissociating (Lyman-Werner; LW) background; and dark matter -- baryon relative velocities; which recovers results from recent, small-scale hydrodynamical simulations with both effects. We perform a large, "best-guess" simulation as the 2021 installment of the Evolution of 21-cm Structure (EOS) project. This improves the previous release with a galaxy model that reproduces the observed UV luminosity functions (UVLFs), and by including a population of molecular-cooling galaxies. The resulting 21-cm global signal and power spectrum are significantly weaker, primarily due to a more rapid evolution of the star-formation rate density required to match the UVLFs. Nevertheless, we forecast high signal-to-noise detections for both HERA and the SKA. We demonstrate how the stellar-to-halo mass relation of the unseen, first galaxies can be inferred from the 21-cm evolution. Finally, we show that the spatial modulation of X-ray heating due to relative velocities provides a unique acoustic signature that is detectable at $z \approx 10-15$ in our fiducial model. Ours are the first public simulations with joint inhomogeneous LW and relative-velocity feedback across the entire cosmic dawn and reionization.
△ Less
Submitted 10 March, 2022; v1 submitted 26 October, 2021;
originally announced October 2021.
-
Epoch of Reionization Power Spectrum Limits from Murchison Widefield Array Data Targeted at EoR1 Field
Authors:
M. Rahimi,
B. Pindor,
J. L. B. Line,
N. Barry,
C. M. Trott,
R. L. Webster,
C. H. Jordan,
M. Wilensky,
S. Yoshiura,
A. Beardsley,
J. Bowman,
R. Byrne,
A. Chokshi,
B. J. Hazelton,
K. Hasegawa,
E. Howard,
B. Greig,
D. Jacobs,
R. Joseph,
M. Kolopanis,
C. Lynch,
B. McKinley,
D. A. Mitchell,
S. Murray,
M. F. Morales
, et al. (6 additional authors not shown)
Abstract:
Current attempts to measure the 21cm Power Spectrum of neutral hydrogen during the Epoch of Reionization are limited by systematics which produce measured upper limits above both the thermal noise and the expected cosmological signal. These systematics arise from a combination of observational, instrumental, and analysis effects. In order to further understand and mitigate these effects, it is ins…
▽ More
Current attempts to measure the 21cm Power Spectrum of neutral hydrogen during the Epoch of Reionization are limited by systematics which produce measured upper limits above both the thermal noise and the expected cosmological signal. These systematics arise from a combination of observational, instrumental, and analysis effects. In order to further understand and mitigate these effects, it is instructive to explore different aspects of existing datasets. One such aspect is the choice of observing field. To date, MWA EoR observations have largely focused on the EoR0 field. In this work, we present a new detailed analysis of the EoR1 field. The EoR1 field is one of the coldest regions of the Southern radio sky, but contains the very bright radio galaxy Fornax-A. The presence of this bright extended source in the primary beam of the interferometer makes the calibration and analysis of EoR1 particularly challenging. We demonstrate the effectiveness of a recently developed shapelet model of Fornax-A in improving the results from this field. We also describe and apply a series of data quality metrics which identify and remove systematically contaminated data. With substantially improved source models, upgraded analysis algorithms and enhanced data quality metrics, we determine EoR power spectrum upper limits based on analysis of the best $\sim$14-hours data observed during 2015 and 2014 at redshifts 6.5, 6.8 and 7.1, with the lowest $2σ$ upper limit at z=6.5 of $Δ^2 \leq (73.78 ~\mathrm{mK)^2}$ at $k=0.13~\mathrm{h~ Mpc^{-1}}$, improving on previous EoR1 measurement results.
△ Less
Submitted 7 October, 2021;
originally announced October 2021.
-
Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study with the Hydrogen Epoch of Reionization Array
Authors:
Dara Storer,
Joshua S. Dillon,
Daniel C. Jacobs,
Miguel F. Morales,
Bryna J. Hazelton,
Aaron Ewall-Wice,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Scott Dynes
, et al. (53 additional authors not shown)
Abstract:
We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for…
▽ More
We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.
△ Less
Submitted 4 May, 2022; v1 submitted 26 September, 2021;
originally announced September 2021.
-
Solar Flare Effects on the Earth's Lower Ionosphere
Authors:
Laura A. Hayes,
Oscar S. D. O'Hara,
Sophie A. Murray,
Peter T. Gallagher
Abstract:
Solar flares significantly impact the conditions of the Earth's ionosphere. In particular, the sudden increase in X-ray flux during a flare penetrates down to the lowest-lying D-region and dominates ionization at these altitudes (60-100 km). Measurements of very low frequency (VLF: 3-30kHz) radio waves that reflect at D-region altitudes provide a unique remote-sensing probe to investigate the D-re…
▽ More
Solar flares significantly impact the conditions of the Earth's ionosphere. In particular, the sudden increase in X-ray flux during a flare penetrates down to the lowest-lying D-region and dominates ionization at these altitudes (60-100 km). Measurements of very low frequency (VLF: 3-30kHz) radio waves that reflect at D-region altitudes provide a unique remote-sensing probe to investigate the D-region response to solar flare emissions. Here, using a combination of VLF amplitude measurements at 24kHz together with X-ray observations from the Geostationary Operational Environment Satellite (GOES) X-ray sensor, we present a large-scale statistical study of 334 solar flare events and their impacts on the D-region over the past solar cycle. Focusing on both GOES broadband X-ray channels, we investigate how the flare peak fluxes and position on the solar disk dictate an ionospheric response and extend this to investigate the characteristic time delay between incident X-ray flux and the D-region response. We show that the VLF amplitude linearly correlates with both the 1-8 A and 0.5-4 A channels, with correlation coefficients of 0.80 and 0.79, respectively. Unlike higher altitude ionospheric regions for which the location of the flare on the solar disk affects the ionospheric response, we find that the D-region response to solar flares does not depend on the flare location. By comparing the time delays between the peak X-ray fluxes in both GOES channels and VLF amplitudes, we find that there is an important difference between the D-region response and the X-ray spectral band. We also demonstrate for several flare events that show a negative time delay, the peak VLF amplitude matches with the impulsive 25-50 keV hard X-ray fluxes measured by the Ramaty High Energy Solar Spectroscopic Imager (RHESSI).
△ Less
Submitted 14 September, 2021;
originally announced September 2021.
-
HERA Phase I Limits on the Cosmic 21-cm Signal: Constraints on Astrophysics and Cosmology During the Epoch of Reionization
Authors:
The HERA Collaboration,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki Ali,
Yanga Balfour,
Rennan Barkana,
Adam Beardsley,
Gianni Bernardi,
Tashalee Billings,
Judd Bowman,
Richard Bradley,
Phillip Bull,
Jacob Burba,
Steven Carey,
Christopher Carilli,
Carina Cheng,
David DeBoer,
Matthew Dexter,
Eloy de Lera Acedo,
Joshua Dillon,
John Ely,
Aaron Ewall-Wice,
Nicolas Fagnoni,
Anastasia Fialkov
, et al. (59 additional authors not shown)
Abstract:
Recently, the Hydrogen Epoch of Reionization Array (HERA) collaboration has produced the experiment's first upper limits on the power spectrum of 21-cm fluctuations at z~8 and 10. Here, we use several independent theoretical models to infer constraints on the intergalactic medium (IGM) and galaxies during the epoch of reionization (EoR) from these limits. We find that the IGM must have been heated…
▽ More
Recently, the Hydrogen Epoch of Reionization Array (HERA) collaboration has produced the experiment's first upper limits on the power spectrum of 21-cm fluctuations at z~8 and 10. Here, we use several independent theoretical models to infer constraints on the intergalactic medium (IGM) and galaxies during the epoch of reionization (EoR) from these limits. We find that the IGM must have been heated above the adiabatic cooling threshold by z~8, independent of uncertainties about the IGM ionization state and the nature of the radio background. Combining HERA limits with galaxy and EoR observations constrains the spin temperature of the z~8 neutral IGM to 27 K < T_S < 630 K (2.3 K < T_S < 640 K) at 68% (95%) confidence. They therefore also place a lower bound on X-ray heating, a previously unconstrained aspects of early galaxies. For example, if the CMB dominates the z~8 radio background, the new HERA limits imply that the first galaxies produced X-rays more efficiently than local ones (with soft band X-ray luminosities per star formation rate constrained to L_X/SFR = { 10^40.2, 10^41.9 } erg/s/(M_sun/yr) at 68% confidence), consistent with expectations of X-ray binaries in low-metallicity environments. The z~10 limits require even earlier heating if dark-matter interactions (e.g., through millicharges) cool down the hydrogen gas. Using a model in which an extra radio background is produced by galaxies, we rule out (at 95% confidence) the combination of high radio and low X-ray luminosities of L_{r,ν}/SFR > 3.9 x 10^24 W/Hz/(M_sun/yr) and L_X/SFR<10^40 erg/s/(M_sun/yr). The new HERA upper limits neither support nor disfavor a cosmological interpretation of the recent EDGES detection. The analysis framework described here provides a foundation for the interpretation of future HERA results.
△ Less
Submitted 20 December, 2022; v1 submitted 16 August, 2021;
originally announced August 2021.
-
First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
Authors:
The HERA Collaboration,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Taylor Dibblee-Barkman,
Joshua S. Dillon,
John Ely,
Aaron Ewall-Wice,
Nicolas Fagnoni,
Randall Fritz
, et al. (52 additional authors not shown)
Abstract:
We report upper-limits on the Epoch of Reionization (EoR) 21 cm power spectrum at redshifts 7.9 and 10.4 with 18 nights of data ($\sim36$ hours of integration) from Phase I of the Hydrogen Epoch of Reionization Array (HERA). The Phase I data show evidence for systematics that can be largely suppressed with systematic models down to a dynamic range of $\sim10^9$ with respect to the peak foreground…
▽ More
We report upper-limits on the Epoch of Reionization (EoR) 21 cm power spectrum at redshifts 7.9 and 10.4 with 18 nights of data ($\sim36$ hours of integration) from Phase I of the Hydrogen Epoch of Reionization Array (HERA). The Phase I data show evidence for systematics that can be largely suppressed with systematic models down to a dynamic range of $\sim10^9$ with respect to the peak foreground power. This yields a 95% confidence upper limit on the 21 cm power spectrum of $Δ^2_{21} \le (30.76)^2\ {\rm mK}^2$ at $k=0.192\ h\ {\rm Mpc}^{-1}$ at $z=7.9$, and also $Δ^2_{21} \le (95.74)^2\ {\rm mK}^2$ at $k=0.256\ h\ {\rm Mpc}^{-1}$ at $z=10.4$. At $z=7.9$, these limits are the most sensitive to-date by over an order of magnitude. While we find evidence for residual systematics at low line-of-sight Fourier $k_\parallel$ modes, at high $k_\parallel$ modes we find our data to be largely consistent with thermal noise, an indicator that the system could benefit from deeper integrations. The observed systematics could be due to radio frequency interference, cable sub-reflections, or residual instrumental cross-coupling, and warrant further study. This analysis emphasizes algorithms that have minimal inherent signal loss, although we do perform a careful accounting in a companion paper of the small forms of loss or bias associated with the pipeline. Overall, these results are a promising first step in the development of a tuned, instrument-specific analysis pipeline for HERA, particularly as Phase II construction is completed en route to reaching the full sensitivity of the experiment.
△ Less
Submitted 4 August, 2021;
originally announced August 2021.
-
Constraining the 21cm brightness temperature of the IGM at $z$=6.6 around LAEs with the Murchison Widefield Array
Authors:
Cathryn M. Trott,
C. H. Jordan,
J. L. B. Line,
C. R. Lynch,
S. Yoshiura,
B. McKinley,
P. Dayal,
B. Pindor,
A. Hutter,
K. Takahashi,
R. B. Wayth,
N. Barry,
A. Beardsley,
J. Bowman,
R. Byrne,
A. Chokshi,
B. Greig,
K. Hasegawa,
B. J. Hazelton,
E. Howard,
D. Jacobs,
M. Kolopanis,
D. A. Mitchell,
M. F. Morales,
S. Murray
, et al. (7 additional authors not shown)
Abstract:
The locations of Ly-$α$ emitting galaxies (LAEs) at the end of the Epoch of Reionisation (EoR) are expected to correlate with regions of ionised hydrogen, traced by the redshifted 21~cm hyperfine line. Mapping the neutral hydrogen around regions with detected and localised LAEs offers an avenue to constrain the brightness temperature of the Universe within the EoR by providing an expectation for t…
▽ More
The locations of Ly-$α$ emitting galaxies (LAEs) at the end of the Epoch of Reionisation (EoR) are expected to correlate with regions of ionised hydrogen, traced by the redshifted 21~cm hyperfine line. Mapping the neutral hydrogen around regions with detected and localised LAEs offers an avenue to constrain the brightness temperature of the Universe within the EoR by providing an expectation for the spatial distribution of the gas, thereby providing prior information unavailable to power spectrum measurements. We use a test set of 12 hours of observations from the Murchison Widefield Array (MWA) in extended array configuration, to constrain the neutral hydrogen signature of 58 LAEs, detected with the Subaru Hypersuprime Cam in the \textit{Silverrush} survey, centred on $z$=6.58. We assume that detectable emitters reside in the centre of ionised HII bubbles during the end of reionization, and predict the redshifted neutral hydrogen signal corresponding to the remaining neutral regions using a set of different ionised bubble radii. A prewhitening matched filter detector is introduced to assess detectability. We demonstrate the ability to detect, or place limits upon, the amplitude of brightness temperature fluctuations, and the characteristic HII bubble size. With our limited data, we constrain the brightness temperature of neutral hydrogen to $Δ{\rm T}_B<$30 mK ($<$200 mK) at 95% (99%) confidence for lognormally-distributed bubbles of radii, $R_B =$ 15$\pm$2$h^{-1}$cMpc.
△ Less
Submitted 30 July, 2021;
originally announced July 2021.
-
Machine learning astrophysics from 21 cm lightcones: impact of network architectures and signal contamination
Authors:
David Prelogović,
Andrei Mesinger,
Steven Murray,
Giuseppe Fiameni,
Nicolas Gillet
Abstract:
Imaging the cosmic 21 cm signal will map out the first billion years of our Universe. The resulting 3D lightcone (LC) will encode the properties of the unseen first galaxies and physical cosmology. Here, we build on previous work using neural networks (NNs) to infer astrophysical parameters directly from 21 cm LC images. We introduce recurrent neural networks (RNNs), capable of efficiently charact…
▽ More
Imaging the cosmic 21 cm signal will map out the first billion years of our Universe. The resulting 3D lightcone (LC) will encode the properties of the unseen first galaxies and physical cosmology. Here, we build on previous work using neural networks (NNs) to infer astrophysical parameters directly from 21 cm LC images. We introduce recurrent neural networks (RNNs), capable of efficiently characterizing the evolution along the redshift axis of 21 cm LC images. Using a large database of simulated cosmic 21 cm LCs, we compare the relative performance in parameter estimation of different network architectures. These including two types of RNNs, which differ in their complexity, as well as a more traditional convolutional neural network (CNN). For the ideal case of no instrumental effects, our simplest and easiest to train RNN performs the best, with a mean squared parameter estimation error (MSE) that is lower by a factor of $\ge 2$ compared with the other architectures studied here, and a factor of $\ge 8$ lower than the previously-studied CNN. We also corrupt the cosmic signal by adding noise expected from a 1000 h integration with the Square Kilometre Array, as well as excising a foreground-contaminated 'horizon wedge'. Parameter prediction errors increase when the NNs are trained on these contaminated LC images, though recovery is still good even in the most pessimistic case (with $R^2 \ge 0.5-0.95$). However, we find no notable differences in performance between network architectures on the contaminated images. We argue this is due to the size of our data set, highlighting the need for larger data sets and/or better data augmentation in order to maximize the potential of NNs in 21 cm parameter estimation.
△ Less
Submitted 16 February, 2022; v1 submitted 30 June, 2021;
originally announced July 2021.
-
A new MWA limit on the 21 cm Power Spectrum at Redshifts $\sim$ 13 $-$ 17
Authors:
S. Yoshiura,
B. Pindor,
J. L. B. Line,
N. Barry,
C. M. Trott,
A. Beardsley,
J. Bowman,
R. Byrne,
A. Chokshi,
B. J. Hazelton,
K. Hasegawa,
E. Howard,
B. Greig,
D. Jacobs,
C. H. Jordan,
R. Joseph,
M. Kolopanis,
C. Lynch,
B. McKinley,
D. A. Mitchell,
M. F. Morales,
S. G. Murray,
J. C. Pober,
M. Rahimi,
K. Takahashi
, et al. (7 additional authors not shown)
Abstract:
Observations in the lowest MWA band between $75-100$ MHz have the potential to constrain the distribution of neutral hydrogen in the intergalactic medium at redshift $\sim 13-17$. Using 15 hours of MWA data, we analyse systematics in this band such as radio-frequency interference (RFI), ionospheric and wide field effects. By updating the position of point sources, we mitigate the direction indepen…
▽ More
Observations in the lowest MWA band between $75-100$ MHz have the potential to constrain the distribution of neutral hydrogen in the intergalactic medium at redshift $\sim 13-17$. Using 15 hours of MWA data, we analyse systematics in this band such as radio-frequency interference (RFI), ionospheric and wide field effects. By updating the position of point sources, we mitigate the direction independent calibration error due to ionospheric offsets. Our calibration strategy is optimized for the lowest frequency bands by reducing the number of direction dependent calibrators and taking into account radio sources within a wider field of view. We remove data polluted by systematics based on the RFI occupancy and ionospheric conditions, finally selecting 5.5 hours of the cleanest data. Using these data, we obtain two sigma upper limits on the 21 cm power spectrum in the range of $0.1\lessapprox k \lessapprox 1 ~\rm ~h~Mpc^{-1}$ and at $z$=14.2, 15.2 and 16.5, with the lowest limit being $6.3\times 10^6 ~\rm mK^2$ at $\rm k=0.14 \rm ~h~Mpc^{-1}$ and at $z=15.2$ with a possibility of a few \% of signal loss due to direction independent calibration.
△ Less
Submitted 26 May, 2021;
originally announced May 2021.
-
The Flare Likelihood and Region Eruption Forecasting (FLARECAST) Project: Flare forecasting in the big data & machine learning era
Authors:
M. K. Georgoulis,
D. S. Bloomfield,
M. Piana,
A. M. Massone,
M. Soldati,
P. T. Gallagher,
E. Pariat,
N. Vilmer,
E. Buchlin,
F. Baudin,
A. Csillaghy,
H. Sathiapal,
D. R. Jackson,
P. Alingery,
F. Benvenuto,
C. Campi,
K. Florios,
C. Gontikakis,
C. Guennou,
J. A. Guerra,
I. Kontogiannis,
V. Latorre,
S. A. Murray,
S. -H. Park,
S. von Stachelski
, et al. (3 additional authors not shown)
Abstract:
The EU funded the FLARECAST project, that ran from Jan 2015 until Feb 2018. FLARECAST had a R2O focus, and introduced several innovations into the discipline of solar flare forecasting. FLARECAST innovations were: first, the treatment of hundreds of physical properties viewed as promising flare predictors on equal footing, extending multiple previous works; second, the use of fourteen (14) differe…
▽ More
The EU funded the FLARECAST project, that ran from Jan 2015 until Feb 2018. FLARECAST had a R2O focus, and introduced several innovations into the discipline of solar flare forecasting. FLARECAST innovations were: first, the treatment of hundreds of physical properties viewed as promising flare predictors on equal footing, extending multiple previous works; second, the use of fourteen (14) different ML techniques, also on equal footing, to optimize the immense Big Data parameter space created by these many predictors; third, the establishment of a robust, three-pronged communication effort oriented toward policy makers, space-weather stakeholders and the wider public. FLARECAST pledged to make all its data, codes and infrastructure openly available worldwide. The combined use of 170+ properties (a total of 209 predictors are now available) in multiple ML algorithms, some of which were designed exclusively for the project, gave rise to changing sets of best-performing predictors for the forecasting of different flaring levels. At the same time, FLARECAST reaffirmed the importance of rigorous training and testing practices to avoid overly optimistic pre-operational prediction performance. In addition, the project has (a) tested new and revisited physically intuitive flare predictors and (b) provided meaningful clues toward the transition from flares to eruptive flares, namely, events associated with coronal mass ejections (CMEs). These leads, along with the FLARECAST data, algorithms and infrastructure, could help facilitate integrated space-weather forecasting efforts that take steps to avoid effort duplication. In spite of being one of the most intensive and systematic flare forecasting efforts to-date, FLARECAST has not managed to convincingly lift the barrier of stochasticity in solar flare occurrence and forecasting: solar flare prediction thus remains inherently probabilistic.
△ Less
Submitted 12 May, 2021;
originally announced May 2021.
-
Effects of model incompleteness on the drift-scan calibration of radio telescopes
Authors:
Bharat K. Gehlot,
Daniel C. Jacobs,
Judd D. Bowman,
Nivedita Mahesh,
Steven G. Murray,
Matthew Kolopanis,
Adam P. Beardsley,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Gianni Bernardi,
Tashalee S. Billings,
Richard F. Bradley,
Phil Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Joshua S. Dillon,
John Ely
, et al. (54 additional authors not shown)
Abstract:
Precision calibration poses challenges to experiments probing the redshifted 21-cm signal of neutral hydrogen from the Cosmic Dawn and Epoch of Reionization (z~30-6). In both interferometric and global signal experiments, systematic calibration is the leading source of error. Though many aspects of calibration have been studied, the overlap between the two types of instruments has received less at…
▽ More
Precision calibration poses challenges to experiments probing the redshifted 21-cm signal of neutral hydrogen from the Cosmic Dawn and Epoch of Reionization (z~30-6). In both interferometric and global signal experiments, systematic calibration is the leading source of error. Though many aspects of calibration have been studied, the overlap between the two types of instruments has received less attention. We investigate the sky based calibration of total power measurements with a HERA dish and an EDGES style antenna to understand the role of auto-correlations in the calibration of an interferometer and the role of sky in calibrating a total power instrument. Using simulations we study various scenarios such as time variable gain, incomplete sky calibration model, and primary beam model. We find that temporal gain drifts, sky model incompleteness, and beam inaccuracies cause biases in the receiver gain amplitude and the receiver temperature estimates. In some cases, these biases mix spectral structure between beam and sky resulting in spectrally variable gain errors. Applying the calibration method to the HERA and EDGES data, we find good agreement with calibration via the more standard methods. Although instrumental gains are consistent with beam and sky errors similar in scale to those simulated, the receiver temperatures show significant deviations from expected values. While we show that it is possible to partially mitigate biases due to model inaccuracies by incorporating a time-dependent gain model in calibration, the resulting errors on calibration products are larger and more correlated. Completely addressing these biases will require more accurate sky and primary beam models.
△ Less
Submitted 15 July, 2021; v1 submitted 25 April, 2021;
originally announced April 2021.
-
Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline
Authors:
James E. Aguirre,
Steven G. Murray,
Robert Pascua,
Zachary E. Martinot,
Jacob Burba,
Joshua S. Dillon,
Daniel C. Jacobs,
Nicholas S. Kern,
Piyanat Kittiwisit,
Matthew Kolopanis,
Adam Lanman,
Adrian Liu,
Lily Whitler,
Zara Abdurashidova,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Steve Carey,
Chris L. Carilli
, et al. (51 additional authors not shown)
Abstract:
We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the…
▽ More
We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the organization of this validation approach, the specific modular tests performed, and the construction of the end-to-end simulations. We explicitly discuss the limitations in scope of the current simulation effort. With mock visibility data generated from a known analytic power spectrum and a wide range of realistic instrumental effects and foregrounds, we demonstrate that the current pipeline produces power spectrum estimates that are consistent with known analytic inputs to within thermal noise levels (at the 2 sigma level) for k > 0.2 h/Mpc for both bands and fields considered. Our input spectrum is intentionally amplified to enable a strong `detection' at k ~0.2 h/Mpc -- at the level of ~25 sigma -- with foregrounds dominating on larger scales, and thermal noise dominating at smaller scales. Our pipeline is able to detect this amplified input signal after suppressing foregrounds with a dynamic range (foreground to noise ratio) of > 10^7. Our validation test suite uncovered several sources of scale-independent signal loss throughout the pipeline, whose amplitude is well-characterized and accounted for in the final estimates. We conclude with a discussion of the steps required for the next round of data analysis.
△ Less
Submitted 19 April, 2021;
originally announced April 2021.
-
A Real Time Processing System for Big Data in Astronomy: Applications to HERA
Authors:
Paul La Plante,
Peter K. G. Williams,
Matthew Kolopanis,
Joshua S. Dillon,
Adam P. Beardsley,
Nicholas S. Kern,
Michael Wilensky,
Zaki S. Ali,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Yanga Balfour,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Phil Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
John Ely
, et al. (50 additional authors not shown)
Abstract:
As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen…
▽ More
As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data.
△ Less
Submitted 30 September, 2021; v1 submitted 8 April, 2021;
originally announced April 2021.
-
Methods of Error Estimation for Delay Power Spectra in $21\,\textrm{cm}$ Cosmology
Authors:
Jianrong Tan,
Adrian Liu,
Nicholas S. Kern,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Christopher L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Joshua S. Dillon,
John Ely,
Aaron Ewall-Wice,
Nicolas Fagnoni
, et al. (49 additional authors not shown)
Abstract:
Precise measurements of the 21 cm power spectrum are crucial for understanding the physical processes of hydrogen reionization. Currently, this probe is being pursued by low-frequency radio interferometer arrays. As these experiments come closer to making a first detection of the signal, error estimation will play an increasingly important role in setting robust measurements. Using the delay power…
▽ More
Precise measurements of the 21 cm power spectrum are crucial for understanding the physical processes of hydrogen reionization. Currently, this probe is being pursued by low-frequency radio interferometer arrays. As these experiments come closer to making a first detection of the signal, error estimation will play an increasingly important role in setting robust measurements. Using the delay power spectrum approach, we have produced a critical examination of different ways that one can estimate error bars on the power spectrum. We do this through a synthesis of analytic work, simulations of toy models, and tests on small amounts of real data. We find that, although computed independently, the different error bar methodologies are in good agreement with each other in the noise-dominated regime of the power spectrum. For our preferred methodology, the predicted probability distribution function is consistent with the empirical noise power distributions from both simulated and real data. This diagnosis is mainly in support of the forthcoming HERA upper limit, and also is expected to be more generally applicable.
△ Less
Submitted 25 May, 2021; v1 submitted 17 March, 2021;
originally announced March 2021.
-
Chandra Observations of the Planck ESZ Sample: A Re-Examination of Masses and Mass Proxies
Authors:
Felipe Andrade-Santos,
Gabriel W. Pratt,
Jean-Baptiste Melin,
Monique Arnaud,
Christine Jones,
William R. Forman,
Etienne Pointecouteau,
Iacopo Bartalucci,
Alexey Vikhlinin,
Stephen S. Murray,
Pasquale Mazzotta,
Stefano Borgani,
Lorenzo Lovisari,
Reinout J. van Weeren,
Ralph P. Kraft,
Laurence P. David,
Simona Giacintucci
Abstract:
Using Chandra observations, we derive the $Y_{\rm X}$ proxy and associated total mass measurement, $M_{500}^{\rm Y_X}$, for 147 clusters with $z \leq 0.35$ from the Planck Early Sunyaev-Zel'dovich catalog, and for 80 clusters with $z \leq 0.30$ from an X-ray flux-limited sample. We re-extract the Planck $Y_{\rm SZ}$ measurements and obtain the corresponding mass proxy, $M_{500}^{\rm SZ}$, from the…
▽ More
Using Chandra observations, we derive the $Y_{\rm X}$ proxy and associated total mass measurement, $M_{500}^{\rm Y_X}$, for 147 clusters with $z \leq 0.35$ from the Planck Early Sunyaev-Zel'dovich catalog, and for 80 clusters with $z \leq 0.30$ from an X-ray flux-limited sample. We re-extract the Planck $Y_{\rm SZ}$ measurements and obtain the corresponding mass proxy, $M_{500}^{\rm SZ}$, from the full Planck mission maps, minimizing the Malmquist bias due to observational scatter. The masses re-extracted using the more precise X-ray position and characteristic size agree with the published PSZ2 values, but yield a significant reduction in the scatter (by a factor of two) in the $M_{500}^{\rm SZ}$-$M_{500}^{\rm X}$ relation. The slope is $0.93\pm0.03$, and the median ratio, $M_{500}^{\rm SZ}/M_{500}^{\rm X}= 0.91\pm0.01$, is within the expectations from known X-ray calibration systematics. The $Y_{\rm SZ}/Y_{\rm X}$ ratio is $0.88\pm0.02$, in good agreement with predictions from cluster structure, and implying a low level of clumpiness. In agreement with the findings of the Planck Collaboration, the slope of the $Y_{\rm SZ}$-$D_{\rm A}^{-2} Y_{X}$ flux relation is significantly less than unity ($0.89\pm0.01$). Using extensive simulations, we show that this result is not due to selection effects, intrinsic scatter, or covariance between quantities. We demonstrate analytically that changing the $Y_{\rm SZ}$-$Y_{X}$ relation from apparent flux to intrinsic properties results in a best-fit slope that is closer to unity and increases the dispersion about the relation. The redistribution resulting from this transformation implies that the best fit parameters of the $M_{500}^{\rm SZ}$-$M_{500}^{\rm X}$ relation will be sample-dependent.
△ Less
Submitted 6 April, 2021; v1 submitted 12 March, 2021;
originally announced March 2021.
-
Validation of EDGES Low-Band Antenna Beam Model
Authors:
Nivedita Mahesh,
Judd D. Bowman,
Thomas J. Mozdzen,
Alan E. E. Rogers,
Raul A. Monsalve,
Steven G. Murray,
David Lewis
Abstract:
The response of the antenna is a source of uncertainty in measurements with the Experiment to Detect the Global EoR Signature (EDGES). We aim to validate the beam model of the low-band (50-100 MHz) dipole antenna with comparisons between models and against data. We find that simulations of a simplified model of the antenna over an infinite perfectly conducting ground plane are, with one exception,…
▽ More
The response of the antenna is a source of uncertainty in measurements with the Experiment to Detect the Global EoR Signature (EDGES). We aim to validate the beam model of the low-band (50-100 MHz) dipole antenna with comparisons between models and against data. We find that simulations of a simplified model of the antenna over an infinite perfectly conducting ground plane are, with one exception, robust to changes of numerical electromagnetic solver code or algorithm. For simulations of the antenna with the actual finite ground plane and realistic soil properties, we find that two out of three numerical solvers agree well. Applying our analysis pipeline to a simulated driftscan observation from an early EDGES low-band instrument that had a 10 m $\times$ 10 m ground plane, we find residual levels after fitting and removing a five-term foreground model to data binned in Local Sidereal Time (LST) average about 250 mK with $\pm$40 mK variation between numerical solvers. A similar analysis of the primary 30 m $\times$ 30 m sawtooth ground plane reduced the LST-averaged residuals to about 90 mK with $\pm$10 mK between the two viable solvers. More broadly we show that larger ground planes generally perform better than smaller ground planes. Simulated data have a power which is within 4$\%$ of real observations, a limitation of net accuracy of the sky and beam models. We observe that residual spectral structures after foreground model fits match qualitatively between simulated data and observations, suggesting that the frequency dependence of the beam is reasonably represented by the models. We find that soil conductivity of 0.02 Sm$^{-1}$ and relative permittivity of 3.5 yield good agreement between simulated spectra and observations. This is consistent with the soil properties reported by Sutinjo et al. (2015) for the Murchison Radio-astronomy Observatory, where EDGES is located.
△ Less
Submitted 2 March, 2021; v1 submitted 28 February, 2021;
originally announced March 2021.
-
Absolute Calibration of Diffuse Radio Surveys at 45 and 150 MHz
Authors:
Raul A. Monsalve,
Alan E. E. Rogers,
Judd D. Bowman,
Nivedita Mahesh,
Steven G. Murray,
Thomas J. Mozdzen,
Leroy Johnson,
John Barrett,
Titu Samson,
David Lewis
Abstract:
We use EDGES measurements to determine scale and zero-level corrections to the diffuse radio surveys by Guzmán et al. at $45$ MHz and Landecker & Wielebinski at $150$ MHz. We find that the Guzmán et al. map requires a scale correction of $1.076 \pm 0.034$ ($2σ$) and a zero-level correction of $-160 \pm 78$ K ($2σ$) to best-fit the EDGES data. For the Landecker & Wielebinski map, the scale correcti…
▽ More
We use EDGES measurements to determine scale and zero-level corrections to the diffuse radio surveys by Guzmán et al. at $45$ MHz and Landecker & Wielebinski at $150$ MHz. We find that the Guzmán et al. map requires a scale correction of $1.076 \pm 0.034$ ($2σ$) and a zero-level correction of $-160 \pm 78$ K ($2σ$) to best-fit the EDGES data. For the Landecker & Wielebinski map, the scale correction is $1.112 \pm 0.023$ ($2σ$) and the zero-level correction is $0.7 \pm 6.0$ K ($2σ$). The correction uncertainties are dominated by systematic effects, of which the most significant are uncertainty in the calibration of the EDGES receivers, antenna pointing, and tropospheric and ionospheric effects. We propagate the correction uncertainties to estimate the uncertainties in the corrected maps themselves and find that the $2σ$ uncertainty in the map brightness temperature is in the range $3.2-7.5\%$ for the Guzmán et al. map and $2.1-9.0\%$ for the Landecker & Wielebinski map, with the largest percent uncertainties occurring at high Galactic latitudes. The corrected maps could be used to improve existing diffuse low-frequency radio sky models, which are essential tools in analyses of cosmological $21$ cm observations, as well as to investigate the existence of a radio monopole excess above the cosmic microwave background and known Galactic and extragalactic contributions.
△ Less
Submitted 20 December, 2020;
originally announced December 2020.
-
21cmFAST v3: A Python-integrated C code forgenerating 3D realizations of the cosmic 21cm signal
Authors:
Steven G. Murray,
Bradley Greig,
Andrei Mesinger,
Julian B. Muñoz,
Yuxiang Qin,
Jaehong Park,
Catherine A. Watkinson
Abstract:
This brief code paper presents a new Python-wrapped version of the popular 21cm cosmology simulator, 21cmFAST. The new version, v3+, maintains the same core functionality of previous versions of 21cmFAST, but features a simple and intuitive interface, and a great deal more flexibility. This evolution represents the work of a formalized collaboration, and the new version, available publicly on GitH…
▽ More
This brief code paper presents a new Python-wrapped version of the popular 21cm cosmology simulator, 21cmFAST. The new version, v3+, maintains the same core functionality of previous versions of 21cmFAST, but features a simple and intuitive interface, and a great deal more flexibility. This evolution represents the work of a formalized collaboration, and the new version, available publicly on GitHub, provides a single point-of-reference for all future upgrades and community-added features. In this paper, we describe simple usage of 21cmFAST, some of its new features, and provide a simple performance benchmark.
△ Less
Submitted 28 October, 2020;
originally announced October 2020.
-
Extracting HI Astrophysics from Interferometric Intensity Mapping
Authors:
Zhaoting Chen,
Laura Wolz,
Marta Spinelli,
Steven G. Murray
Abstract:
We present a new halo model of neutral hydrogen (HI) calibrated to galaxy formation simulations at redshifts $z\sim0.1$ and $z\sim1.0$ that we employ to investigate the constraining power of interferometric HI intensity mapping on HI astrophysics. We demonstrate that constraints on the small-scale HI power spectrum can break the degeneracy between the HI density $Ω_{\rm HI}$ and the HI bias…
▽ More
We present a new halo model of neutral hydrogen (HI) calibrated to galaxy formation simulations at redshifts $z\sim0.1$ and $z\sim1.0$ that we employ to investigate the constraining power of interferometric HI intensity mapping on HI astrophysics. We demonstrate that constraints on the small-scale HI power spectrum can break the degeneracy between the HI density $Ω_{\rm HI}$ and the HI bias $b_{\rm HI}$. For $z\sim0.1$, we forecast that an accurate measurement of $Ω_{\rm HI}$ up to 6% level precision and the large-scale HI bias $b_{\rm HI}^0$ up to 1% level precision can be achieved using Square Kilometre Array (SKA) pathfinder data from MeerKAT and Australian SKA Pathfinder (ASKAP). We also propose a new description of the HI shot noise in the halo model framework in which a scatter of the relation between the HI mass of galaxies and their host halo mass is taken into account. Furthermore, given the number density of HI galaxies above a certain HI mass threshold, future surveys will also be able to constrain the HI mass function using only the HI shot noise. This will lead to constraints at the 10% level using the standard Schechter function. This technique will potentially provide a new way of measuring the HI Mass Function, independent from existing methods. We predict that the SKA will be able to further improve the low-redshift constraints by a factor of 3, as well as pioneering measurements of HI astrophysics at higher redshifts.
△ Less
Submitted 20 March, 2021; v1 submitted 15 October, 2020;
originally announced October 2020.
-
TheHaloMod: An online calculator for the halo model
Authors:
Steven G. Murray,
Benedikt Diemer,
Zhaoting Chen,
Anton Glenn Neuhold Jr.,
M. A. Schnapp,
Tia Peruzzi,
Daniel Blevins,
Trent Engelman
Abstract:
The halo model is a successful framework for describing the distribution of matter in the Universe -- from weak lensing observables to galaxy 2-point correlation functions. We review the basic formulation of the halo model and several of its components in the context of galaxy two-point statistics, developing a coherent framework for its application. We use this framework to motivate the presentat…
▽ More
The halo model is a successful framework for describing the distribution of matter in the Universe -- from weak lensing observables to galaxy 2-point correlation functions. We review the basic formulation of the halo model and several of its components in the context of galaxy two-point statistics, developing a coherent framework for its application. We use this framework to motivate the presentation of a new Python tool for simple and efficient calculation of halo model quantities, and their extension to galaxy statistics via a \textit{halo occupation distribution}, called \halomod. This tool is efficient, simple to use, comprehensive and importantly provides a great deal of flexibility in terms of custom extensions. This Python tool is complemented by a new web-application at https://thehalomod.app that supports the generation of many halo model quantities directly from the browser -- useful for educators, students, theorists and observers.
△ Less
Submitted 9 August, 2021; v1 submitted 29 September, 2020;
originally announced September 2020.
-
The Impact of Tandem Redundant/Sky-Based Calibration in MWA Phase II Data Analysis
Authors:
Zheng Zhang,
Jonathan C. Pober,
Wenyang Li,
Bryna J. Hazelton,
Miguel F. Morales,
Cathryn M. Trott,
Christopher H. Jordan,
Ronniy C. Joseph,
Adam Beardsley,
Nichole Barry,
Ruby Byrne,
Steven J. Tingay,
Aman Chokshi,
Kenji Hasegawa,
Daniel C. Jacobs,
Adam Lanman,
Jack L. B. Line,
Christene Lynch,
Benjamin McKinley,
Daniel A. Mitchell,
Steven Murray,
Bart Pindor,
Mahsa Rahimi,
Keitaro Takahashi,
Randall B. Wayth
, et al. (4 additional authors not shown)
Abstract:
Precise instrumental calibration is of crucial importance to 21-cm cosmology experiments. The Murchison Widefield Array's (MWA) Phase II compact configuration offers us opportunities for both redundant calibration and sky-based calibration algorithms; using the two in tandem is a potential approach to mitigate calibration errors caused by inaccurate sky models. The MWA Epoch of Reionization (EoR)…
▽ More
Precise instrumental calibration is of crucial importance to 21-cm cosmology experiments. The Murchison Widefield Array's (MWA) Phase II compact configuration offers us opportunities for both redundant calibration and sky-based calibration algorithms; using the two in tandem is a potential approach to mitigate calibration errors caused by inaccurate sky models. The MWA Epoch of Reionization (EoR) experiment targets three patches of the sky (dubbed EoR0, EoR1, and EoR2) with deep observations. Previous work in \cite{Li_2018} and \cite{Wenyang_2019} studied the effect of tandem calibration on the EoR0 field and found that it yielded no significant improvement in the power spectrum over sky-based calibration alone. In this work, we apply similar techniques to the EoR1 field and find a distinct result: the improvements in the power spectrum from tandem calibration are significant. To understand this result, we analyze both the calibration solutions themselves and the effects on the power spectrum over three nights of EoR1 observations. We conclude that the presence of the bright radio galaxy Fornax A in EoR1 degrades the performance of sky-based calibration, which in turn enables redundant calibration to have a larger impact. These results suggest that redundant calibration can indeed mitigate some level of model-incompleteness error.
△ Less
Submitted 19 September, 2020;
originally announced September 2020.
-
The Chandra Deep Wide-Field Survey: A New Chandra Legacy Survey in the Boötes Field I. X-ray Point Source Catalog, Number Counts and Multi-Wavelength Counterparts
Authors:
A. Masini,
R. C. Hickox,
C. M. Carroll,
J. Aird,
D. M. Alexander,
R. J. Assef,
R. Bower,
M. Brodwin,
M. J. I. Brown,
S. Chatterjee,
C. -T. J. Chen,
A. Dey,
M. A. DiPompeo,
K. J. Duncan,
P. R. M. Eisenhardt,
W. R. Forman,
A. H. Gonzalez,
A. D. Goulding,
K. N. Hainline,
B. T. Jannuzi,
C. Jones,
C. S. Kochanek,
R. Kraft,
K. -S. Lee,
E. D. Miller
, et al. (8 additional authors not shown)
Abstract:
We present a new, ambitious survey performed with the Chandra X-ray Observatory of the 9.3 deg$^2$ Boötes field of the NOAO Deep Wide-Field Survey. The wide field probes a statistically representative volume of the Universe at high redshift. The Chandra Deep Wide-Field Survey exploits the excellent sensitivity and angular resolution of Chandra over a wide area, combining 281 observations spanning…
▽ More
We present a new, ambitious survey performed with the Chandra X-ray Observatory of the 9.3 deg$^2$ Boötes field of the NOAO Deep Wide-Field Survey. The wide field probes a statistically representative volume of the Universe at high redshift. The Chandra Deep Wide-Field Survey exploits the excellent sensitivity and angular resolution of Chandra over a wide area, combining 281 observations spanning 15 years, for a total exposure time of 3.4 Ms, and detects 6891 X-ray point sources down to limiting fluxes of $4.7\times10^{-16}$, $1.5\times10^{-16}$, and $9\times10^{-16}$ erg cm$^{-2}$ s$^{-1}$, in the $0.5-7$ keV, $0.5-2$ keV, and $2-7$ keV bands, respectively. The robustness and reliability of the detection strategy is validated through extensive, state-of-the-art simulations of the whole field. Accurate number counts, in good agreement with previous X-ray surveys, are derived thanks to the uniquely large number of point sources detected, which resolve $65.0 \pm 12.8\%$ of the cosmic X-ray background between $0.5-2$ keV and $81.0 \pm 11.5\%$ between $2-7$ keV. Exploiting the wealth of multi-wavelength data available on the field, we assign redshifts to $\sim 94\%$ of the X-ray sources, estimate their obscuration and derive absorption-corrected luminosities. We provide an electronic catalog containing all the relevant quantities needed for future investigations.
△ Less
Submitted 7 September, 2020;
originally announced September 2020.
-
Ensemble Forecasting of Major Solar Flares: Methods for Combining Models
Authors:
Jordan A. Guerra,
Sophie A. Murray,
D. Shaun Bloomfield,
Peter T. Gallagher
Abstract:
One essential component of operational space weather forecasting is the prediction of solar flares. With a multitude of flare forecasting methods now available online it is still unclear which of these methods performs best, and none are substantially better than climatological forecasts. Space weather researchers are increasingly looking towards methods used by the terrestrial weather community t…
▽ More
One essential component of operational space weather forecasting is the prediction of solar flares. With a multitude of flare forecasting methods now available online it is still unclear which of these methods performs best, and none are substantially better than climatological forecasts. Space weather researchers are increasingly looking towards methods used by the terrestrial weather community to improve current forecasting techniques. Ensemble forecasting has been used in numerical weather prediction for many years as a way to combine different predictions in order to obtain a more accurate result. Here we construct ensemble forecasts for major solar flares by linearly combining the full-disk probabilistic forecasts from a group of operational forecasting methods (ASAP, ASSA, MAG4, MOSWOC, NOAA, and MCSTAT). Forecasts from each method are weighted by a factor that accounts for the method's ability to predict previous events, and several performance metrics (both probabilistic and categorical) are considered. It is found that most ensembles achieve a better skill metric (between 5\% and 15\%) than any of the members alone. Moreover, over 90\% of ensembles perform better (as measured by forecast attributes) than a simple equal-weights average. Finally, ensemble uncertainties are highly dependent on the internal metric being optimized and they are estimated to be less than 20\% for probabilities greater than 0.2. This simple multi-model, linear ensemble technique can provide operational space weather centres with the basis for constructing a versatile ensemble forecasting system -- an improved starting point to their forecasts that can be tailored to different end-user needs.
△ Less
Submitted 1 August, 2020;
originally announced August 2020.
-
Reionization inference from the CMB optical depth and E-mode polarization power spectra
Authors:
Yuxiang Qin,
Vivian Poulin,
Andrei Mesinger,
Bradley Greig,
Steven Murray,
Jaehong Park
Abstract:
The Epoch of Reionization (EoR) depends on the complex astrophysics governing the birth and evolution of the first galaxies and structures in the intergalactic medium. EoR models rely on cosmic microwave background (CMB) observations, and in particular the large-scale E-mode polarization power spectra (EE PS), to help constrain their highly uncertain parameters. However, rather than directly forwa…
▽ More
The Epoch of Reionization (EoR) depends on the complex astrophysics governing the birth and evolution of the first galaxies and structures in the intergalactic medium. EoR models rely on cosmic microwave background (CMB) observations, and in particular the large-scale E-mode polarization power spectra (EE PS), to help constrain their highly uncertain parameters. However, rather than directly forward-modelling the EE PS, most EoR models are constrained using a summary statistic -- the Thompson scattering optical depth, $τ_e$. Compressing CMB observations to $τ_e$ requires adopting a basis set for the EoR history. The common choice is the unphysical, redshift-symmetric hyperbolic tangent (Tanh) function, which differs in shape from physical EoR models based on hierarchical structure formation. Combining public EoR and CMB codes, 21cmFAST and CLASS, here we quantify how inference using the $τ_e$ summary statistic impacts the resulting constraints on galaxy properties and EoR histories. Using the last Planck 2018 data release, we show that the marginalized constraints on the EoR history are more sensitive to the choice of the basis set (Tanh vs physical model) than to the CMB likelihood statistic ($τ_e$ vs PS). For example, EoR histories implied by the growth of structure show a small tail of partial reionization extending to higher redshifts. However, biases in inference using $τ_e$ are negligible for the Planck 2018 data. Using EoR constraints from high-redshift observations including the quasar dark fraction, galaxy UV luminosity functions and CMB EE PS, our physical model recovers $τ_e=0.0569^{+0.0081}_{-0.0066}$.
△ Less
Submitted 24 September, 2020; v1 submitted 30 June, 2020;
originally announced June 2020.