-
Understanding the HERA Phase I receiver system with simulations and its impact on the detectability of the EoR delay power spectrum
Authors:
Nicolas Fagnoni,
Eloy de Lera Acedo,
David R. DeBoer,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Phil Bull,
Jacob Burba,
Chris L. Carilli,
Carina Cheng,
Matt Dexter,
Joshua S. Dillon,
Aaron Ewall-Wice,
Randall Fritz,
Steve R. Furlanetto,
Kingsley Gale-Sides,
Brian Glendenning,
Deepthi Gorthi
, et al. (45 additional authors not shown)
Abstract:
The detection of the Epoch of Reionization (EoR) delay power spectrum using a "foreground avoidance method" highly depends on the instrument chromaticity. The systematic effects induced by the radio-telescope spread the foreground signal in the delay domain, which contaminates the EoR window theoretically observable. Applied to the Hydrogen Epoch of Reionization Array (HERA), this paper combines d…
▽ More
The detection of the Epoch of Reionization (EoR) delay power spectrum using a "foreground avoidance method" highly depends on the instrument chromaticity. The systematic effects induced by the radio-telescope spread the foreground signal in the delay domain, which contaminates the EoR window theoretically observable. Applied to the Hydrogen Epoch of Reionization Array (HERA), this paper combines detailed electromagnetic and electrical simulations in order to model the chromatic effects of the instrument, and quantify its frequency and time responses. In particular, the effects of the analogue receiver, transmission cables, and mutual coupling are included. These simulations are able to accurately predict the intensity of the reflections occurring in the 150-m cable which links the antenna to the back-end. They also show that electromagnetic waves can propagate from one dish to another one through large sections of the array due to mutual coupling. The simulated system time response is attenuated by a factor $10^{4}$ after a characteristic delay which depends on the size of the array and on the antenna position. Ultimately, the system response is attenuated by a factor $10^{5}$ after 1400 ns because of the reflections in the cable, which corresponds to characterizable ${k_\parallel}$-modes above 0.7 $h\;\rm{Mpc}^{-1}$ at 150 MHz. Thus, this new study shows that the detection of the EoR signal with HERA Phase I will be more challenging than expected. On the other hand, it improves our understanding of the telescope, which is essential to mitigate the instrument chromaticity.
△ Less
Submitted 25 August, 2020; v1 submitted 6 August, 2019;
originally announced August 2019.
-
ICE: a scalable, low-cost FPGA-based telescope signal processing and networking system
Authors:
K. Bandura,
A. N. Bender,
J. F. Cliche,
T. de Haan,
M. A. Dobbs,
A. J. Gilbert,
S. Griffin,
G. Hsyu,
D. Ittah,
J. Mena Parra,
J. Montgomery,
T. Pinsonneault-Marotte,
S. Siegel,
G. Smecher,
Q. Y. Tang,
K. Vanderlinde,
N. Whitehorn
Abstract:
We present an overview of the 'ICE' hardware and software framework that implements large arrays of interconnected FPGA-based data acquisition, signal processing and networking nodes economically. The system was conceived for application to radio, millimeter and sub-millimeter telescope readout systems that have requirements beyond typical off-the-shelf processing systems, such as careful control…
▽ More
We present an overview of the 'ICE' hardware and software framework that implements large arrays of interconnected FPGA-based data acquisition, signal processing and networking nodes economically. The system was conceived for application to radio, millimeter and sub-millimeter telescope readout systems that have requirements beyond typical off-the-shelf processing systems, such as careful control of interference signals produced by the digital electronics, and clocking of all elements in the system from a single precise observatory-derived oscillator. A new generation of telescopes operating at these frequency bands and designed with a vastly increased emphasis on digital signal processing to support their detector multiplexing technology or high-bandwidth correlators---data rates exceeding a terabyte per second---are becoming common. The ICE system is built around a custom FPGA motherboard that makes use of an Xilinx Kintex-7 FPGA and ARM-based co-processor. The system is specialized for specific applications through software, firmware, and custom mezzanine daughter boards that interface to the FPGA through the industry-standard FMC specifications. For high density applications, the motherboards are packaged in 16-slot crates with ICE backplanes that implement a low-cost passive full-mesh network between the motherboards in a crate, allow high bandwidth interconnection between crates, and enable data offload to a computer cluster. A Python-based control software library automatically detects and operates the hardware in the array. Examples of specific telescope applications of the ICE framework are presented, namely the frequency-multiplexed bolometer readout systems used for the SPT and Simons Array and the digitizer, F-engine, and networking engine for the CHIME and HIRAX radio interferometers.
△ Less
Submitted 22 August, 2016;
originally announced August 2016.
-
ICE-based Custom Full-Mesh Network for the CHIME High Bandwidth Radio Astronomy Correlator
Authors:
Kevin Bandura,
Jean-Francois Cliche,
Matt Dobbs,
Adam Gilbert,
David Ittah,
Juan Mena Parra,
Graeme Smecher
Abstract:
New generation radio interferometers encode signals from thousands of antenna feeds across large bandwidth. Channelizing and correlating this data requires networking capabilities that can handle unprecedented data rates with reasonable cost. The Canadian Hydrogen Intensity Mapping Experiment (CHIME) correlator processes 8-bits from N=2048 digitizer inputs across 400~MHz of bandwidth. Measured in…
▽ More
New generation radio interferometers encode signals from thousands of antenna feeds across large bandwidth. Channelizing and correlating this data requires networking capabilities that can handle unprecedented data rates with reasonable cost. The Canadian Hydrogen Intensity Mapping Experiment (CHIME) correlator processes 8-bits from N=2048 digitizer inputs across 400~MHz of bandwidth. Measured in $N^2~\times $ bandwidth, it is the largest radio correlator that has been built. Its digital back-end must exchange and reorganize the 6.6~terabit/s produced by its 128 digitizing and channelizing nodes, and feed it to the 256-node spatial correlator in a way that each node obtains data from all digitizer inputs but across a small fraction of the bandwidth (i.e. `corner-turn'). In order to maximize performance and reliability of the corner-turn system while minimizing cost, a custom networking solution has been implemented. The system makes use of Field Programmable Gate Array (FPGA) transceivers to implement direct, passive, full-mesh, high speed serial connections between sixteen circuit boards in a crate, to exchange data between crates, and to offload the data to a cluster of 256 graphics processing unit (GPU) nodes using standard 10~Gbit/s Ethernet links. The GPU nodes complete the corner-turn by combining data from all crates and then computing visibilities. Eye diagrams and frame error counters confirm error-free operation of the corner-turn network in both the currently operating CHIME Pathfinder telescope (a prototype for the full CHIME telescope) and a representative fraction of the full CHIME hardware providing an end-to-end system validation.
An analysis of an equivalent corner-turn system built with Ethernet switches instead of custom passive data links is provided.
△ Less
Submitted 15 August, 2016;
originally announced August 2016.
-
HIRAX: A Probe of Dark Energy and Radio Transients
Authors:
L. B. Newburgh,
K. Bandura,
M. A. Bucher,
T. -C. Chang,
H. C. Chiang,
J. F. Cliche,
R. Dave,
M. Dobbs,
C. Clarkson,
K. M. Ganga,
T. Gogo,
A. Gumba,
N. Gupta,
M. Hilton,
B. Johnstone,
A. Karastergiou,
M. Kunz,
D. Lokhorst,
R. Maartens,
S. Macpherson,
M. Mdlalose,
K. Moodley,
L. Ngwenya,
J. M. Parra,
J. Peterson
, et al. (11 additional authors not shown)
Abstract:
The Hydrogen Intensity and Real-time Analysis eXperiment (HIRAX) is a new 400-800MHz radio interferometer under development for deployment in South Africa. HIRAX will comprise 1024 six meter parabolic dishes on a compact grid and will map most of the southern sky over the course of four years. HIRAX has two primary science goals: to constrain Dark Energy and measure structure at high redshift, and…
▽ More
The Hydrogen Intensity and Real-time Analysis eXperiment (HIRAX) is a new 400-800MHz radio interferometer under development for deployment in South Africa. HIRAX will comprise 1024 six meter parabolic dishes on a compact grid and will map most of the southern sky over the course of four years. HIRAX has two primary science goals: to constrain Dark Energy and measure structure at high redshift, and to study radio transients and pulsars. HIRAX will observe unresolved sources of neutral hydrogen via their redshifted 21-cm emission line (`hydrogen intensity mapping'). The resulting maps of large-scale structure at redshifts 0.8-2.5 will be used to measure Baryon Acoustic Oscillations (BAO). HIRAX will improve upon current BAO measurements from galaxy surveys by observing a larger cosmological volume (larger in both survey area and redshift range) and by measuring BAO at higher redshift when the expansion of the universe transitioned to Dark Energy domination. HIRAX will complement CHIME, a hydrogen intensity mapping experiment in the Northern Hemisphere, by completing the sky coverage in the same redshift range. HIRAX's location in the Southern Hemisphere also allows a variety of cross-correlation measurements with large-scale structure surveys at many wavelengths. Daily maps of a few thousand square degrees of the Southern Hemisphere, encompassing much of the Milky Way galaxy, will also open new opportunities for discovering and monitoring radio transients. The HIRAX correlator will have the ability to rapidly and eXperimentciently detect transient events. This new data will shed light on the poorly understood nature of fast radio bursts (FRBs), enable pulsar monitoring to enhance long-wavelength gravitational wave searches, and provide a rich data set for new radio transient phenomena searches. This paper discusses the HIRAX instrument, science goals, and current status.
△ Less
Submitted 7 July, 2016;
originally announced July 2016.
-
Holographic Beam Mapping of the CHIME Pathfinder Array
Authors:
Philippe Berger,
Laura B. Newburgh,
Mandana Amiri,
Kevin Bandura,
Jean-Francois Cliche,
Liam Connor,
Meiling Deng,
Nolan Denman,
Matt Dobbs,
Mateus Fandino,
Adam J. Gilbert,
Deborah Good,
Mark Halpern,
David Hanna,
Adam D. Hincks,
Gary Hinshaw,
Carolin Hofer,
Andre M. Johnson,
Tom L. Landecker,
Kiyoshi W. Masui,
Juan Mena Parra,
Niels Oppermann,
Ue-Li Pen,
Jeffrey B. Peterson,
Andre Recnik
, et al. (10 additional authors not shown)
Abstract:
The Canadian Hydrogen Intensity Mapping Experiment (CHIME) Pathfinder radio telescope is currently surveying the northern hemisphere between 400 and 800 MHz. By mapping the large scale structure of neutral hydrogen through its redshifted 21 cm line emission between $z \sim 0.8-2.5$ CHIME will contribute to our understanding of Dark Energy. Bright astrophysical foregrounds must be separated from th…
▽ More
The Canadian Hydrogen Intensity Mapping Experiment (CHIME) Pathfinder radio telescope is currently surveying the northern hemisphere between 400 and 800 MHz. By mapping the large scale structure of neutral hydrogen through its redshifted 21 cm line emission between $z \sim 0.8-2.5$ CHIME will contribute to our understanding of Dark Energy. Bright astrophysical foregrounds must be separated from the neutral hydrogen signal, a task which requires precise characterization of the polarized telescope beams. Using the DRAO John A. Galt 26 m telescope, we have developed a holography instrument and technique for mapping the CHIME Pathfinder beams. We report the status of the instrument and initial results of this effort.
△ Less
Submitted 5 July, 2016;
originally announced July 2016.
-
A GPU-based Correlator X-engine Implemented on the CHIME Pathfinder
Authors:
Nolan Denman,
Mandana Amiri,
Kevin Bandura,
Jean-François Cliche,
Liam Connor,
Matt Dobbs,
Mateus Fandino,
Mark Halpern,
Adam Hincks,
Gary Hinshaw,
Carolin Höfer,
Peter Klages,
Kiyoshi Masui,
Juan Mena Parra,
Laura Newburgh,
Andre Recnik,
J. Richard Shaw,
Kris Sigurdson,
Kendrick Smith,
Keith Vanderlinde
Abstract:
We present the design and implementation of a custom GPU-based compute cluster that provides the correlation X-engine of the CHIME Pathfinder radio telescope. It is among the largest such systems in operation, correlating 32,896 baselines (256 inputs) over 400MHz of radio bandwidth. Making heavy use of consumer-grade parts and a custom software stack, the system was developed at a small fraction o…
▽ More
We present the design and implementation of a custom GPU-based compute cluster that provides the correlation X-engine of the CHIME Pathfinder radio telescope. It is among the largest such systems in operation, correlating 32,896 baselines (256 inputs) over 400MHz of radio bandwidth. Making heavy use of consumer-grade parts and a custom software stack, the system was developed at a small fraction of the cost of comparable installations. Unlike existing GPU backends, this system is built around OpenCL kernels running on consumer-level AMD GPUs, taking advantage of low-cost hardware and leveraging packed integer operations to double algorithmic efficiency. The system achieves the required 105TOPS in a 10kW power envelope, making it among the most power-efficient X-engines in use today.
△ Less
Submitted 11 June, 2015; v1 submitted 20 March, 2015;
originally announced March 2015.
-
A compression scheme for radio data in high performance computing
Authors:
Kiyoshi Masui,
Mandana Amiri,
Liam Connor,
Meiling Deng,
Mateus Fandino,
Carolin Höfer,
Mark Halpern,
David Hanna,
Adam D. Hincks,
Gary Hinshaw,
Juan Mena Parra,
Laura B. Newburgh,
J. Richard Shaw,
Keith Vanderlinde
Abstract:
We present a procedure for efficiently compressing astronomical radio data for high performance applications. Integrated, post-correlation data are first passed through a nearly lossless rounding step which compares the precision of the data to a generalized and calibration-independent form of the radiometer equation. This allows the precision of the data to be reduced in a way that has an insigni…
▽ More
We present a procedure for efficiently compressing astronomical radio data for high performance applications. Integrated, post-correlation data are first passed through a nearly lossless rounding step which compares the precision of the data to a generalized and calibration-independent form of the radiometer equation. This allows the precision of the data to be reduced in a way that has an insignificant impact on the data. The newly developed Bitshuffle lossless compression algorithm is subsequently applied. When the algorithm is used in conjunction with the HDF5 library and data format, data produced by the CHIME Pathfinder telescope is compressed to 28% of its original size and decompression throughputs in excess of 1 GB/s are obtained on a single core.
△ Less
Submitted 16 September, 2015; v1 submitted 2 March, 2015;
originally announced March 2015.
-
Calibrating CHIME, A New Radio Interferometer to Probe Dark Energy
Authors:
Laura B. Newburgh,
Graeme E. Addison,
Mandana Amiri,
Kevin Bandura,
J. Richard Bond,
Liam Connor,
Jean-François Cliche,
Greg Davis,
Meiling Deng,
Nolan Denman,
Matt Dobbs,
Mateus Fandino,
Heather Fong,
Kenneth Gibbs,
Adam Gilbert,
Elizabeth Griffin,
Mark Halpern,
David Hanna,
Adam D. Hincks,
Gary Hinshaw,
Carolin Höfer,
Peter Klages,
Tom Landecker,
Kiyoshi Masui,
Juan Mena Parra
, et al. (10 additional authors not shown)
Abstract:
The Canadian Hydrogen Intensity Mapping Experiment (CHIME) is a transit interferometer currently being built at the Dominion Radio Astrophysical Observatory (DRAO) in Penticton, BC, Canada. We will use CHIME to map neutral hydrogen in the frequency range 400 -- 800\,MHz over half of the sky, producing a measurement of baryon acoustic oscillations (BAO) at redshifts between 0.8 -- 2.5 to probe dark…
▽ More
The Canadian Hydrogen Intensity Mapping Experiment (CHIME) is a transit interferometer currently being built at the Dominion Radio Astrophysical Observatory (DRAO) in Penticton, BC, Canada. We will use CHIME to map neutral hydrogen in the frequency range 400 -- 800\,MHz over half of the sky, producing a measurement of baryon acoustic oscillations (BAO) at redshifts between 0.8 -- 2.5 to probe dark energy. We have deployed a pathfinder version of CHIME that will yield constraints on the BAO power spectrum and provide a test-bed for our calibration scheme. I will discuss the CHIME calibration requirements and describe instrumentation we are developing to meet these requirements.
△ Less
Submitted 9 June, 2014;
originally announced June 2014.
