-
Lossy Compression of Large-Scale Radio Interferometric Data
Authors:
M Atemkeng,
S Perkins,
E Seck,
S Makhathini,
O Smirnov,
L Bester,
B Hugo
Abstract:
This work proposes to reduce visibility data volume using a baseline-dependent lossy compression technique that preserves smearing at the edges of the field-of-view. We exploit the relation of the rank of a matrix and the fact that a low-rank approximation can describe the raw visibility data as a sum of basic components where each basic component corresponds to a specific Fourier component of the…
▽ More
This work proposes to reduce visibility data volume using a baseline-dependent lossy compression technique that preserves smearing at the edges of the field-of-view. We exploit the relation of the rank of a matrix and the fact that a low-rank approximation can describe the raw visibility data as a sum of basic components where each basic component corresponds to a specific Fourier component of the sky distribution. As such, the entire visibility data is represented as a collection of data matrices from baselines, instead of a single tensor. The proposed methods are formulated as follows: provided a large dataset of the entire visibility data; the first algorithm, named $simple~SVD$ projects the data into a regular sampling space of rank$-r$ data matrices. In this space, the data for all the baselines has the same rank, which makes the compression factor equal across all baselines. The second algorithm, named $BDSVD$ projects the data into an irregular sampling space of rank$-r_{pq}$ data matrices. The subscript $pq$ indicates that the rank of the data matrix varies across baselines $pq$, which makes the compression factor baseline-dependent. MeerKAT and the European Very Long Baseline Interferometry Network are used as reference telescopes to evaluate and compare the performance of the proposed methods against traditional methods, such as traditional averaging and baseline-dependent averaging (BDA). For the same spatial resolution threshold, both $simple~SVD$ and $BDSVD$ show effective compression by two-orders of magnitude higher than traditional averaging and BDA. At the same space-saving rate, there is no decrease in spatial resolution and there is a reduction in the noise variance in the data which improves the S/N to over $1.5$ dB at the edges of the field-of-view.
△ Less
Submitted 14 April, 2023;
originally announced April 2023.
-
The extended HI halo of NGC 4945 as seen by MeerKAT
Authors:
Roger Ianjamasimanana,
B. S. Koribalski,
Gyula I. G. Józsa,
Peter Kamphuis,
W. J. G. de Blok,
Dane Kleiner,
Brenda Namumba,
Claude Carignan,
Ralf-Jürgen Dettmar,
Paolo Serra,
Oleg M. Smirnov,
Kshitij Thorat,
Benjamin V. Hugo,
Athanaseus J. T. Ramaila,
Eric Maina,
Filippo M. Maccagni,
Sphesihle Makhathini,
Lexy A. L. Andati,
Dániel Cs. Molnár,
Simon Perkins,
Francesca Loi,
Mpati Ramatsoku,
Marcellin Atemkeng
Abstract:
Observations of the neutral atomic hydrogen (HI) in the nuclear starburst galaxy NGC 4945 with MeerKAT are presented. We find a large amount of halo gas, previously missed by HI observations, accounting for 6.8% of the total HI mass. This is most likely gas blown into the halo by star formation. Our maps go down to a $3σ$ column density level of $5\times10^{18} cm^{-2}$ . We model the HI distribut…
▽ More
Observations of the neutral atomic hydrogen (HI) in the nuclear starburst galaxy NGC 4945 with MeerKAT are presented. We find a large amount of halo gas, previously missed by HI observations, accounting for 6.8% of the total HI mass. This is most likely gas blown into the halo by star formation. Our maps go down to a $3σ$ column density level of $5\times10^{18} cm^{-2}$ . We model the HI distribution using tilted-ring fitting techniques and find a warp on the galaxy's approaching and receding sides. The HI in the northern side of the galaxy appears to be suppressed. This may be the result of ionisation by the starburst activity in the galaxy, as suggested by a previous study. The origin of the warp is unclear but could be due to past interactions or ram pressure stripping. Broad, asymmetric HI absorption lines extending beyond the HI emission velocity channels are present towards the nuclear region of NGC 4945. Such broad lines suggest the existence of a nuclear ring moving at a high circular velocity. This is supported by the clear rotation patterns in the HI absorption velocity field. The asymmetry of the absorption spectra can be caused by outflows or inflows of gas in the nuclear region of NGC 4945. The continuum map shows small extensions on both sides of the galaxy's major axis that might be signs of outflows resulting from the starburst activity.
△ Less
Submitted 1 April, 2022;
originally announced April 2022.
-
Xova: Baseline-Dependent Time and Channel Averaging for Radio Interferometry
Authors:
Marcellin Atemkeng,
Simon Perkins,
Jonathan Kenyon,
Benjamin Hugo,
Oleg Smirnov
Abstract:
Xova is a software package that implements baseline-dependent time and channel averaging on Measurement Set data. The uv-samples along a baseline track are aggregated into a bin until a specified decorrelation tolerance is exceeded. The degree of decorrelation in the bin correspondingly determines the amount of channel and timeslot averaging that is suitable for samples in the bin. This necessaril…
▽ More
Xova is a software package that implements baseline-dependent time and channel averaging on Measurement Set data. The uv-samples along a baseline track are aggregated into a bin until a specified decorrelation tolerance is exceeded. The degree of decorrelation in the bin correspondingly determines the amount of channel and timeslot averaging that is suitable for samples in the bin. This necessarily implies that the number of channels and timeslots varies per bin and the output data loses the rectilinear input shape of the input data.
△ Less
Submitted 27 January, 2021;
originally announced January 2021.
-
Fast algorithms to approximate the position-dependent point spread function responses in radio interferometric wide-field imaging
Authors:
M. Atemkeng,
O. Smirnov,
C. Tasse,
G. Foster,
S. Makhathini
Abstract:
The desire for wide-field of view, large fractional bandwidth, high sensitivity, high spectral and temporal resolution has driven radio interferometry to the point of big data revolution where the data is represented in at least three dimensions with an axis for spectral windows, baselines, sources, etc; where each axis has its own set of sub-dimensions. The cost associated with storing and handli…
▽ More
The desire for wide-field of view, large fractional bandwidth, high sensitivity, high spectral and temporal resolution has driven radio interferometry to the point of big data revolution where the data is represented in at least three dimensions with an axis for spectral windows, baselines, sources, etc; where each axis has its own set of sub-dimensions. The cost associated with storing and handling these data is very large, and therefore several techniques to compress interferometric data and/or speed up processing have been investigated. Unfortunately, averaging-based methods for visibility data compression are detrimental to the data fidelity, since the point spread function (PSF) is position-dependent, i.e. distorted and attenuated as a function of distance from the phase centre. The position dependence of the PSF becomes more severe, requiring more PSF computations for wide-field imaging. Deconvolution algorithms must take the distortion into account in the major and minor cycles to properly subtract the PSF and recover the fidelity of the image. This approach is expensive in computation since at each deconvolution iteration a distorted PSF must be computed. We present two algorithms that approximate these position-dependent PSFs with fewer computations. The first algorithm approximates the position-dependent PSFs in the $uv$-plane and the second algorithm approximates the position-dependent PSFs in the image-plane. The proposed algorithms are validated using simulated data from the MeerKAT telescope.
△ Less
Submitted 15 September, 2020;
originally announced September 2020.
-
Hydrodynamical Backflow in X-shaped Radio Galaxy PKS 2014-55
Authors:
W. D. Cotton,
K. Thorat,
J. J. Condon,
B . S. Frank,
G . I. G. Józsa,
S. V. White,
R . Deane,
N. Oozeer,
M. Atemkeng,
L. Bester,
B. Fanaroff,
R. S. Kupa,
O. M. Smirnov,
T. Mauch,
V. Krishnan,
F. Camilo
Abstract:
We present MeerKAT 1.28 GHz total-intensity, polarization, and spectral-index images covering the giant (projected length $l \approx 1.57$~Mpc) X-shaped radio source PKS~2014$-$55 with an unprecedented combination of brightness sensitivity and angular resolution. They show the clear "double boomerang" morphology of hydrodynamical backflows from the straight main jets deflected by the large and obl…
▽ More
We present MeerKAT 1.28 GHz total-intensity, polarization, and spectral-index images covering the giant (projected length $l \approx 1.57$~Mpc) X-shaped radio source PKS~2014$-$55 with an unprecedented combination of brightness sensitivity and angular resolution. They show the clear "double boomerang" morphology of hydrodynamical backflows from the straight main jets deflected by the large and oblique hot-gas halo of the host galaxy PGC~064440. The magnetic field orientation in PKS~2014$-$55 follows the flow lines from the jets through the secondary wings. The radio source is embedded in faint ($T_\mathrm{b} \approx 0.5 \mathrm{\,K}$) cocoons having the uniform brightness temperature and sharp outer edges characteristic of subsonic expansion into the ambient intra-group medium. The position angle of the much smaller ($l \sim 25$~kpc) restarted central source is within $5^\circ$ of the main jets, ruling out models that invoke jet re-orientation or two independent jets. Compression and turbulence in the backflows probably produce the irregular and low polarization bright region behind the apex of each boomerang as well as several features in the flow with bright heads and dark tails.
△ Less
Submitted 6 May, 2020;
originally announced May 2020.
-
Filling the uv-gaps of the current VLBI network in Africa
Authors:
Marcellin Atemkeng,
Patrice M. Okouma,
Eric Maina,
Roger Ianjamasimanana,
Serges Zambou
Abstract:
In the African continent, South Africa has world-class astronomical facilities for advanced radio astronomy research. With the advent of the Square Kilometre Array project in South Africa (SA SKA), six countries in Africa (SA SKA partner countries) have joined South Africa to contribute towards the African Very Long Baseline Interferometry (VLBI) Networks (AVN). Each of the AVN countries will soon…
▽ More
In the African continent, South Africa has world-class astronomical facilities for advanced radio astronomy research. With the advent of the Square Kilometre Array project in South Africa (SA SKA), six countries in Africa (SA SKA partner countries) have joined South Africa to contribute towards the African Very Long Baseline Interferometry (VLBI) Networks (AVN). Each of the AVN countries will soon have a single-dish radio telescope that will be part of the AVN, the European VLBI Network, and the global VLBI network. The SKA and the AVN will enable very high sensitivity VLBI in the southern hemisphere. In the current AVN network, there is a gap in coverage in the central African region. This work analyses the scientific impact if new antennas were to be built or old telecommunication facilities were to be converted to radio telescopes in each of the six countries in central Africa i.e. Cameroon, Gabon, Congo, Equatorial Guinea, Chad, Central African Republic. The work also discusses some economical and skills transfer impacts of having a radio interferometer in this area of Africa.
△ Less
Submitted 19 March, 2020;
originally announced March 2020.
-
The LOFAR Two-metre Sky Survey - II. First data release
Authors:
T. W. Shimwell,
C. Tasse,
M. J. Hardcastle,
A. P. Mechev,
W. L. Williams,
P. N. Best,
H. J. A. Röttgering,
J. R. Callingham,
T. J. Dijkema,
F. de Gasperin,
D. N. Hoang,
B. Hugo,
M. Mirmont,
J. B. R. Oonk,
I. Prandoni,
D. Rafferty,
J. Sabater,
O. Smirnov,
R. J. van Weeren,
G. J. White,
M. Atemkeng,
L. Bester,
E. Bonnassieux,
M. Brüggen,
G. Brunetti
, et al. (82 additional authors not shown)
Abstract:
The LOFAR Two-metre Sky Survey (LoTSS) is an ongoing sensitive, high-resolution 120-168MHz survey of the entire northern sky for which observations are now 20% complete. We present our first full-quality public data release. For this data release 424 square degrees, or 2% of the eventual coverage, in the region of the HETDEX Spring Field (right ascension 10h45m00s to 15h30m00s and declination 45…
▽ More
The LOFAR Two-metre Sky Survey (LoTSS) is an ongoing sensitive, high-resolution 120-168MHz survey of the entire northern sky for which observations are now 20% complete. We present our first full-quality public data release. For this data release 424 square degrees, or 2% of the eventual coverage, in the region of the HETDEX Spring Field (right ascension 10h45m00s to 15h30m00s and declination 45$^\circ$00$'$00$''$ to 57$^\circ$00$'$00$''$) were mapped using a fully automated direction-dependent calibration and imaging pipeline that we developed. A total of 325,694 sources are detected with a signal of at least five times the noise, and the source density is a factor of $\sim 10$ higher than the most sensitive existing very wide-area radio-continuum surveys. The median sensitivity is S$_{\rm 144 MHz} = 71\,μ$Jy beam$^{-1}$ and the point-source completeness is 90% at an integrated flux density of 0.45mJy. The resolution of the images is 6$''$ and the positional accuracy is within 0.2$''$. This data release consists of a catalogue containing location, flux, and shape estimates together with 58 mosaic images that cover the catalogued area. In this paper we provide an overview of the data release with a focus on the processing of the LOFAR data and the characteristics of the resulting images. In two accompanying papers we provide the radio source associations and deblending and, where possible, the optical identifications of the radio sources together with the photometric redshifts and properties of the host galaxies. These data release papers are published together with a further $\sim$20 articles that highlight the scientific potential of LoTSS.
△ Less
Submitted 19 November, 2018;
originally announced November 2018.
-
Baseline-dependent sampling and windowing for radio interferometry: data compression, field-of-interest shaping and outer field suppression
Authors:
M. Atemkeng,
O. Smirnov,
C. Tasse,
G. Foster,
A. Keimpema,
Z. Paragi,
J. Jonas
Abstract:
Traditional radio interferometric correlators produce regular-gridded samples of the true $uv$-distribution by averaging the signal over constant, discrete time-frequency intervals. This regular sampling and averaging then translate to be irregular-gridded samples in the $uv$-space, and results in a baseline-length-dependent loss of amplitude and phase coherence, which is dependent on the distance…
▽ More
Traditional radio interferometric correlators produce regular-gridded samples of the true $uv$-distribution by averaging the signal over constant, discrete time-frequency intervals. This regular sampling and averaging then translate to be irregular-gridded samples in the $uv$-space, and results in a baseline-length-dependent loss of amplitude and phase coherence, which is dependent on the distance from the image phase centre. The effect is often referred to as "decorrelation" in the $uv$-space, which is equivalent in the source domain to "smearing". This work discusses and implements a regular-gridded sampling scheme in the $uv$-space (baseline-dependent sampling) and windowing that allow for data compression, field-of-interest shaping and source suppression. The baseline-dependent sampling requires irregular-gridded sampling in the time-frequency space i.e. the time-frequency interval becomes baseline-dependent. Analytic models and simulations are used to show that decorrelation remains constant across all the baselines when applying baseline-dependent sampling and windowing. Simulations using MeerKAT telescope and the European Very Long Baseline Interferometry Network show that both data compression, field-of-interest shaping and outer field-of-interest suppression are achieved.
△ Less
Submitted 7 March, 2018;
originally announced March 2018.
-
Faceting for direction-dependent spectral deconvolution
Authors:
C. Tasse,
B. Hugo,
M. Mirmont,
O. Smirnov,
M. Atemkeng,
L. Bester,
M. J. Hardcastle,
R. Lakhoo,
S. Perkins,
T. Shimwell
Abstract:
The new generation of radio interferometers is characterized by high sensitivity, wide fields of view and large fractional bandwidth. To synthesize the deepest images enabled by the high dynamic range of these instruments requires us to take into account the direction-dependent Jones matrices, while estimating the spectral properties of the sky in the imaging and deconvolution algorithms.
In thi…
▽ More
The new generation of radio interferometers is characterized by high sensitivity, wide fields of view and large fractional bandwidth. To synthesize the deepest images enabled by the high dynamic range of these instruments requires us to take into account the direction-dependent Jones matrices, while estimating the spectral properties of the sky in the imaging and deconvolution algorithms.
In this paper we discuss and implement a wide-band wide-field spectral deconvolution framework (DDFacet) based on image plane faceting, that takes into account generic direction-dependent effects. Specifically, we present a wide-field co-planar faceting scheme, and discuss the various effects that need to be taken into account to solve for the deconvolution problem (image plane normalization, position-dependent PSF, etc). We discuss two wide-band spectral deconvolution algorithms based on hybrid matching pursuit and sub-space optimisation respectively. A few interesting technical features incorporated in our imager are discussed, including baseline dependent averaging, which has the effect of improving computing efficiency. The version of DDFacet presented here can account for any externally defined Jones matrices and/or beam patterns.
△ Less
Submitted 13 December, 2017; v1 submitted 6 December, 2017;
originally announced December 2017.
-
Using baseline-dependent window functions for data compression and field-of-interest shaping in radio interferometry
Authors:
M. T. Atemkeng,
O. M. Smirnov,
C. Tasse,
G. Foster,
J. Jonas
Abstract:
In radio interferometry, observed visibilities are intrinsically sampled at some interval in time and frequency. Modern interferometers are capable of producing data at very high time and frequency resolution; practical limits on storage and computation costs require that some form of data compression be imposed. The traditional form of compression is a simple averaging of the visibilities over co…
▽ More
In radio interferometry, observed visibilities are intrinsically sampled at some interval in time and frequency. Modern interferometers are capable of producing data at very high time and frequency resolution; practical limits on storage and computation costs require that some form of data compression be imposed. The traditional form of compression is a simple averaging of the visibilities over coarser time and frequency bins. This has an undesired side effect: the resulting averaged visibilities "decorrelate", and do so differently depending on the baseline length and averaging interval. This translates into a non-trivial signature in the image domain known as "smearing", which manifests itself as an attenuation in amplitude towards off-centre sources. With the increasing fields of view and/or longer baselines employed in modern and future instruments, the trade-off between data rate and smearing becomes increasingly unfavourable. In this work we investigate alternative approaches to low-loss data compression. We show that averaging of the visibility data can be treated as a form of convolution by a boxcar-like window function, and that by employing alternative baseline-dependent window functions a more optimal interferometer smearing response may be induced. In particular, we show improved amplitude response over a chosen field of interest, and better attenuation of sources outside the field of interest. The main cost of this technique is a reduction in nominal sensitivity; we investigate the smearing vs. sensitivity trade-off, and show that in certain regimes a favourable compromise can be achieved. We show the application of this technique to simulated data from the Karl G. Jansky Very Large Array (VLA) and the European Very-long-baseline interferometry Network (EVN).
△ Less
Submitted 14 July, 2016;
originally announced July 2016.
