-
Phantom-Powered Nested Sampling
Authors:
Joshua G. Albert
Abstract:
We introduce a novel technique within the Nested Sampling framework to enhance efficiency of the computation of Bayesian evidence, a critical component in scientific data analysis. In higher dimensions, Nested Sampling relies on Markov Chain-based likelihood-constrained prior samplers, which generate numerous 'phantom points' during parameter space exploration. These points are too auto-correlated…
▽ More
We introduce a novel technique within the Nested Sampling framework to enhance efficiency of the computation of Bayesian evidence, a critical component in scientific data analysis. In higher dimensions, Nested Sampling relies on Markov Chain-based likelihood-constrained prior samplers, which generate numerous 'phantom points' during parameter space exploration. These points are too auto-correlated to be used in the standard Nested Sampling scheme and so are conventionally discarded, leading to waste. Our approach discovers a way to integrate these phantom points into the evidence calculation, thereby improving the efficiency of Nested Sampling without sacrificing accuracy. This is achieved by ensuring the points within the live set remain asymptotically i.i.d. uniformly distributed, allowing these points to contribute meaningfully to the final evidence estimation. We apply our method on several models, demonstrating substantial enhancements in sampling efficiency, that scales well in high-dimension. Our findings suggest that this approach can reduce the number of required likelihood evaluations by at least a factor of 5. This advancement holds considerable promise for improving the robustness and speed of statistical analyses over a wide range of fields, from astrophysics and cosmology to climate modelling.
△ Less
Submitted 18 December, 2023;
originally announced December 2023.
-
The LOFAR Two-metre Sky Survey -- V. Second data release
Authors:
T. W. Shimwell,
M. J. Hardcastle,
C. Tasse,
P. N. Best,
H. J. A. Röttgering,
W. L. Williams,
A. Botteon,
A. Drabent,
A. Mechev,
A. Shulevski,
R. J. van Weeren,
L. Bester,
M. Brüggen,
G. Brunetti,
J. R. Callingham,
K. T. Chyży,
J. E. Conway,
T. J. Dijkema,
K. Duncan,
F. de Gasperin,
C. L. Hale,
M. Haverkorn,
B. Hugo,
N. Jackson,
M. Mevius
, et al. (81 additional authors not shown)
Abstract:
In this data release from the LOFAR Two-metre Sky Survey (LoTSS) we present 120-168MHz images covering 27% of the northern sky. Our coverage is split into two regions centred at approximately 12h45m +44$^\circ$30' and 1h00m +28$^\circ$00' and spanning 4178 and 1457 square degrees respectively. The images were derived from 3,451hrs (7.6PB) of LOFAR High Band Antenna data which were corrected for th…
▽ More
In this data release from the LOFAR Two-metre Sky Survey (LoTSS) we present 120-168MHz images covering 27% of the northern sky. Our coverage is split into two regions centred at approximately 12h45m +44$^\circ$30' and 1h00m +28$^\circ$00' and spanning 4178 and 1457 square degrees respectively. The images were derived from 3,451hrs (7.6PB) of LOFAR High Band Antenna data which were corrected for the direction-independent instrumental properties as well as direction-dependent ionospheric distortions during extensive, but fully automated, data processing. A catalogue of 4,396,228 radio sources is derived from our total intensity (Stokes I) maps, where the majority of these have never been detected at radio wavelengths before. At 6" resolution, our full bandwidth Stokes I continuum maps with a central frequency of 144MHz have: a median rms sensitivity of 83$μ$Jy/beam; a flux density scale accuracy of approximately 10%; an astrometric accuracy of 0.2"; and we estimate the point-source completeness to be 90% at a peak brightness of 0.8mJy/beam. By creating three 16MHz bandwidth images across the band we are able to measure the in-band spectral index of many sources, albeit with an error on the derived spectral index of +/-0.2 which is a consequence of our flux-density scale accuracy and small fractional bandwidth. Our circular polarisation (Stokes V) 20" resolution 120-168MHz continuum images have a median rms sensitivity of 95$μ$Jy/beam, and we estimate a Stokes I to Stokes V leakage of 0.056%. Our linear polarisation (Stokes Q and Stokes U) image cubes consist of 480 x 97.6 kHz wide planes and have a median rms sensitivity per plane of 10.8mJy/beam at 4' and 2.2mJy/beam at 20"; we estimate the Stokes I to Stokes Q/U leakage to be approximately 0.2%. Here we characterise and publicly release our Stokes I, Q, U and V images in addition to the calibrated uv-data.
△ Less
Submitted 23 February, 2022;
originally announced February 2022.
-
JAXNS: a high-performance nested sampling package based on JAX
Authors:
Joshua G. Albert
Abstract:
Since its debut by John Skilling in 2004, nested sampling has proven a valuable tool to the scientist, providing hypothesis evidence calculations and parameter inference for complicated posterior distributions, particularly in the field of astronomy. Due to its computational complexity and long-running nature, in the past, nested sampling has been reserved for offline-type Bayesian inference, leav…
▽ More
Since its debut by John Skilling in 2004, nested sampling has proven a valuable tool to the scientist, providing hypothesis evidence calculations and parameter inference for complicated posterior distributions, particularly in the field of astronomy. Due to its computational complexity and long-running nature, in the past, nested sampling has been reserved for offline-type Bayesian inference, leaving tools such as variational inference and MCMC for online-type, time-constrained, Bayesian computations. These tools do not easily handle complicated multi-modal posteriors, discrete random variables, and posteriors lacking gradients, nor do they enable practical calculations of the Bayesian evidence. An opening thus remains for a high-performance out-of-the-box nested sampling package that can close the gap in computational time, and let nested sampling become common place in the data science toolbox. We present JAX-based nested sampling (JAXNS), a high-performance nested sampling package written in XLA-primitives using JAX, and show that it is several orders of magnitude faster than the currently available nested sampling implementations of PolyChord, MultiNEST, and dynesty, while maintaining the same accuracy of evidence calculation. The JAXNS package is publically available at \url{https://github.com/joshuaalbert/jaxns}.
△ Less
Submitted 30 December, 2020;
originally announced December 2020.
-
Probabilistic direction-dependent ionospheric calibration for LOFAR-HBA
Authors:
J. G. Albert,
R. J. van Weeren,
H. T. Intema,
H. J. A. Röttgering
Abstract:
Direction dependent calibration and imaging is a vital part of producing deep, high fidelity, high-dynamic range radio images with a wide-field low-frequency array like LOFAR. Currently, state-of-the-art facet-based direction dependent calibration algorithms rely on the assumption that the isoplanatic-patch size is much larger than the separation between bright in-field calibrators. This assumptio…
▽ More
Direction dependent calibration and imaging is a vital part of producing deep, high fidelity, high-dynamic range radio images with a wide-field low-frequency array like LOFAR. Currently, state-of-the-art facet-based direction dependent calibration algorithms rely on the assumption that the isoplanatic-patch size is much larger than the separation between bright in-field calibrators. This assumption is often violated due to the dynamic nature of the ionosphere, and as a result direction dependent errors affect image quality between calibrators. In this paper we propose a probabilistic physics-informed model for inferring ionospheric phase screens, providing a calibration for all sources in the field of view. We apply our method to a randomly selected observation from the LOFAR Two-Metre Sky Survey archive, and show that almost all direction dependent effects between bright calibrators are corrected and that the root-mean-squared residuals around bright sources is reduced by 32\% on average.
△ Less
Submitted 31 January, 2020;
originally announced February 2020.
-
A probabilistic approach to direction-dependent ionospheric calibration
Authors:
J. G. Albert,
M. S. S. L. Oei,
R. J. van Weeren,
H. T. Intema,
H. J. A. Röttgering
Abstract:
Calibrating for direction-dependent ionospheric distortions in visibility data is one of the main technical challenges that must be overcome to advance low-frequency radio astronomy. In this paper, we propose a novel probabilistic, tomographic approach that utilises Gaussian processes to calibrate direction-dependent ionospheric phase distortions in low-frequency interferometric data. We suggest t…
▽ More
Calibrating for direction-dependent ionospheric distortions in visibility data is one of the main technical challenges that must be overcome to advance low-frequency radio astronomy. In this paper, we propose a novel probabilistic, tomographic approach that utilises Gaussian processes to calibrate direction-dependent ionospheric phase distortions in low-frequency interferometric data. We suggest that the ionospheric free electron density can be modelled to good approximation by a Gaussian process restricted to a thick single layer, and show that under this assumption the differential total electron content must also be a Gaussian process. We perform a comparison with a number of other widely successful Gaussian processes on simulated differential total electron contents over a wide range of experimental conditions, and find that, in all experimental conditions, our model is better able to represent observed data and generalise to unseen data. The mean equivalent source shift imposed by our predictive errors are half as large as the best competitor model's. We find that it is possible to partially constrain the ionosphere's hyperparameters from sparse-and-noisy observed data. Our model provides an alternative explanation for observed phase structure functions deviating from Kolmogorov's 5/3 turbulence, turnover at high baselines, and diffractive scale anisotropy. We show that our model implicitly cheaply performs tomography of the free electron density. Moreover, we find that even a fast, low-resolution approximation to our model yields better results than the best alternative Gaussian process, implying that the geometric coupling between directions and antennae is a powerful prior that should not be ignored.
△ Less
Submitted 24 October, 2019; v1 submitted 10 October, 2019;
originally announced October 2019.
-
Predicting the hypervelocity star population in Gaia
Authors:
T. Marchetti,
O. Contigiani,
E. M. Rossi,
J. G. Albert,
A. G. A. Brown,
A. Sesana
Abstract:
Hypervelocity stars (HVSs) are amongst the fastest objects in our Milky Way. These stars are predicted to come from the Galactic center (GC) and travel along unbound orbits across the Galaxy. In the coming years, the ESA satellite Gaia will provide the most complete and accurate catalogue of the Milky Way, with full astrometric parameters for more than $1$ billion stars. In this paper, we present…
▽ More
Hypervelocity stars (HVSs) are amongst the fastest objects in our Milky Way. These stars are predicted to come from the Galactic center (GC) and travel along unbound orbits across the Galaxy. In the coming years, the ESA satellite Gaia will provide the most complete and accurate catalogue of the Milky Way, with full astrometric parameters for more than $1$ billion stars. In this paper, we present the expected sample size and properties (mass, magnitude, spatial, velocity distributions) of HVSs in the Gaia stellar catalogue. We build three Gaia mock catalogues of HVSs anchored to current observations, exploring different ejection mechanisms and GC stellar population properties. In all cases, we predict hundreds to thousands of HVSs with precise proper motion measurements within a few tens of kpc from us. For stars with a relative error in total proper motion below $10 \%$, the mass range extends to ~$10 M_{\odot}$ but peaks at ~$1$ $M_\odot$. The majority of Gaia HVSs will therefore probe a different mass and distance range compared to the current non-Gaia sample. In addition, a subset of a few hundreds to a few thousands of HVSs with $M$ ~ $3$ $M_\odot$ will be bright enough to have a precise measurement of the three-dimensional velocity from Gaia alone. Finally, we show that Gaia will provide more precise proper motion measurements for the current sample of HVS candidates. This will help identifying their birthplace narrowing down their ejection location, and confirming or rejecting their nature as HVSs. Overall, our forecasts are extremely encouraging in terms of quantity and quality of HVS data that can be exploited to constrain both the Milky Way potential and the GC properties.
△ Less
Submitted 1 March, 2018; v1 submitted 30 November, 2017;
originally announced November 2017.
-
Complex diffuse emission in the $z=0.52$ cluster PLCK~G004.5-19.5
Authors:
J. G. Albert,
C. Sifón,
A. Stroe,
F. Mernier,
H. T. Intema,
H. J. A. Röttgering,
G. Brunetti
Abstract:
We present radio observations of the galaxy cluster PLCK G004.5-19.5 ($z=0.52$) using the Giant Metrewave Radio Telescope at 150~MHz, 325~MHz, and 610~MHz. We find an unusual arrangement of diffuse radio emission in the center and periphery of the cluster, as well as several radio galaxies with head-tail emission. A patch of peripheral emission resembles a radio relic, and central emission resembl…
▽ More
We present radio observations of the galaxy cluster PLCK G004.5-19.5 ($z=0.52$) using the Giant Metrewave Radio Telescope at 150~MHz, 325~MHz, and 610~MHz. We find an unusual arrangement of diffuse radio emission in the center and periphery of the cluster, as well as several radio galaxies with head-tail emission. A patch of peripheral emission resembles a radio relic, and central emission resembles a radio halo. Reanalysis of archival XMM-Newton X-ray data shows that PLCK G004.5-19.5 is disturbed, which has a known correlation with the existence of radio relics and halos. Given that the number of known radio halos and radio relics at $z>0.5$ is very limited, PLCK G004.5-19.5 is an important addition to understanding merger-related particle acceleration at higher redshifts.
△ Less
Submitted 8 August, 2017; v1 submitted 2 August, 2017;
originally announced August 2017.
-
A simulation calibrated limit on the HI power spectrum from the GMRT Epoch of Reionization experiment
Authors:
Gregory Paciga,
Joshua G. Albert,
Kevin Bandura,
Tzu-Ching Chang,
Yashwant Gupta,
Christopher Hirata,
Julia Odegova,
Ue-Li Pen,
Jeffrey B. Peterson,
Jayanta Roy,
Richard Shaw,
Kris Sigurdson,
Tabitha Voytek
Abstract:
The GMRT Epoch of Reionization (EoR) experiment is an ongoing effort to measure the power spectrum from neutral hydrogen at high redshift. We have previously reported an upper limit of (70 mK)^2 at wavenumbers of k=0.65 h/Mpc using a basic piecewise-linear foreground subtraction. In this paper we explore the use of a singular value decomposition to remove foregrounds with fewer assumptions about t…
▽ More
The GMRT Epoch of Reionization (EoR) experiment is an ongoing effort to measure the power spectrum from neutral hydrogen at high redshift. We have previously reported an upper limit of (70 mK)^2 at wavenumbers of k=0.65 h/Mpc using a basic piecewise-linear foreground subtraction. In this paper we explore the use of a singular value decomposition to remove foregrounds with fewer assumptions about the foreground structure. Using this method we also quantify, for the first time, the signal loss due to the foreground filter and present new power spectra adjusted for this loss, providing a revised measurement of a 2-sigma upper limit at (248 mK)^2 for k=0.50 h/Mpc. While this revised limit is larger than previously reported, we believe it to be more robust and still represents the best current constraints on reionization at z=8.6.
△ Less
Submitted 13 May, 2013; v1 submitted 24 January, 2013;
originally announced January 2013.
