-
Exploiting the diversity of modeling methods to probe systematic biases in strong lensing analyses
Authors:
A. Galan,
G. Vernardos,
Q. Minor,
D. Sluse,
L. Van de Vyvere,
M. Gomer
Abstract:
In the past decade, the diversity of strong lens modeling methods has exploded, from being purely analytical to pixelated and non-parametric, or based on deep learning. We embrace this diversity by selecting different software packages and use them to blindly model independently simulated Hubble Space Telescope imaging data. To overcome the difficulties arising from using different codes and conve…
▽ More
In the past decade, the diversity of strong lens modeling methods has exploded, from being purely analytical to pixelated and non-parametric, or based on deep learning. We embrace this diversity by selecting different software packages and use them to blindly model independently simulated Hubble Space Telescope imaging data. To overcome the difficulties arising from using different codes and conventions, we use the COde-independent Organized LEns STandard (COOLEST) to store, compare and release all models in a self-consistent and human-readable manner. From an ensemble of six modeling methods, we study the recovery of the lens potential parameters and properties of the reconstructed source. In particular, we simulate and infer parameters of an elliptical power-law mass distribution with external shear for the lens while each modeling method reconstructs the source differently. We find that overall, both lens and source properties are recovered reasonably well, but systematic biases arise in all methods. Interestingly, we do not observe that a single method is significantly more accurate than others, and the amount of bias largely depends on the specific lens or source property of interest. By combining posterior distributions from individual methods using equal weights, the maximal systematic biases on lens model parameters inferred from individual models are reduced by a factor of 5.4 on average. We investigate a selection of modeling effects that partly explain the observed biases, such as the cuspy nature of the background source and the accuracy of the point spread function. This work introduces, for the first time, a generic framework to compare and ease the combination of models obtained from different codes and methods, which will be key to retain accuracy in future strong lensing analyses.
△ Less
Submitted 12 June, 2024;
originally announced June 2024.
-
On the ellipticity parameterization for an NFW profile: an overlooked angular structure in strong lens modeling
Authors:
Matthew R. Gomer,
Dominique Sluse,
Lyne Van de Vyvere,
Simon Birrer,
Anowar J. Shajib,
Frederic Courbin
Abstract:
Galaxy-scale gravitational lenses are often modeled with two-component mass profiles where one component represents the stellar mass and the second is an NFW profile representing the dark matter. Outside of the spherical case, the NFW profile is costly to implement, and so it is approximated via two different methods; ellipticity can be introduced via the lensing potential (NFWp) or via the mass b…
▽ More
Galaxy-scale gravitational lenses are often modeled with two-component mass profiles where one component represents the stellar mass and the second is an NFW profile representing the dark matter. Outside of the spherical case, the NFW profile is costly to implement, and so it is approximated via two different methods; ellipticity can be introduced via the lensing potential (NFWp) or via the mass by approximating the NFW profile as a sum of analytical profiles (NFWm). While the NFWp method has been the default for lensing applications, it gives a different prescription of the azimuthal structure, which we show introduces ubiquitous gradients in ellipticity and boxiness in the mass distribution rather than having a constant elliptical shape. Because unmodeled azimuthal structure has been shown to be able to bias lens model results, we explore the degree to which this introduced azimuthal structure can affect the model accuracy. We construct input profiles using composite models using both the NFWp and NFWm methods and fit these mocks with a power-law elliptical mass distribution (PEMD) model with external shear. As a measure of the accuracy of the recovered lensing potential, we calculate the value of the Hubble parameter $H_0$ one would determine from the lensing fit. We find that the fits to the NFWp input return $H_0$ values which are systematically biased by about $3\%$ lower than the NFWm counterparts. We explore whether such an effect is attributable to the mass sheet transformation (MST) by using an MST-independent quantity, $ξ_2$. We show that, as expected, the NFWm mocks are degenerate with PEMD through an MST. For the NFWp, an additional bias is found beyond the MST due to azimuthal structures {\it exterior to the Einstein radius}. We recommend modelers use an NFWm prescription in the future, such that azimuthal structure can be introduced explicitly rather than implicitly.
△ Less
Submitted 4 October, 2023;
originally announced October 2023.
-
Accelerating galaxy dynamical modeling using a neural network for joint lensing and kinematics analyses
Authors:
Matthew R. Gomer,
Sebastian Ertl,
Luca Biggio,
Han Wang,
Aymeric Galan,
Lyne Van de Vyvere,
Dominique Sluse,
Georgios Vernardos,
Sherry H. Suyu
Abstract:
Strong gravitational lensing is a powerful tool to provide constraints on galaxy mass distributions and cosmological parameters, such as the Hubble constant, $H_0$. Nevertheless, inference of such parameters from images of lensing systems is not trivial as parameter degeneracies can limit the precision in the measured lens mass and cosmological results. External information on the mass of the lens…
▽ More
Strong gravitational lensing is a powerful tool to provide constraints on galaxy mass distributions and cosmological parameters, such as the Hubble constant, $H_0$. Nevertheless, inference of such parameters from images of lensing systems is not trivial as parameter degeneracies can limit the precision in the measured lens mass and cosmological results. External information on the mass of the lens, in the form of kinematic measurements, is needed to ensure a precise and unbiased inference. Traditionally, such kinematic information has been included in the inference after the image modeling, using spherical Jeans approximations to match the measured velocity dispersion integrated within an aperture. However, as spatially resolved kinematic measurements become available via IFU data, more sophisticated dynamical modeling is necessary. Such kinematic modeling is expensive, and constitutes a computational bottleneck which we aim to overcome with our Stellar Kinematics Neural Network (SKiNN). SKiNN emulates axisymmetric modeling using a neural network, quickly synthesizing from a given mass model a kinematic map which can be compared to the observations to evaluate a likelihood. With a joint lensing plus kinematic framework, this likelihood constrains the mass model at the same time as the imaging data. We show that SKiNN's emulation of a kinematic map is accurate to considerably better precision than can be measured (better than $1\%$ in almost all cases). Using SKiNN speeds up the likelihood evaluation by a factor of $\sim 200$. This speedup makes dynamical modeling economical, and enables lens modelers to make effective use of modern data quality in the JWST era.
△ Less
Submitted 19 July, 2023;
originally announced July 2023.
-
TDCOSMO VIII: A key test of systematics in the hierarchical method of time-delay cosmography
Authors:
Matthew R. Gomer,
Dominique Sluse,
Lyne Van de Vyvere,
Simon Birrer,
Frederic Courbin
Abstract:
The largest source of systematic errors in the time-delay cosmography method likely arises from the lens model mass distribution, where an inaccurate choice of model could in principle bias the value of $H_0$. A Bayesian hierarchical framework has been proposed which combines lens systems with kinematic data, constraining the mass profile shape at a population level. The framework has been previou…
▽ More
The largest source of systematic errors in the time-delay cosmography method likely arises from the lens model mass distribution, where an inaccurate choice of model could in principle bias the value of $H_0$. A Bayesian hierarchical framework has been proposed which combines lens systems with kinematic data, constraining the mass profile shape at a population level. The framework has been previously validated on a small sample of lensing galaxies drawn from hydro-simulations. The goal of this work is to expand the validation to a more general set of lenses consistent with observed systems, as well as confirm the capacity of the method to combine two lens populations: one which has time delay information and one which lacks time delays and has systematically different image radii. For this purpose, we generate samples of analytic lens mass distributions made of baryons+dark matter and fit the subsequent mock images with standard power-law models. Corresponding kinematics data are also emulated. The hierarchical framework applied to an ensemble of time-delay lenses allows us to correct the $H_0$ bias associated with model choice, finding $H_0$ within $1.5σ$ of the fiducial value. We then combine this set with a sample of corresponding lens systems which have no time delays and have a source at lower $z$, resulting in a systematically smaller image radius relative to their effective radius. The hierarchical framework successfully accounts for this effect, recovering a value of $H_0$ which is both more precise ($σ\sim2\%$) and more accurate ($0.7\%$ median offset) than the time-delay set alone. This result confirms that non-time-delay lenses can nonetheless contribute valuable constraining power to the determination of $H_0$ via their kinematic constraints, assuming they come from the same global population as the time-delay set.
△ Less
Submitted 28 September, 2022; v1 submitted 5 September, 2022;
originally announced September 2022.
-
Consequences of the lack of azimuthal freedom in the modeling of lensing galaxies
Authors:
Lyne Van de Vyvere,
Dominique Sluse,
Matthew R. Gomer,
Sampath Mukherjee
Abstract:
Massive elliptical galaxies can display structures that deviate from a pure elliptical shape, such as a twist of the principal axis or variations in the axis ratio with galactocentric distance. Although satisfactory lens modeling is generally achieved without accounting for these azimuthal structures, the question about their impact on inferred lens parameters remains, in particular, on time delay…
▽ More
Massive elliptical galaxies can display structures that deviate from a pure elliptical shape, such as a twist of the principal axis or variations in the axis ratio with galactocentric distance. Although satisfactory lens modeling is generally achieved without accounting for these azimuthal structures, the question about their impact on inferred lens parameters remains, in particular, on time delays as they are used in time-delay cosmography. This paper aims at characterizing these effects and quantifying their impact considering realistic amplitudes of the variations. We achieved this goal by creating mock lensing galaxies with morphologies based on two data sets: observational data of local elliptical galaxies, and hydrodynamical simulations of elliptical galaxies at a typical lens redshift. We then simulated images of the lensing systems with space-based data quality and modeled them in a standard way to assess the impact of a lack of azimuthal freedom in the lens model. We find that twists in lensing galaxies are easily absorbed in homoeidal lens models by a change in orientation of the lens up to 10° with respect to the reference orientation at the Einstein radius, and of the shear by up to 20° with respect to the input shear orientation. The ellipticity gradients, on the other hand, can introduce a substantial amount of shear that may impact the radial mass model and consequently bias $H_0$, up to 10 km/s/Mpc. However, we find that light is a good tracer of azimuthal structures, meaning that direct imaging should be capable of diagnosing their presence. This in turn implies that such a large bias is unlikely to be unaccounted for in standard modeling practices. Furthermore, the overall impact of twists and ellipticity gradients averages out at a population level. For the galaxy populations we considered, the cosmological inference remains unbiased.
△ Less
Submitted 31 May, 2022;
originally announced June 2022.
-
TDCOSMO. VII. Boxyness/discyness in lensing galaxies : Detectability and impact on $H_0$
Authors:
Lyne Van de Vyvere,
Matthew R. Gomer,
Dominique Sluse,
Dandan Xu,
Simon Birrer,
Aymeric Galan,
Georgios Vernardos
Abstract:
In the context of gravitational lensing, the density profile of lensing galaxies is often considered to be perfectly elliptical. Potential angular structures are generally ignored, except to explain flux ratios anomalies. Surprisingly, the impact of azimuthal structures on extended images of the source has not been characterized, nor its impact on the H0 inference. We address this task by creating…
▽ More
In the context of gravitational lensing, the density profile of lensing galaxies is often considered to be perfectly elliptical. Potential angular structures are generally ignored, except to explain flux ratios anomalies. Surprisingly, the impact of azimuthal structures on extended images of the source has not been characterized, nor its impact on the H0 inference. We address this task by creating mock images of a point source embedded in an extended source, lensed by an elliptical galaxy on which multipolar components are added to emulate boxy/discy isodensity contours. Modeling such images with a density profile free of angular structure allow us to explore the detectability of image deformation induced by the multipoles in the residual frame. Multipole deformations are almost always detectable for our highest signal-to-noise mock data. However the detectability depends on the lens ellipticity and Einstein radius, on the S/N of the data, and on the specific lens modeling strategy. Multipoles also introduce small changes to the time delays. We therefore quantify how undetected multipoles would impact H0 inference. When no multipoles are detected in the residuals, the impact on H0 for a given lens is in general less than a few km/s/Mpc, but in the worst case scenario, combining low S/N in the ring and large intrinsic boxyness/discyness, the bias on H0 can reach 10-12 km/s/Mpc. If we now look at the inference on H0 from a population of lensing galaxies, having a distribution of multipoles representative of what is found in the light-profile of elliptical galaxies, we then find a systematic bias on H0 < 1%. The comparison of our mock systems to the state-of-the-art time delay lens sample studied by the H0LiCOW and TDCOSMO collaborations, indicates that multipoles are currently unlikely to be a source of substantial systematic bias on the inferred value of H0 from time-delay lenses.
△ Less
Submitted 3 March, 2022; v1 submitted 7 December, 2021;
originally announced December 2021.
-
lenstronomy II: A gravitational lensing software ecosystem
Authors:
Simon Birrer,
Anowar J. Shajib,
Daniel Gilman,
Aymeric Galan,
Jelle Aalbers,
Martin Millon,
Robert Morgan,
Giulia Pagano,
Ji Won Park,
Luca Teodori,
Nicolas Tessore,
Madison Ueland,
Lyne Van de Vyvere,
Sebastian Wagner-Carena,
Ewoud Wempe,
Lilan Yang,
Xuheng Ding,
Thomas Schmidt,
Dominique Sluse,
Ming Zhang,
Adam Amara
Abstract:
lenstronomy is an Astropy-affiliated Python package for gravitational lensing simulations and analyses. lenstronomy was introduced by Birrer and Amara (2018) and is based on the linear basis set approach by Birrer et a. (2015). The user and developer base of lenstronomy has substantially grown since then, and the software has become an integral part of a wide range of recent analyses, such as meas…
▽ More
lenstronomy is an Astropy-affiliated Python package for gravitational lensing simulations and analyses. lenstronomy was introduced by Birrer and Amara (2018) and is based on the linear basis set approach by Birrer et a. (2015). The user and developer base of lenstronomy has substantially grown since then, and the software has become an integral part of a wide range of recent analyses, such as measuring the Hubble constant with time-delay strong lensing or constraining the nature of dark matter from resolved and unresolved small scale lensing distortion statistics. The modular design has allowed the community to incorporate innovative new methods, as well as to develop enhanced software and wrappers with more specific aims on top of the lenstronomy API. Through community engagement and involvement, lenstronomy has become a foundation of an ecosystem of affiliated packages extending the original scope of the software and proving its robustness and applicability at the forefront of the strong gravitational lensing community in an open source and reproducible manner.
△ Less
Submitted 10 June, 2021;
originally announced June 2021.
-
The impact of mass map truncation on strong lensing simulations
Authors:
Lyne Van de Vyvere,
Dominique Sluse,
Sampath Mukherjee,
Dandan Xu,
Simon Birrer
Abstract:
Strong gravitational lensing is a powerful tool to measure cosmological parameters and to study galaxy evolution mechanisms. However, quantitative strong lensing studies often require mock observations. To capture the full complexity of galaxies, the lensing galaxy is often drawn from high resolution, dark matter only or hydro-dynamical simulations. These have their own limitations, but the way we…
▽ More
Strong gravitational lensing is a powerful tool to measure cosmological parameters and to study galaxy evolution mechanisms. However, quantitative strong lensing studies often require mock observations. To capture the full complexity of galaxies, the lensing galaxy is often drawn from high resolution, dark matter only or hydro-dynamical simulations. These have their own limitations, but the way we use them to emulate mock lensed systems may also introduce significant artefacts. In this work we identify and explore the specific impact of mass truncation on simulations of strong lenses by applying different truncation schemes to a fiducial density profile with conformal isodensity contours. Our main finding is that improper mass truncation can introduce undesired artificial shear. The amplitude of the spurious shear depends on the shape and size of the truncation area as well as on the slope and ellipticity of the lens density profile. Due to this effect, the value of H0 or the shear amplitude inferred by modelling those systems may be biased by several percents. However, we show that the effect becomes negligible provided that the lens projected map extends over at least 50 times the Einstein radius.
△ Less
Submitted 26 October, 2020;
originally announced October 2020.
-
TDCOSMO IV: Hierarchical time-delay cosmography -- joint inference of the Hubble constant and galaxy density profiles
Authors:
S. Birrer,
A. J. Shajib,
A. Galan,
M. Millon,
T. Treu,
A. Agnello,
M. Auger,
G. C. -F. Chen,
L. Christensen,
T. Collett,
F. Courbin,
C. D. Fassnacht,
L. V. E. Koopmans,
P. J. Marshall,
J. -W. Park,
C. E. Rusu,
D. Sluse,
C. Spiniello,
S. H. Suyu,
S. Wagner-Carena,
K. C. Wong,
M. Barnabè,
A. S. Bolton,
O. Czoske,
X. Ding
, et al. (2 additional authors not shown)
Abstract:
The H0LiCOW collaboration inferred via gravitational lensing time delays a Hubble constant $H_0=73.3^{+1.7}_{-1.8}$ km s$^{-1}{\rm Mpc}^{-1}$, describing deflector mass density profiles by either a power-law or stars plus standard dark matter halos. The mass-sheet transform (MST) that leaves the lensing observables unchanged is considered the dominant source of residual uncertainty in $H_0$. We qu…
▽ More
The H0LiCOW collaboration inferred via gravitational lensing time delays a Hubble constant $H_0=73.3^{+1.7}_{-1.8}$ km s$^{-1}{\rm Mpc}^{-1}$, describing deflector mass density profiles by either a power-law or stars plus standard dark matter halos. The mass-sheet transform (MST) that leaves the lensing observables unchanged is considered the dominant source of residual uncertainty in $H_0$. We quantify any potential effect of the MST with flexible mass models that are maximally degenerate with H0. Our calculation is based on a new hierarchical approach in which the MST is only constrained by stellar kinematics. The approach is validated on hydrodynamically simulated lenses. We apply the method to the TDCOSMO sample of 7 lenses (6 from H0LiCOW) and measure $H_0=74.5^{+5.6}_{-6.1}$ km s$^{-1}{\rm Mpc}^{-1}$. In order to further constrain the deflector mass profiles, we then add imaging and spectroscopy for 33 strong gravitational lenses from the SLACS sample. For 9 of the SLAC lenses we use resolved kinematics to constrain the stellar anisotropy. From the joint analysis of the TDCOSMO+SLACS sample, we measure $H_0=67.4^{+4.1}_{-3.2}$ km s$^{-1}{\rm Mpc}^{-1}$, assuming that the TDCOSMO and SLACS galaxies are drawn from the same parent population. The blind H0LiCOW, TDCOSMO-only and TDCOSMO+SLACS analyses are in mutual statistical agreement. The TDCOSMO+SLACS analysis prefers marginally shallower mass profiles than H0LiCOW or TDCOSMO-only. While our new analysis does not statistically invalidate the mass profile assumptions by H0LiCOW, and thus their $H_0$ measurement relying on those, it demonstrates the importance of understanding the mass density profile of elliptical galaxies. The uncertainties on $H_0$ derived in this paper can be reduced by physical or observational priors on the form of the mass profile, or by additional data, chiefly spatially resolved kinematics of lens galaxies.
△ Less
Submitted 19 December, 2020; v1 submitted 6 July, 2020;
originally announced July 2020.
-
Time Delay Lens Modelling Challenge
Authors:
X. Ding,
T. Treu,
S. Birrer,
G. C. -F. Chen,
J. Coles,
P. Denzel,
M. Frigo A. Galan,
P. J. Marshall,
M. Millon,
A. More,
A. J. Shajib,
D. Sluse,
H. Tak,
D. Xu,
M. W. Auger,
V. Bonvin,
H. Chand,
F. Courbin,
G. Despali,
C. D. Fassnacht,
D. Gilman,
S. Hilbert,
S. R. Kumar,
Y. -Y. Lin,
J. W. Park
, et al. (4 additional authors not shown)
Abstract:
In recent years, breakthroughs in methods and data have enabled gravitational time delays to emerge as a very powerful tool to measure the Hubble constant $H_0$. However, published state-of-the-art analyses require of order 1 year of expert investigator time and up to a million hours of computing time per system. Furthermore, as precision improves, it is crucial to identify and mitigate systematic…
▽ More
In recent years, breakthroughs in methods and data have enabled gravitational time delays to emerge as a very powerful tool to measure the Hubble constant $H_0$. However, published state-of-the-art analyses require of order 1 year of expert investigator time and up to a million hours of computing time per system. Furthermore, as precision improves, it is crucial to identify and mitigate systematic uncertainties. With this time delay lens modelling challenge we aim to assess the level of precision and accuracy of the modelling techniques that are currently fast enough to handle of order 50 lenses, via the blind analysis of simulated datasets. The results in Rung 1 and Rung 2 show that methods that use only the point source positions tend to have lower precision ($10 - 20\%$) while remaining accurate. In Rung 2, the methods that exploit the full information of the imaging and kinematic datasets can recover $H_0$ within the target accuracy ($ |A| < 2\%$) and precision ($< 6\%$ per system), even in the presence of poorly known point spread function and complex source morphology. A post-unblinding analysis of Rung 3 showed the numerical precision of the ray-traced cosmological simulations to be insufficient to test lens modelling methodology at the percent level, making the results difficult to interpret. A new challenge with improved simulations is needed to make further progress in the investigation of systematic uncertainties. For completeness, we present the Rung 3 results in an appendix, and use them to discuss various approaches to mitigating against similar subtle data generation effects in future blind challenges.
△ Less
Submitted 17 February, 2021; v1 submitted 15 June, 2020;
originally announced June 2020.
-
TDCOSMO. I. An exploration of systematic uncertainties in the inference of $H_0$ from time-delay cosmography
Authors:
M. Millon,
A. Galan,
F. Courbin,
T. Treu,
S. H. Suyu,
X. Ding,
S. Birrer,
G. C. -F. Chen,
A. J. Shajib,
D. Sluse,
K. C. Wong,
A. Agnello,
M. W. Auger,
E. J. Buckley-Geer,
J. H. H. Chan,
T. Collett,
C. D. Fassnacht,
S. Hilbert,
L. V. E. Koopmans,
V. Motta,
S. Mukherjee,
C. E. Rusu,
A. Sonnenfeld,
C. Spiniello,
L. Van de Vyvere
Abstract:
Time-delay cosmography of lensed quasars has achieved 2.4% precision on the measurement of the Hubble constant, $H_0$. As part of an ongoing effort to uncover and control systematic uncertainties, we investigate three potential sources: 1- stellar kinematics, 2- line-of-sight effects, and 3- the deflector mass model. To meet this goal in a quantitative way, we reproduced the H0LiCOW/SHARP/STRIDES…
▽ More
Time-delay cosmography of lensed quasars has achieved 2.4% precision on the measurement of the Hubble constant, $H_0$. As part of an ongoing effort to uncover and control systematic uncertainties, we investigate three potential sources: 1- stellar kinematics, 2- line-of-sight effects, and 3- the deflector mass model. To meet this goal in a quantitative way, we reproduced the H0LiCOW/SHARP/STRIDES (hereafter TDCOSMO) procedures on a set of real and simulated data, and we find the following. First, stellar kinematics cannot be a dominant source of error or bias since we find that a systematic change of 10% of measured velocity dispersion leads to only a 0.7% shift on $H_0$ from the seven lenses analyzed by TDCOSMO. Second, we find no bias to arise from incorrect estimation of the line-of-sight effects. Third, we show that elliptical composite (stars + dark matter halo), power-law, and cored power-law mass profiles have the flexibility to yield a broad range in $H_0$ values. However, the TDCOSMO procedures that model the data with both composite and power-law mass profiles are informative. If the models agree, as we observe in real systems owing to the "bulge-halo" conspiracy, $H_0$ is recovered precisely and accurately by both models. If the two models disagree, as in the case of some pathological models illustrated here, the TDCOSMO procedure either discriminates between them through the goodness of fit, or it accounts for the discrepancy in the final error bars provided by the analysis. This conclusion is consistent with a reanalysis of six of the TDCOSMO (real) lenses: the composite model yields $74.0^{+1.7}_{-1.8}$ $km.s^{-1}.Mpc^{-1}$, while the power-law model yields $H_0=74.2^{+1.6}_{-1.6}$ $km.s^{-1}.Mpc^{-1}$. In conclusion, we find no evidence of bias or errors larger than the current statistical uncertainties reported by TDCOSMO.
△ Less
Submitted 22 July, 2020; v1 submitted 17 December, 2019;
originally announced December 2019.
