Showing 1–22 of 22 results for author: Wadekar, D

A new search pipeline for gravitational waves with higher-order modes using mode-by-mode filtering

Authors: Digvijay Wadekar, Tejaswi Venumadhav, Javier Roulet, Ajit Kumar Mehta, Barak Zackay, Jonathan Mushkin, Matias Zaldarriaga

Abstract: Nearly all template-based gravitational wave (GW) searches only include the quasi-circular quadrupolar modes of the signals in their templates. Including additional degrees of freedom in the GW templates corresponding to higher-order harmonics, orbital precession, or eccentricity is challenging because: ($i$) the size of template banks and the matched-filtering cost increases significantly with th… ▽ More Nearly all template-based gravitational wave (GW) searches only include the quasi-circular quadrupolar modes of the signals in their templates. Including additional degrees of freedom in the GW templates corresponding to higher-order harmonics, orbital precession, or eccentricity is challenging because: ($i$) the size of template banks and the matched-filtering cost increases significantly with the number of degrees of freedom, $(ii)$ if these additional degrees are not included properly, the search can lose sensitivity overall (due to an increase in the rate of background triggers). Here, we focus on including aligned-spin higher harmonics in GW search templates. We use a new mode-by-mode filtering approach, where we separately filter GW strain data with three harmonics [namely $(\ell, |m|)=(2,2)$, $(3,3)$ and $(4,4)$]. This results in an increase in the matched-filtering cost by only a factor of $3$ compared to that of a $(2,2)$-only search. We develop computationally cheap trigger-ranking statistics to optimally combine the different signal-to-noise ratios (SNR) timeseries from different harmonics, which ensure only physically-allowed combinations of the different harmonics are triggered on. We use an empirical template-dependent background model in our ranking statistic to account for non-Gaussian transients. In addition, we develop a tool called band eraser which specifically excises narrow time-varying noisy bands in time-frequency space (without having to excise entire time chunks in the data). New GW candidate events that we detect using our search pipeline and the details of our template banks are discussed in accompanying papers: Wadekar et al. [1] and [2] respectively. Apart from higher harmonics, we expect our methodology to also be useful for cheap and optimal searches including orbital precession and eccentricity in GW waveforms. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Comments: 10+4 pages, 5 figures

Fast marginalization algorithm for optimizing gravitational wave detection, parameter estimation and sky localization

Authors: Javier Roulet, Jonathan Mushkin, Digvijay Wadekar, Tejaswi Venumadhav, Barak Zackay, Matias Zaldarriaga

Abstract: We introduce an algorithm to marginalize the likelihood for a gravitational wave signal from a quasi-circular binary merger over its extrinsic parameters, accounting for the effects of higher harmonics and spin-induced precession. The algorithm takes as input the matched-filtering time series of individual waveform harmonics against the data in all operational detectors, and the covariances of the… ▽ More We introduce an algorithm to marginalize the likelihood for a gravitational wave signal from a quasi-circular binary merger over its extrinsic parameters, accounting for the effects of higher harmonics and spin-induced precession. The algorithm takes as input the matched-filtering time series of individual waveform harmonics against the data in all operational detectors, and the covariances of the harmonics. The outputs are the Gaussian likelihood marginalized over extrinsic parameters describing the merger time, location and orientation, along with samples from the conditional posterior of these parameters. Our algorithm exploits the waveform's known analytical dependence on extrinsic parameters to efficiently marginalize over them using a single waveform evaluation. Our current implementation achieves a 10% precision on the marginalized likelihood within $\approx 50$ ms on a single CPU core and is publicly available through the package `cogwheel`. We discuss applications of this tool for gravitational wave searches involving higher modes or precession, efficient and robust parameter estimation, and generation of sky localization maps in low latency for electromagnetic followup of gravitational-wave alerts. The inclusion of higher modes can improve the distance measurement, providing an advantage over existing low-latency localization methods. △ Less

Submitted 2 April, 2024; originally announced April 2024.

Comments: 18 pages, 7 figures

New black hole mergers in the LIGO-Virgo O3 data from a gravitational wave search including higher-order harmonics

Authors: Digvijay Wadekar, Javier Roulet, Tejaswi Venumadhav, Ajit Kumar Mehta, Barak Zackay, Jonathan Mushkin, Seth Olsen, Matias Zaldarriaga

Abstract: Nearly all of the previous gravitational wave (GW) searches in the LIGO-Virgo data included GW waveforms with only the dominant quadrupole mode, i.e., omitting higher-order harmonics which are predicted by general relativity. Based on the techniques developed in Wadekar et al. [1,2], we improve the IAS pipeline by ($i$) introducing higher harmonics in the GW templates, ($ii$) downweighting noise t… ▽ More Nearly all of the previous gravitational wave (GW) searches in the LIGO-Virgo data included GW waveforms with only the dominant quadrupole mode, i.e., omitting higher-order harmonics which are predicted by general relativity. Based on the techniques developed in Wadekar et al. [1,2], we improve the IAS pipeline by ($i$) introducing higher harmonics in the GW templates, ($ii$) downweighting noise transients ('glitches') to improve the search sensitivity to high-mass and high-redshift binary black hole (BBH) mergers. We find 14 new BBH mergers with $0.53\leq p_{\rm astro}\leq 0.88$ on running our pipeline over the public LIGO-Virgo data from the O3 run (we use the detection threshold as $p_{\rm astro}>0.5$ following the approach of other pipelines). We also broadly recover the high-significance events from earlier catalogs, except some which were either vetoed or fell below our SNR threshold for trigger collection. A few notable properties of our new candidate events are as follows. At $>95$\% credibility, 4 candidates have total masses in the IMBH range (i.e., above 100 $M_\odot$), and 9 candidates have $z>0.5$. 9 candidates have median mass of the primary BH falling roughly within the pair instability mass gap, with the highest primary mass being $300_{+60}^{-120} M_\odot$. 5 candidates have median mass ratio $q < 0.5$. Under a prior uniform in effective spin $χ_{\rm eff}$, 6 candidates have $χ_{\rm eff} > 0$ at $>95\%$ credibility. We also find that including higher harmonics in our search raises the significance of a few previously reported marginal events (e.g., GW190711_030756). While our new candidate events have modest false alarm rates ($\gtrsim 1.6 $/yr), a population inference study including these can better inform the parameter space of BHs corresponding to the pair instability mass gap, high redshifts, positive effective spins and asymmetric mass ratios. △ Less

Submitted 11 December, 2023; originally announced December 2023.

Comments: 15+7 pages, 6+5 figures. Our event catalog (including sub-threshold events) and the samples from our PE runs are available at https://github.com/JayWadekar/GW_higher_harmonics_search

New binary black hole mergers in the LIGO-Virgo O3b data

Authors: Ajit Kumar Mehta, Seth Olsen, Digvijay Wadekar, Javier Roulet, Tejaswi Venumadhav, Jonathan Mushkin, Barak Zackay, Matias Zaldarriaga

Abstract: We report the detection of 6 new candidate binary black hole (BBH) merger signals in the publicly released data from the second half of the third observing run (O3b) of advanced LIGO and advanced Virgo. The LIGO-Virgo-KAGRA (LVK) collaboration reported 35 compact binary coalescences (CBCs) in their analysis of the O3b data [1], with 30 BBH mergers having coincidence in the Hanford and Livingston d… ▽ More We report the detection of 6 new candidate binary black hole (BBH) merger signals in the publicly released data from the second half of the third observing run (O3b) of advanced LIGO and advanced Virgo. The LIGO-Virgo-KAGRA (LVK) collaboration reported 35 compact binary coalescences (CBCs) in their analysis of the O3b data [1], with 30 BBH mergers having coincidence in the Hanford and Livingston detectors. We confirm 17 of these for a total of 23 detections in our analysis of the Hanford-Livingston coincident O3b data. We identify candidates using a search pipeline employing aligned-spin quadrupole-only waveforms. Our pipeline is similar to the one used in our O3a coincident analysis [2], except for a few improvements in the veto procedure and the ranking statistic, and we continue to use an astrophysical probability of one half as our detection threshold, following the approach of the LVK catalogs. Most of the new candidates reported in this work are placed in the upper and lower-mass gap of the black hole (BH) mass distribution. We also identify a possible neutron star-black hole (NSBH) merger. We expect these events to help inform the black hole mass and spin distributions inferred in a full population analysis. △ Less

Submitted 4 May, 2024; v1 submitted 10 November, 2023; originally announced November 2023.

Comments: 16 pages, 12 figures

A new approach to template banks of gravitational waves with higher harmonics: reducing matched-filtering cost by over an order of magnitude

Authors: Digvijay Wadekar, Tejaswi Venumadhav, Ajit Kumar Mehta, Javier Roulet, Seth Olsen, Jonathan Mushkin, Barak Zackay, Matias Zaldarriaga

Abstract: Searches for gravitational wave events use models, or templates, for the signals of interest. The templates used in current searches in the LIGO-Virgo-Kagra (LVK) data model the dominant quadrupole mode $(\ell,m)=(2,2)$ of the signals, and omit sub-dominant higher-order modes (HM) such as $(\ell,m)=(3,3)$, $(4,4)$, which are predicted by general relativity. Hence, these searches could lose sensiti… ▽ More Searches for gravitational wave events use models, or templates, for the signals of interest. The templates used in current searches in the LIGO-Virgo-Kagra (LVK) data model the dominant quadrupole mode $(\ell,m)=(2,2)$ of the signals, and omit sub-dominant higher-order modes (HM) such as $(\ell,m)=(3,3)$, $(4,4)$, which are predicted by general relativity. Hence, these searches could lose sensitivity to black hole mergers in interesting parts of parameter space, such as systems with high-masses and asymmetric mass ratios. We develop a new strategy to include HM in template banks that exploits the natural connection between the modes. We use a combination of post-Newtonian formulae and machine learning tools to model aligned-spin $(3,3)$, $(4,4)$ waveforms corresponding to a given $(2,2)$ waveform. Each of these modes can be individually filtered against the data to yield separate timeseries of signal-to-noise ratios (SNR), which can be combined in a relatively inexpensive way to marginalize over extrinsic parameters of the signals. This leads to a HM search pipeline whose matched-filtering cost is just $\approx 3\times$ that of a quadrupole-only search (in contrast to being $\approx\! 100 \times$, as in previously proposed HM search methods). Our method is effectual and is generally applicable for template banks constructed with either stochastic or geometric placement techniques. Additionally, we discuss compression of $(2,2)$-only geometric-placement template banks using machine learning algorithms. △ Less

Submitted 23 October, 2023; originally announced October 2023.

Comments: 12+2 pages, 7+1 figures. The template bank described here will be publicly available at https://github.com/JayWadekar/GW_higher_harmonics_search

In Pursuit of Love: First Templated Search for Compact Objects with Large Tidal Deformabilities in the LIGO-Virgo Data

Authors: Horng Sheng Chia, Thomas D. P. Edwards, Digvijay Wadekar, Aaron Zimmerman, Seth Olsen, Javier Roulet, Tejaswi Venumadhav, Barak Zackay, Matias Zaldarriaga

Abstract: We report results on the first matched-filtering search for binaries with compact objects having large tidal deformabilities in the LIGO-Virgo gravitational wave (GW) data. The tidal deformability of a body is quantified by the ``Love number" $Λ\propto \hskip 1pt (r/m)^5$, where $r/m$ is the body's (inverse) compactness. Due to its strong dependence on compactness, the $Λ$ of larger-sized compact… ▽ More We report results on the first matched-filtering search for binaries with compact objects having large tidal deformabilities in the LIGO-Virgo gravitational wave (GW) data. The tidal deformability of a body is quantified by the ``Love number" $Λ\propto \hskip 1pt (r/m)^5$, where $r/m$ is the body's (inverse) compactness. Due to its strong dependence on compactness, the $Λ$ of larger-sized compact objects can easily be many orders of magnitude greater than those of black holes and neutron stars, leaving phase shifts which are sufficiently large for these binaries to be missed by binary black hole (BBH) templated searches. In this paper, we conduct a search using inspiral-only waveforms with zero spins but finite tides, with the search space covering chirp masses $3 M_\odot < \mathcal{M} < 15 M_\odot$ and effective tidal deformabilities $10^2 \lesssim \tildeΛ \lesssim 10^6$. We find no statistically significant GW candidates. This null detection implies an upper limit on the merger rate of such binaries in the range $[1-300] \hskip 2pt \text{Gpc}^{-3} \text{year}^{-1}$, depending on $\mathcal{M}$ and $\tildeΛ$. While our constraints are model agnostic, we discuss the implications on beyond the Standard Model scenarios that give rise to boson stars and superradiant clouds. Using inspiral-only waveforms we recover many of the BBH signals which were previously identified with full inspiral-merger-ringdown templates. We also constrain the Love number of black holes to $Λ\lesssim 10^3$ at the 90\% credible interval. Our work is the first-ever dedicated template-based search for compact objects that are not only black holes and neutron stars. Additionally, our work demonstrates a novel way of finding new physics in GW data, widening the scope of potential discovery to previously unexplored parameter space. △ Less

Submitted 31 May, 2023; originally announced June 2023.

Comments: 42+11 pages, 12 figures

Constraining axion and compact dark matter with interstellar medium heating

Authors: Digvijay Wadekar, Zihui Wang

Abstract: Cold interstellar gas systems have been used to constrain dark matter (DM) models by the condition that the heating rate from DM must be lower than the astrophysical cooling rate of the gas. Following the methodology of Wadekar and Farrar (2021), we use the interstellar medium of a gas-rich dwarf galaxy, Leo T, and a Milky Way-environment gas cloud, G33.4-8.0 to constrain DM. Leo T is a particular… ▽ More Cold interstellar gas systems have been used to constrain dark matter (DM) models by the condition that the heating rate from DM must be lower than the astrophysical cooling rate of the gas. Following the methodology of Wadekar and Farrar (2021), we use the interstellar medium of a gas-rich dwarf galaxy, Leo T, and a Milky Way-environment gas cloud, G33.4-8.0 to constrain DM. Leo T is a particularly strong system as its gas can have the lowest cooling rate among all the objects in the late Universe (owing to the low volume density and metallicity of the gas). Milky Way clouds, in some cases, provide complementary limits as the DM-gas relative velocity in them is much larger than that in Leo T. We derive constraints on the following scenarios in which DM can heat the gas: $(i)$ interaction of axions with hydrogen atoms or free electrons in the gas, $(ii)$ deceleration of relic magnetically charged DM in gas plasma, $(iii)$ dynamical friction from compact DM, $(iv)$ hard sphere scattering of composite DM with gas. Our limits are complementary to DM direct detection searches. Detection of more gas-rich low-mass dwarfs like Leo T from upcoming 21cm and optical surveys can improve our bounds. △ Less

Submitted 6 April, 2023; v1 submitted 14 November, 2022; originally announced November 2022.

Comments: 10+6 pages, 8 figures. Version appearing in PRD. Added more realistic calculation of escape velocity in Leo T

Journal ref: Phys. Rev. D 107, 083011 (2023)

The SZ flux-mass ($Y$-$M$) relation at low halo masses: improvements with symbolic regression and strong constraints on baryonic feedback

Authors: Digvijay Wadekar, Leander Thiele, J. Colin Hill, Shivam Pandey, Francisco Villaescusa-Navarro, David N. Spergel, Miles Cranmer, Daisuke Nagai, Daniel Anglés-Alcázar, Shirley Ho, Lars Hernquist

Abstract: Feedback from active galactic nuclei (AGN) and supernovae can affect measurements of integrated SZ flux of halos ($Y_\mathrm{SZ}$) from CMB surveys, and cause its relation with the halo mass ($Y_\mathrm{SZ}-M$) to deviate from the self-similar power-law prediction of the virial theorem. We perform a comprehensive study of such deviations using CAMELS, a suite of hydrodynamic simulations with exten… ▽ More Feedback from active galactic nuclei (AGN) and supernovae can affect measurements of integrated SZ flux of halos ($Y_\mathrm{SZ}$) from CMB surveys, and cause its relation with the halo mass ($Y_\mathrm{SZ}-M$) to deviate from the self-similar power-law prediction of the virial theorem. We perform a comprehensive study of such deviations using CAMELS, a suite of hydrodynamic simulations with extensive variations in feedback prescriptions. We use a combination of two machine learning tools (random forest and symbolic regression) to search for analogues of the $Y-M$ relation which are more robust to feedback processes for low masses ($M\lesssim 10^{14}\, h^{-1} \, M_\odot$); we find that simply replacing $Y\rightarrow Y(1+M_*/M_\mathrm{gas})$ in the relation makes it remarkably self-similar. This could serve as a robust multiwavelength mass proxy for low-mass clusters and galaxy groups. Our methodology can also be generally useful to improve the domain of validity of other astrophysical scaling relations. We also forecast that measurements of the $Y-M$ relation could provide percent-level constraints on certain combinations of feedback parameters and/or rule out a major part of the parameter space of supernova and AGN feedback models used in current state-of-the-art hydrodynamic simulations. Our results can be useful for using upcoming SZ surveys (e.g., SO, CMB-S4) and galaxy surveys (e.g., DESI and Rubin) to constrain the nature of baryonic feedback. Finally, we find that the an alternative relation, $Y-M_*$, provides complementary information on feedback than $Y-M$ △ Less

Submitted 28 April, 2023; v1 submitted 5 September, 2022; originally announced September 2022.

Comments: Version appearing in MNRAS. Minor change to Fig.6 and added Fig. A5 compared to the previous version. 7+5 pages. The code and data associated with this paper are available at https://github.com/JayWadekar/ScalingRelations_ML

Journal ref: MNRAS, 522, 2628 (2023)

Percent-level constraints on baryonic feedback with spectral distortion measurements

Authors: Leander Thiele, Digvijay Wadekar, J. Colin Hill, Nicholas Battaglia, Jens Chluba, Francisco Villaescusa-Navarro, Lars Hernquist, Mark Vogelsberger, Daniel Anglés-Alcázar, Federico Marinacci

Abstract: High-significance measurements of the monopole thermal Sunyaev-Zel'dovich CMB spectral distortions have the potential to tightly constrain poorly understood baryonic feedback processes. The sky-averaged Compton-y distortion and its relativistic correction are measures of the total thermal energy in electrons in the observable universe and their mean temperature. We use the CAMELS suite of hydrodyn… ▽ More High-significance measurements of the monopole thermal Sunyaev-Zel'dovich CMB spectral distortions have the potential to tightly constrain poorly understood baryonic feedback processes. The sky-averaged Compton-y distortion and its relativistic correction are measures of the total thermal energy in electrons in the observable universe and their mean temperature. We use the CAMELS suite of hydrodynamic simulations to explore possible constraints on parameters describing the subgrid implementation of feedback from active galactic nuclei and supernovae, assuming a PIXIE-like measurement. The small 25 Mpc/h CAMELS boxes present challenges due to the significant cosmic variance. We utilize machine learning to construct interpolators through the noisy simulation data. Using the halo model, we translate the simulation halo mass functions into correction factors to reduce cosmic variance where required. Our results depend on the subgrid model. In the case of IllustrisTNG, we find that the best-determined parameter combination can be measured to ~2% and corresponds to a product of AGN and SN feedback. In the case of SIMBA, the tightest constraint is ~0.2% on a ratio between AGN and SN feedback. A second orthogonal parameter combination can be measured to ~8%. Our results demonstrate the significant constraining power a measurement of the late-time spectral distortion monopoles would have for baryonic feedback models. △ Less

Submitted 27 April, 2022; v1 submitted 5 January, 2022; originally announced January 2022.

Comments: 10+5 pages, 7 figures; matches PRD published version

Augmenting astrophysical scaling relations with machine learning: application to reducing the Sunyaev-Zeldovich flux-mass scatter

Authors: Digvijay Wadekar, Leander Thiele, Francisco Villaescusa-Navarro, J. Colin Hill, Miles Cranmer, David N. Spergel, Nicholas Battaglia, Daniel Anglés-Alcázar, Lars Hernquist, Shirley Ho

Abstract: Complex astrophysical systems often exhibit low-scatter relations between observable properties (e.g., luminosity, velocity dispersion, oscillation period). These scaling relations illuminate the underlying physics, and can provide observational tools for estimating masses and distances. Machine learning can provide a fast and systematic way to search for new scaling relations (or for simple exten… ▽ More Complex astrophysical systems often exhibit low-scatter relations between observable properties (e.g., luminosity, velocity dispersion, oscillation period). These scaling relations illuminate the underlying physics, and can provide observational tools for estimating masses and distances. Machine learning can provide a fast and systematic way to search for new scaling relations (or for simple extensions to existing relations) in abstract high-dimensional parameter spaces. We use a machine learning tool called symbolic regression (SR), which models patterns in a dataset in the form of analytic equations. We focus on the Sunyaev-Zeldovich flux$-$cluster mass relation ($Y_\mathrm{SZ}-M$), the scatter in which affects inference of cosmological parameters from cluster abundance data. Using SR on the data from the IllustrisTNG hydrodynamical simulation, we find a new proxy for cluster mass which combines $Y_\mathrm{SZ}$ and concentration of ionized gas ($c_\mathrm{gas}$): $M \propto Y_\mathrm{conc}^{3/5} \equiv Y_\mathrm{SZ}^{3/5} (1-A\, c_\mathrm{gas})$. $Y_\mathrm{conc}$ reduces the scatter in the predicted $M$ by $\sim 20-30$\% for large clusters ($M\gtrsim 10^{14}\, h^{-1} \, M_\odot$), as compared to using just $Y_\mathrm{SZ}$. We show that the dependence on $c_\mathrm{gas}$ is linked to cores of clusters exhibiting larger scatter than their outskirts. Finally, we test $Y_\mathrm{conc}$ on clusters from CAMELS simulations and show that $Y_\mathrm{conc}$ is robust against variations in cosmology, subgrid physics, and cosmic variance. Our results and methodology can be useful for accurate multiwavelength cluster mass estimation from upcoming CMB and X-ray surveys like ACT, SO, eROSITA and CMB-S4. △ Less

Submitted 17 March, 2023; v1 submitted 4 January, 2022; originally announced January 2022.

Comments: Version appearing in PNAS. Added additional tests but results unchanged compared to previous version. The code and data associated with this paper are available at https://github.com/JayWadekar/ScalingRelations_ML

Journal ref: PNAS March 17, 2023, 120 (12) e2202074120

The CAMELS project: public data release

Authors: Francisco Villaescusa-Navarro, Shy Genel, Daniel Anglés-Alcázar, Lucia A. Perez, Pablo Villanueva-Domingo, Digvijay Wadekar, Helen Shao, Faizan G. Mohammad, Sultan Hassan, Emily Moser, Erwin T. Lau, Luis Fernando Machado Poletti Valle, Andrina Nicola, Leander Thiele, Yongseok Jo, Oliver H. E. Philcox, Benjamin D. Oppenheimer, Megan Tillman, ChangHoon Hahn, Neerav Kaushal, Alice Pisani, Matthew Gebhardt, Ana Maria Delgado, Joyce Caliendo, Christina Kreisch , et al. (22 additional authors not shown)

Abstract: The Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project was developed to combine cosmology with astrophysics through thousands of cosmological hydrodynamic simulations and machine learning. CAMELS contains 4,233 cosmological simulations, 2,049 N-body and 2,184 state-of-the-art hydrodynamic simulations that sample a vast volume in parameter space. In this paper we present… ▽ More The Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project was developed to combine cosmology with astrophysics through thousands of cosmological hydrodynamic simulations and machine learning. CAMELS contains 4,233 cosmological simulations, 2,049 N-body and 2,184 state-of-the-art hydrodynamic simulations that sample a vast volume in parameter space. In this paper we present the CAMELS public data release, describing the characteristics of the CAMELS simulations and a variety of data products generated from them, including halo, subhalo, galaxy, and void catalogues, power spectra, bispectra, Lyman-$α$ spectra, probability distribution functions, halo radial profiles, and X-rays photon lists. We also release over one thousand catalogues that contain billions of galaxies from CAMELS-SAM: a large collection of N-body simulations that have been combined with the Santa Cruz Semi-Analytic Model. We release all the data, comprising more than 350 terabytes and containing 143,922 snapshots, millions of halos, galaxies and summary statistics. We provide further technical details on how to access, download, read, and process the data at \url{https://camels.readthedocs.io}. △ Less

Submitted 4 January, 2022; originally announced January 2022.

Comments: 18 pages, 3 figures. More than 350 Tb of data from thousands of simulations publicly available at https://www.camel-simulations.org

Strong constraints on decay and annihilation of dark matter from heating of gas-rich dwarf galaxies

Authors: Digvijay Wadekar, Zihui Wang

Abstract: Gas-rich dwarf galaxies located outside the virial radius of their host are relatively pristine systems and have ultra-low gas cooling rates. This makes them very sensitive to heat injection by annihilation or decay of dark matter (DM). Such dwarfs are particularly sensitive to DM producing e$^\pm$ with energies 1$-$100 MeV or photons with energies 13.6 eV$-1$ keV, because these products can be ef… ▽ More Gas-rich dwarf galaxies located outside the virial radius of their host are relatively pristine systems and have ultra-low gas cooling rates. This makes them very sensitive to heat injection by annihilation or decay of dark matter (DM). Such dwarfs are particularly sensitive to DM producing e$^\pm$ with energies 1$-$100 MeV or photons with energies 13.6 eV$-1$ keV, because these products can be efficiently thermalized in the neutral hydrogen gas of the dwarfs. Following the methodology of Wadekar and Farrar (2021), we require the rate of heat injection by DM to not exceed the ultra-low radiative cooling rate of gas in the Leo T dwarf galaxy. This gives model-independent bounds on $(i)$ the decay lifetime of DM to $e^\pm$ (photons) which are stronger than all the previous literature for $m_\mathrm{DM}\sim$ 1$-$10 MeV ($m_\mathrm{DM}\sim0.02-1$ keV), $(ii)$ annihilation of DM to $e^{\pm}$ comparable to constraints from CMB and X/$γ$-ray surveys. We also translate our bounds for the case of the following DM models: axion-like particles (ALPs), sterile neutrinos, excited DM states, higgs portal scalars and dark baryons. Observations of gas-rich low-mass dwarfs from upcoming 21cm and optical surveys can therefore be powerful probes of a multitude of models of DM. △ Less

Submitted 11 October, 2022; v1 submitted 15 November, 2021; originally announced November 2021.

Comments: 11+4 pages, 7 figures. Version appearing in PRD. Added more conservative estimates of DM limits and a discussion of senstivity of the limits to DM halo model. The code associated with this paper is available at https://github.com/JayWadekar/Gas_rich_dwarfs

Journal ref: Phys. Rev. D 106, 075007 (2022)

Modeling the galaxy-halo connection with machine learning

Authors: Ana Maria Delgado, Digvijay Wadekar, Boryana Hadzhiyska, Sownak Bose, Lars Hernquist, Shirley Ho

Abstract: To extract information from the clustering of galaxies on non-linear scales, we need to model the connection between galaxies and halos accurately and in a flexible manner. Standard halo occupation distribution (HOD) models make the assumption that the galaxy occupation in a halo is a function of only its mass, however, in reality, the occupation can depend on various other parameters including ha… ▽ More To extract information from the clustering of galaxies on non-linear scales, we need to model the connection between galaxies and halos accurately and in a flexible manner. Standard halo occupation distribution (HOD) models make the assumption that the galaxy occupation in a halo is a function of only its mass, however, in reality, the occupation can depend on various other parameters including halo concentration, assembly history, environment, spin, etc. Using the IllustrisTNG hydrodynamic simulation as our target, we show that machine learning tools can be used to capture this high-dimensional dependence and provide more accurate galaxy occupation models. Specifically, we use a random forest regressor to identify which secondary halo parameters best model the galaxy-halo connection and symbolic regression to augment the standard HOD model with simple equations capturing the dependence on those parameters, namely the local environmental overdensity and shear, at the location of a halo. This not only provides insights into the galaxy-formation relationship but, more importantly, improves the clustering statistics of the modeled galaxies significantly. Our approach demonstrates that machine learning tools can help us better understand and model the galaxy-halo connection, and are therefore useful for galaxy formation and cosmology studies from upcoming galaxy surveys. △ Less

Submitted 21 September, 2022; v1 submitted 3 November, 2021; originally announced November 2021.

The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence

Authors: Francisco Villaescusa-Navarro, Shy Genel, Daniel Angles-Alcazar, Leander Thiele, Romeel Dave, Desika Narayanan, Andrina Nicola, Yin Li, Pablo Villanueva-Domingo, Benjamin Wandelt, David N. Spergel, Rachel S. Somerville, Jose Manuel Zorrilla Matilla, Faizan G. Mohammad, Sultan Hassan, Helen Shao, Digvijay Wadekar, Michael Eickenberg, Kaze W. K. Wong, Gabriella Contardo, Yongseok Jo, Emily Moser, Erwin T. Lau, Luis Fernando Machado Poletti Valle, Lucia A. Perez , et al. (3 additional authors not shown)

Abstract: We present the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) Multifield Dataset, CMD, a collection of hundreds of thousands of 2D maps and 3D grids containing many different properties of cosmic gas, dark matter, and stars from 2,000 distinct simulated universes at several cosmic times. The 2D maps and 3D grids represent cosmic regions that span $\sim$100 million light year… ▽ More We present the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) Multifield Dataset, CMD, a collection of hundreds of thousands of 2D maps and 3D grids containing many different properties of cosmic gas, dark matter, and stars from 2,000 distinct simulated universes at several cosmic times. The 2D maps and 3D grids represent cosmic regions that span $\sim$100 million light years and have been generated from thousands of state-of-the-art hydrodynamic and gravity-only N-body simulations from the CAMELS project. Designed to train machine learning models, CMD is the largest dataset of its kind containing more than 70 Terabytes of data. In this paper we describe CMD in detail and outline a few of its applications. We focus our attention on one such task, parameter inference, formulating the problems we face as a challenge to the community. We release all data and provide further technical details at https://camels-multifield-dataset.readthedocs.io. △ Less

Submitted 22 September, 2021; originally announced September 2021.

Comments: 17 pages, 1 figure. Third paper of a series of four. Hundreds of thousands of labeled 2D maps and 3D grids from thousands of simulated universes publicly available at https://camels-multifield-dataset.readthedocs.io

Modeling assembly bias with machine learning and symbolic regression

Authors: Digvijay Wadekar, Francisco Villaescusa-Navarro, Shirley Ho, Laurence Perreault-Levasseur

Abstract: Upcoming 21cm surveys will map the spatial distribution of cosmic neutral hydrogen (HI) over unprecedented volumes. Mock catalogues are needed to fully exploit the potential of these surveys. Standard techniques employed to create these mock catalogs, like Halo Occupation Distribution (HOD), rely on assumptions such as the baryonic properties of dark matter halos only depend on their masses. In th… ▽ More Upcoming 21cm surveys will map the spatial distribution of cosmic neutral hydrogen (HI) over unprecedented volumes. Mock catalogues are needed to fully exploit the potential of these surveys. Standard techniques employed to create these mock catalogs, like Halo Occupation Distribution (HOD), rely on assumptions such as the baryonic properties of dark matter halos only depend on their masses. In this work, we use the state-of-the-art magneto-hydrodynamic simulation IllustrisTNG to show that the HI content of halos exhibits a strong dependence on their local environment. We then use machine learning techniques to show that this effect can be 1) modeled by these algorithms and 2) parametrized in the form of novel analytic equations. We provide physical explanations for this environmental effect and show that ignoring it leads to underprediction of the real-space 21-cm power spectrum at $k\gtrsim 0.05$ h/Mpc by $\gtrsim$10\%, which is larger than the expected precision from upcoming surveys on such large scales. Our methodology of combining numerical simulations with machine learning techniques is general, and opens a new direction at modeling and parametrizing the complex physics of assembly bias needed to generate accurate mocks for galaxy and line intensity mapping surveys. △ Less

Submitted 30 November, 2020; originally announced December 2020.

Comments: 16 pages, 12 figures. To be submitted to PNAS. Figures 3, 5 and 6 show our main results. Comments are welcome

The CAMELS project: Cosmology and Astrophysics with MachinE Learning Simulations

Authors: Francisco Villaescusa-Navarro, Daniel Anglés-Alcázar, Shy Genel, David N. Spergel, Rachel S. Somerville, Romeel Dave, Annalisa Pillepich, Lars Hernquist, Dylan Nelson, Paul Torrey, Desika Narayanan, Yin Li, Oliver Philcox, Valentina La Torre, Ana Maria Delgado, Shirley Ho, Sultan Hassan, Blakesley Burkhart, Digvijay Wadekar, Nicholas Battaglia, Gabriella Contardo, Greg L. Bryan

Abstract: We present the Cosmology and Astrophysics with MachinE Learning Simulations --CAMELS-- project. CAMELS is a suite of 4,233 cosmological simulations of $(25~h^{-1}{\rm Mpc})^3$ volume each: 2,184 state-of-the-art (magneto-)hydrodynamic simulations run with the AREPO and GIZMO codes, employing the same baryonic subgrid physics as the IllustrisTNG and SIMBA simulations, and 2,049 N-body simulations.… ▽ More We present the Cosmology and Astrophysics with MachinE Learning Simulations --CAMELS-- project. CAMELS is a suite of 4,233 cosmological simulations of $(25~h^{-1}{\rm Mpc})^3$ volume each: 2,184 state-of-the-art (magneto-)hydrodynamic simulations run with the AREPO and GIZMO codes, employing the same baryonic subgrid physics as the IllustrisTNG and SIMBA simulations, and 2,049 N-body simulations. The goal of the CAMELS project is to provide theory predictions for different observables as a function of cosmology and astrophysics, and it is the largest suite of cosmological (magneto-)hydrodynamic simulations designed to train machine learning algorithms. CAMELS contains thousands of different cosmological and astrophysical models by way of varying $Ω_m$, $σ_8$, and four parameters controlling stellar and AGN feedback, following the evolution of more than 100 billion particles and fluid elements over a combined volume of $(400~h^{-1}{\rm Mpc})^3$. We describe the simulations in detail and characterize the large range of conditions represented in terms of the matter power spectrum, cosmic star formation rate density, galaxy stellar mass function, halo baryon fractions, and several galaxy scaling relations. We show that the IllustrisTNG and SIMBA suites produce roughly similar distributions of galaxy properties over the full parameter space but significantly different halo baryon fractions and baryonic effects on the matter power spectrum. This emphasizes the need for marginalizing over baryonic effects to extract the maximum amount of information from cosmological surveys. We illustrate the unique potential of CAMELS using several machine learning applications, including non-linear interpolation, parameter estimation, symbolic regression, data generation with Generative Adversarial Networks (GANs), dimensionality reduction, and anomaly detection. △ Less

Submitted 15 August, 2021; v1 submitted 1 October, 2020; originally announced October 2020.

Comments: 34 pages, 19 figures, Matches published version. CAMELS webpage at https://www.camel-simulations.org

Journal ref: ApJ, 915, 71, (2021)

Cosmological constraints from BOSS with analytic covariance matrices

Authors: Digvijay Wadekar, Mikhail M. Ivanov, Roman Scoccimarro

Abstract: We use analytic covariance matrices to carry out a full-shape analysis of the galaxy power spectrum multipoles from the Baryon Oscillation Spectroscopic Survey (BOSS). We obtain parameter estimates that agree well with those based on the sample covariance from two thousand galaxy mock catalogs, thus validating the analytic approach and providing substantial reduction in computational cost. We also… ▽ More We use analytic covariance matrices to carry out a full-shape analysis of the galaxy power spectrum multipoles from the Baryon Oscillation Spectroscopic Survey (BOSS). We obtain parameter estimates that agree well with those based on the sample covariance from two thousand galaxy mock catalogs, thus validating the analytic approach and providing substantial reduction in computational cost. We also highlight a number of additional advantages of analytic covariances. First, the analysis does not suffer from sampling noise, which biases the constraints and typically requires inflating parameter error bars. Second, it allows us to study convergence of the cosmological constraints when recomputing the analytic covariances to match the best-fit power spectrum, which can be done at a negligible computational cost, unlike when using mock catalogs. These effects reduce the systematic error budget of cosmological constraints, which suggests that the analytic approach may be an important tool for upcoming high-precision galaxy redshift surveys such as DESI and Euclid. Finally, we study the impact of various ingredients in the power spectrum covariance matrix and show that the non-Gaussian part, which includes the regular trispectrum and super-sample covariance, has a marginal effect ($\lesssim 10 \%$) on the cosmological parameter error bars. We also suggest improvements to analytic covariances that are commonly used in Fisher forecasts. △ Less

Submitted 24 December, 2020; v1 submitted 1 September, 2020; originally announced September 2020.

Comments: 24 pages, 12 figures. Version appearing in PRD. Likelihoods available at https://github.com/Michalychforever/lss_montepython . CovaPT code for calculating analytic covariances is available at https://github.com/JayWadekar/CovaPT

Report number: INR-TH-2020-036

Journal ref: Phys. Rev. D 102, 123521 (2020)

HInet: Generating neutral hydrogen from dark matter with neural networks

Authors: Digvijay Wadekar, Francisco Villaescusa-Navarro, Shirley Ho, Laurence Perreault-Levasseur

Abstract: Upcoming 21cm surveys will map the spatial distribution of cosmic neutral hydrogen (HI) over very large cosmological volumes. In order to maximize the scientific return of these surveys, accurate theoretical predictions are needed. Hydrodynamic simulations currently are the most accurate tool to provide those predictions in the mildly to non-linear regime. Unfortunately, their computational cost i… ▽ More Upcoming 21cm surveys will map the spatial distribution of cosmic neutral hydrogen (HI) over very large cosmological volumes. In order to maximize the scientific return of these surveys, accurate theoretical predictions are needed. Hydrodynamic simulations currently are the most accurate tool to provide those predictions in the mildly to non-linear regime. Unfortunately, their computational cost is very high: tens of millions of CPU hours. We use convolutional neural networks to find the mapping between the spatial distribution of matter from N-body simulations and HI from the state-of-the-art hydrodynamic simulation IllustrisTNG. Our model performs better than the widely used theoretical model: Halo Occupation Distribution (HOD) for all statistical properties up to the non-linear scales $k\lesssim1$ h/Mpc. Our method allows the generation of 21cm mocks over very big cosmological volumes with similar properties as hydrodynamic simulations. △ Less

Submitted 27 July, 2021; v1 submitted 20 July, 2020; originally announced July 2020.

Comments: 10+5 pages, 7+3 figures. Added supplementary figures and sections to the Appendix for clarification, conclusions unchanged. Version appearing in ApJ

Journal ref: ApJ 916 42 (2021)

Galaxy Power Spectrum Multipoles Covariance in Perturbation Theory

Authors: Digvijay Wadekar, Roman Scoccimarro

Abstract: We compute the covariance of the galaxy power spectrum multipoles in perturbation theory, including the effects of nonlinear evolution, nonlinear and nonlocal bias, radial redshift-space distortions, arbitrary survey window and shot noise. We rewrite the power spectrum FKP estimator in terms of the usual windowed galaxy fluctuations and the fluctuations in the number of galaxies inside the survey… ▽ More We compute the covariance of the galaxy power spectrum multipoles in perturbation theory, including the effects of nonlinear evolution, nonlinear and nonlocal bias, radial redshift-space distortions, arbitrary survey window and shot noise. We rewrite the power spectrum FKP estimator in terms of the usual windowed galaxy fluctuations and the fluctuations in the number of galaxies inside the survey volume. We show that this leads to a stronger super-sample covariance than assumed in the literature and causes a substantial leakage of Gaussian information. We decompose the covariance matrix into several contributions that provide an insight into its behavior for different biased tracers. We show that for realistic surveys, the covariance of power spectrum multipoles is already dominated by shot noise and super survey mode coupling in the weakly non-linear regime. Both these effects can be accurately modeled analytically, making a perturbative treatment of the covariance very compelling. Our method allows for the covariance to be varied as a function of cosmology and bias parameters very efficiently, with survey geometry entering as fixed kernels that can be computed separately using fast fourier transforms (FFTs). We find excellent agreement between our analytic covariance and that estimated from BOSS DR12 Patchy mock catalogs in the whole range we tested, up to $k=0.6$ h/Mpc. This bodes well for application to future surveys such as DESI and Euclid. The CovaPT code that accompanies this paper is available at https://github.com/JayWadekar/CovaPT △ Less

Submitted 7 December, 2020; v1 submitted 7 October, 2019; originally announced October 2019.

Comments: 28 pages + appendices; 14 figures. Version appearing in PRD. The busy reader can focus on the sections: 5C, 6 and 7 which contain the main results. CovaPT code is available at https://github.com/JayWadekar/CovaPT

Journal ref: Phys. Rev. D 102, 123517 (2020)

Comment on the paper "Calorimetric Dark Matter Detection with Galactic Center Gas Clouds"

Authors: Glennys R. Farrar, Felix J. Lockman, N. M. McClure-Griffiths, Digvijay Wadekar

Abstract: The paper "Calorimetric Dark Matter Detection with Galactic Center Gas Clouds" (Bhoonah et al. 2018) aims to derive limits on dark matter interactions by demanding that heat transfer due to DM interactions is less than that by astrophysical cooling, using clouds in the hot, high-velocity nuclear outflow wind of the Milky Way ($T_{wind} \sim 10^{6-7}$ K, $V_{wind} \sim$ 330 km/s). We argue that clo… ▽ More The paper "Calorimetric Dark Matter Detection with Galactic Center Gas Clouds" (Bhoonah et al. 2018) aims to derive limits on dark matter interactions by demanding that heat transfer due to DM interactions is less than that by astrophysical cooling, using clouds in the hot, high-velocity nuclear outflow wind of the Milky Way ($T_{wind} \sim 10^{6-7}$ K, $V_{wind} \sim$ 330 km/s). We argue that clouds in such an extreme environment cannot be assumed to be stable over the long timescales associated with their radiative cooling rates. Furthermore, Bhoonah et al. (2018) uses incorrect parameters for their clouds. △ Less

Submitted 27 January, 2020; v1 submitted 28 March, 2019; originally announced March 2019.

Comments: 2 pages, 1 figure. Version appearing in Phys. Rev. Lett

Journal ref: Phys. Rev. Lett. 124, 029001 (2020)

Gas-rich dwarf galaxies as a new probe of dark matter interactions with ordinary matter

Authors: Digvijay Wadekar, Glennys R. Farrar

Abstract: We use observations of gas-rich dwarf galaxies to derive constraints on dark matter scattering with ordinary matter. We require that heating/cooling due to DM interacting with gas in the Leo T dwarf galaxy not exceed the ultra-low radiative cooling rate of the gas. This enables us to set $(i)$ stronger bounds than all the previous literature on ultra-light hidden photon DM for nearly all of the ma… ▽ More We use observations of gas-rich dwarf galaxies to derive constraints on dark matter scattering with ordinary matter. We require that heating/cooling due to DM interacting with gas in the Leo T dwarf galaxy not exceed the ultra-low radiative cooling rate of the gas. This enables us to set $(i)$ stronger bounds than all the previous literature on ultra-light hidden photon DM for nearly all of the mass range $10^{-23}\lesssim m_\mathrm{DM} \lesssim 10^{-10}$ eV, $(ii)$ limits on sub-GeV millicharged DM which add to the constraints on the recent EDGES 21cm absorption anomaly, and $(iii)$ constraints on DM-baryon interactions directly at low relative velocities $v_\mathrm{rel}\sim 17$ km/s. Our study opens a new direction at using observations of gas-rich dwarf galaxies from previous, current and upcoming optical and 21cm surveys to probe physics beyond the standard model. △ Less

Submitted 30 June, 2021; v1 submitted 28 March, 2019; originally announced March 2019.

Comments: 5+10 pages, 4+6 figures. Version appearing in PRD. Title and abstract revised to reflect the primary message of the paper. Minor changes to figures, conclusions unchanged. The code associated with this paper is available at https://github.com/JayWadekar/Gas_rich_dwarfs

Journal ref: Phys. Rev. D 103, 123028 (2021)

Zeldovich pancakes at redshift zero: the equilibration state and phase space properties

Authors: Digvijay Wadekar, Steen H. Hansen

Abstract: One of the components of the cosmic web are sheets, which are commonly referred to as Zeldovich pancakes. These are structures which have only collapsed along one dimension, as opposed to filaments or galaxies and cluster, which have collapsed along two or three dimensions. These pancakes have recently received renewed interest, since they have been shown to be useful tools for an independent meth… ▽ More One of the components of the cosmic web are sheets, which are commonly referred to as Zeldovich pancakes. These are structures which have only collapsed along one dimension, as opposed to filaments or galaxies and cluster, which have collapsed along two or three dimensions. These pancakes have recently received renewed interest, since they have been shown to be useful tools for an independent method to determine galaxy cluster masses. We consider sheet-like structures resulting from cosmological simulations, which were previously used to establish the cluster mass determination method, and we show through their level of equilibration, that these structures have indeed only collapsed along the one dimension. We also extract the density profiles of these pancake, which agrees acceptably well with theoretical expectations. We derive the observable velocity distribution function (VDF) analytically by generalizing the Eddington method to one dimension, and we compare with the distribution function from the numerical simulation. △ Less

Submitted 24 November, 2014; originally announced November 2014.

Comments: 10 pages, 8 figures, accepted by MNRAS