-
Saving Private WAN: Using Internet Paths to Offload WAN Traffic in Conferencing Services
Authors:
Bhaskar Kataria,
Palak LNU,
Rahul Bothra,
Rohan Gandhi,
Debopam Bhattacherjee,
Venkata N. Padmanabhan,
Irena Atov,
Sriraam Ramakrishnan,
Somesh Chaturmohta,
Chakri Kotipalli,
Rui Liang,
Ken Sueda,
Xin He,
Kevin Hinton
Abstract:
Large-scale video conferencing services incur significant network cost while serving surging global demands. Our work systematically explores the opportunity to offload a fraction of this traffic to the Internet, a cheaper routing option offered already by cloud providers, from WAN without drop in application performance. First, with a large-scale latency measurement study with 3.5 million data po…
▽ More
Large-scale video conferencing services incur significant network cost while serving surging global demands. Our work systematically explores the opportunity to offload a fraction of this traffic to the Internet, a cheaper routing option offered already by cloud providers, from WAN without drop in application performance. First, with a large-scale latency measurement study with 3.5 million data points per day spanning 241K source cities and 21 data centers across the globe, we demonstrate that Internet paths perform comparable to or better than the private WAN for parts of the world (e.g., Europe and North America). Next, we present Titan, a live (12+ months) production system that carefully moves a fraction of the conferencing traffic to the Internet using the above observation. Finally, we propose Titan-Next, a research prototype that jointly assigns the conferencing server and routing option (Internet or WAN) for individual calls. With 5 weeks of production data, we show Titan-Next reduces the sum of peak bandwidth on WAN links that defines the operational network cost by up to 61% compared to state-of-the-art baselines. We will open-source parts of the measurement data.
△ Less
Submitted 2 July, 2024;
originally announced July 2024.
-
Fiducial-Cosmology-dependent systematics for the DESI 2024 BAO Analysis
Authors:
A. Pérez-Fernández,
L. Medina-Varela,
R. Ruggeri,
M. Vargas-Magaña,
H. Seo,
N. Padmanabhan,
M. Ishak,
J. Aguilar,
S. Ahlen,
S. Alam,
O. Alves,
S. Brieden,
D. Brooks,
A. Carnero Rosell,
X. Chen,
T. Claybaugh,
S. Cole,
K. Dawson,
A. de la Macorra,
A. de Mattia,
Arjun Dey,
Z. Ding,
P. Doel,
K. Fanning,
C. Garcia-Quintero
, et al. (38 additional authors not shown)
Abstract:
When measuring the Baryon Acoustic Oscillations (BAO) scale from galaxy surveys, one typically assumes a fiducial cosmology when converting redshift measurements into comoving distances and also when defining input parameters for the reconstruction algorithm. A parameterised template for the model to be fitted is also created based on a (possibly different) fiducial cosmology. This model reliance…
▽ More
When measuring the Baryon Acoustic Oscillations (BAO) scale from galaxy surveys, one typically assumes a fiducial cosmology when converting redshift measurements into comoving distances and also when defining input parameters for the reconstruction algorithm. A parameterised template for the model to be fitted is also created based on a (possibly different) fiducial cosmology. This model reliance can be considered a form of data compression, and the data is then analysed allowing that the true answer is different from the fiducial cosmology assumed. In this study, we evaluate the impact of the fiducial cosmology assumed in the BAO analysis of the Dark Energy Spectroscopic Instrument (DESI) survey Data Release 1 (DR1) on the final measurements in DESI 2024 III. We utilise a suite of mock galaxy catalogues with survey realism that mirrors the DESI DR1 tracers: the bright galaxy sample (BGS), the luminous red galaxies (LRG), the emission line galaxies (ELG) and the quasars (QSO), spanning a redshift range from 0.1 to 2.1. We compare the four secondary AbacusSummit cosmologies against DESI's fiducial cosmology (Planck 2018). The secondary cosmologies explored include a lower cold dark matter density, a thawing dark energy universe, a higher number of effective species, and a lower amplitude of matter clustering. The mocks are processed through the BAO pipeline by consistently iterating the grid, template, and reconstruction reference cosmologies. We determine a conservative systematic contribution to the error of $0.1\%$ for both the isotropic and anisotropic dilation parameters $α_{\rm iso}$ and $α_{\rm AP}$. We then directly test the impact of the fiducial cosmology on DESI DR1 data.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
HOD-Dependent Systematics in Emission Line Galaxies for the DESI 2024 BAO analysis
Authors:
C. Garcia-Quintero,
J. Mena-Fernández,
A. Rocher,
S. Yuan,
B. Hadzhiyska,
O. Alves,
M. Rashkovetskyi,
H. Seo,
N. Padmanabhan,
S. Nadathur,
C. Howlett,
M. Ishak,
L. Medina-Varela,
P. McDonald,
A. J. Ross,
Y. Xie,
X. Chen,
A. Bera,
J. Aguilar,
S. Ahlen,
U. Andrade,
S. BenZvi,
D. Brooks,
E. Burtin,
S. Chen
, et al. (51 additional authors not shown)
Abstract:
The Dark Energy Spectroscopic Instrument (DESI) will provide precise measurements of Baryon Acoustic Oscillations (BAO) to constrain the expansion history of the Universe and set stringent constraints on dark energy. Therefore, precise control of the global error budget due to various systematic effects is required for the DESI 2024 BAO analysis. In this work, we focus on the robustness of the BAO…
▽ More
The Dark Energy Spectroscopic Instrument (DESI) will provide precise measurements of Baryon Acoustic Oscillations (BAO) to constrain the expansion history of the Universe and set stringent constraints on dark energy. Therefore, precise control of the global error budget due to various systematic effects is required for the DESI 2024 BAO analysis. In this work, we focus on the robustness of the BAO analysis against the Halo Occupation Distribution (HOD) modeling for the Emission Line Galaxy (ELG) tracer. Based on a common dark matter simulation, our analysis relies on HOD mocks tuned to early DESI data, namely the One-Percent survey data. To build the mocks, we use several HOD models for the ELG tracer as well as extensions to the baseline HOD models. Among these extensions, we consider distinct recipes for galactic conformity and assembly bias. We perform two independent analyses in the Fourier space and in the configuration space. We recover the BAO signal from two-point measurements after performing reconstruction on our mocks. Additionally, we also apply the control variates technique to reduce sample variance noise. Our BAO analysis can recover the isotropic BAO parameter $α_\text{iso}$ within 0.1\% and the Alcock Paczynski parameter $α_\text{AP}$ within 0.3\%. Overall, we find that our systematic error due to the HOD dependence is below 0.17\%, with the Fourier space analysis being more robust against the HOD systematics. We conclude that our analysis pipeline is robust enough against the HOD systematics for the ELG tracer in the DESI 2024 BAO analysis.
△ Less
Submitted 12 April, 2024; v1 submitted 3 April, 2024;
originally announced April 2024.
-
HOD-Dependent Systematics for Luminous Red Galaxies in the DESI 2024 BAO Analysis
Authors:
J. Mena-Fernández,
C. Garcia-Quintero,
S. Yuan,
B. Hadzhiyska,
O. Alves,
M. Rashkovetskyi,
H. Seo,
N. Padmanabhan,
S. Nadathur,
C. Howlett,
S. Alam,
A. Rocher,
A. J. Ross,
E. Sanchez,
M. Ishak,
J. Aguilar,
S. Ahlen,
U. Andrade,
S. BenZvi,
D. Brooks,
E. Burtin,
S. Chen,
X. Chen,
T. Claybaugh,
S. Cole
, et al. (50 additional authors not shown)
Abstract:
In this paper, we present the estimation of systematics related to the halo occupation distribution (HOD) modeling in the baryon acoustic oscillations (BAO) distance measurement of the Dark Energy Spectroscopic Instrument (DESI) 2024 analysis. This paper focuses on the study of HOD systematics for luminous red galaxies (LRG). We consider three different HOD models for LRGs, including the base 5-pa…
▽ More
In this paper, we present the estimation of systematics related to the halo occupation distribution (HOD) modeling in the baryon acoustic oscillations (BAO) distance measurement of the Dark Energy Spectroscopic Instrument (DESI) 2024 analysis. This paper focuses on the study of HOD systematics for luminous red galaxies (LRG). We consider three different HOD models for LRGs, including the base 5-parameter vanilla model and two extensions to it, that we refer to as baseline and extended models. The baseline model is described by the 5 vanilla HOD parameters, an incompleteness factor and a velocity bias parameter, whereas the extended one also includes a galaxy assembly bias and a satellite profile parameter. We utilize the 25 dark matter simulations available in the AbacusSummit simulation suite at $z=$ 0.8 and generate mock catalogs for our different HOD models. To test the impact of the HOD modeling in the position of the BAO peak, we run BAO fits for all these sets of simulations and compare the best-fit BAO-scaling parameters $α_{\rm iso}$ and $α_{\rm AP}$ between every pair of HOD models. We do this for both Fourier and configuration spaces independently, using post-reconstruction measurements. We find a 3.3$σ$ detection of HOD systematic for $α_{\rm AP}$ in configuration space with an amplitude of 0.19%. For the other cases, we did not find a 3$σ$ detection, and we decided to compute a conservative estimation of the systematic using the ensemble of shifts between all pairs of HOD models. By doing this, we quote a systematic with an amplitude of 0.07% in $α_{\rm iso}$ for both Fourier and configuration spaces; and of 0.09% in $α_{\rm AP}$ for Fourier space.
△ Less
Submitted 5 April, 2024; v1 submitted 3 April, 2024;
originally announced April 2024.
-
Semi-analytical covariance matrices for two-point correlation function for DESI 2024 data
Authors:
M. Rashkovetskyi,
D. Forero-Sánchez,
A. de Mattia,
D. J. Eisenstein,
N. Padmanabhan,
H. Seo,
A. J. Ross,
J. Aguilar,
S. Ahlen,
O. Alves,
U. Andrade,
D. Brooks,
E. Burtin,
T. Claybaugh,
S. Cole,
A. de la Macorra,
Z. Ding,
P. Doel,
K. Fanning,
S. Ferraro,
A. Font-Ribera,
J. E. Forero-Romero,
C. Garcia-Quintero,
H. Gil-Marín,
S. Gontcho A Gontcho
, et al. (34 additional authors not shown)
Abstract:
We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 20…
▽ More
We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 2024 analyses. We find only a few percent differences between the mock sample covariance matrix and our results, which can be expected given the approximate nature of the mocks, although we do identify discrepancies between the shot-noise properties of the DESI fiber assignment algorithm and the faster approximation used in the mocks. Importantly, we find a close agreement (<~ 5% relative differences) in the projected errorbars for distance scale parameters for the baryon acoustic oscillation measurements. This confirms our method as an attractive alternative to simulation-based covariance matrices, especially for non-standard models or galaxy sample selections, in particular, relevant to the broad current and future analyses of DESI data.
△ Less
Submitted 5 April, 2024; v1 submitted 3 April, 2024;
originally announced April 2024.
-
Optimal Reconstruction of Baryon Acoustic Oscillations for DESI 2024
Authors:
E. Paillas,
Z. Ding,
X. Chen,
H. Seo,
N. Padmanabhan,
A. de Mattia,
A. J. Ross,
S. Nadathur,
C. Howlett,
J. Aguilar,
S. Ahlen,
O. Alves,
U. Andrade,
D. Brooks,
E. Buckley-Geer,
E. Burtin,
S. Chen,
T. Claybaugh,
S. Cole,
K. Dawson,
A. de la Macorra,
Arjun Dey,
P. Doel,
K. Fanning,
S. Ferraro
, et al. (51 additional authors not shown)
Abstract:
Baryon acoustic oscillations (BAO) provide a robust standard ruler to measure the expansion history of the Universe through galaxy clustering. Density-field reconstruction is now a widely adopted procedure for increasing the precision and accuracy of the BAO detection. With the goal of finding the optimal reconstruction settings to be used in the DESI 2024 galaxy BAO analysis, we assess the sensit…
▽ More
Baryon acoustic oscillations (BAO) provide a robust standard ruler to measure the expansion history of the Universe through galaxy clustering. Density-field reconstruction is now a widely adopted procedure for increasing the precision and accuracy of the BAO detection. With the goal of finding the optimal reconstruction settings to be used in the DESI 2024 galaxy BAO analysis, we assess the sensitivity of the post-reconstruction BAO constraints to different choices in our analysis configuration, performing tests on blinded data from the first year of DESI observations (DR1), as well as on mocks that mimic the expected clustering and selection properties of the DESI DR1 target samples. Overall, we find that BAO constraints remain robust against multiple aspects in the reconstruction process, including the choice of smoothing scale, treatment of redshift-space distortions, fiber assignment incompleteness, and parameterizations of the BAO model. We also present a series of tests that DESI followed in order to assess the maturity of the end-to-end galaxy BAO pipeline before the unblinding of the large-scale structure catalogs.
△ Less
Submitted 14 April, 2024; v1 submitted 3 April, 2024;
originally announced April 2024.
-
DESI 2024 VI: Cosmological Constraints from the Measurements of Baryon Acoustic Oscillations
Authors:
DESI Collaboration,
A. G. Adame,
J. Aguilar,
S. Ahlen,
S. Alam,
D. M. Alexander,
M. Alvarez,
O. Alves,
A. Anand,
U. Andrade,
E. Armengaud,
S. Avila,
A. Aviles,
H. Awan,
B. Bahr-Kalus,
S. Bailey,
C. Baltay,
A. Bault,
J. Behera,
S. BenZvi,
A. Bera,
F. Beutler,
D. Bianchi,
C. Blake,
R. Blum
, et al. (178 additional authors not shown)
Abstract:
We present cosmological results from the measurement of baryon acoustic oscillations (BAO) in galaxy, quasar and Lyman-$α$ forest tracers from the first year of observations from the Dark Energy Spectroscopic Instrument (DESI), to be released in the DESI Data Release 1. DESI BAO provide robust measurements of the transverse comoving distance and Hubble rate, or their combination, relative to the s…
▽ More
We present cosmological results from the measurement of baryon acoustic oscillations (BAO) in galaxy, quasar and Lyman-$α$ forest tracers from the first year of observations from the Dark Energy Spectroscopic Instrument (DESI), to be released in the DESI Data Release 1. DESI BAO provide robust measurements of the transverse comoving distance and Hubble rate, or their combination, relative to the sound horizon, in seven redshift bins from over 6 million extragalactic objects in the redshift range $0.1<z<4.2$. DESI BAO data alone are consistent with the standard flat $Λ$CDM cosmological model with a matter density $Ω_\mathrm{m}=0.295\pm 0.015$. Paired with a BBN prior and the robustly measured acoustic angular scale from the CMB, DESI requires $H_0=(68.52\pm0.62)$ km/s/Mpc. In conjunction with CMB anisotropies from Planck and CMB lensing data from Planck and ACT, we find $Ω_\mathrm{m}=0.307\pm 0.005$ and $H_0=(67.97\pm0.38)$ km/s/Mpc. Extending the baseline model with a constant dark energy equation of state parameter $w$, DESI BAO alone require $w=-0.99^{+0.15}_{-0.13}$. In models with a time-varying dark energy equation of state parametrized by $w_0$ and $w_a$, combinations of DESI with CMB or with SN~Ia individually prefer $w_0>-1$ and $w_a<0$. This preference is 2.6$σ$ for the DESI+CMB combination, and persists or grows when SN~Ia are added in, giving results discrepant with the $Λ$CDM model at the $2.5σ$, $3.5σ$ or $3.9σ$ levels for the addition of Pantheon+, Union3, or DES-SN5YR datasets respectively. For the flat $Λ$CDM model with the sum of neutrino mass $\sum m_ν$ free, combining the DESI and CMB data yields an upper limit $\sum m_ν< 0.072$ $(0.113)$ eV at 95% confidence for a $\sum m_ν>0$ $(\sum m_ν>0.059)$ eV prior. These neutrino-mass constraints are substantially relaxed in models beyond $Λ$CDM. [Abridged.]
△ Less
Submitted 24 April, 2024; v1 submitted 3 April, 2024;
originally announced April 2024.
-
DESI 2024 IV: Baryon Acoustic Oscillations from the Lyman Alpha Forest
Authors:
DESI Collaboration,
A. G. Adame,
J. Aguilar,
S. Ahlen,
S. Alam,
D. M. Alexander,
M. Alvarez,
O. Alves,
A. Anand,
U. Andrade,
E. Armengaud,
S. Avila,
A. Aviles,
H. Awan,
S. Bailey,
C. Baltay,
A. Bault,
J. Bautista,
J. Behera,
S. BenZvi,
F. Beutler,
D. Bianchi,
C. Blake,
R. Blum,
S. Brieden
, et al. (174 additional authors not shown)
Abstract:
We present the measurement of Baryon Acoustic Oscillations (BAO) from the Lyman-$α$ (Ly$α$) forest of high-redshift quasars with the first-year dataset of the Dark Energy Spectroscopic Instrument (DESI). Our analysis uses over $420\,000$ Ly$α$ forest spectra and their correlation with the spatial distribution of more than $700\,000$ quasars. An essential facet of this work is the development of a…
▽ More
We present the measurement of Baryon Acoustic Oscillations (BAO) from the Lyman-$α$ (Ly$α$) forest of high-redshift quasars with the first-year dataset of the Dark Energy Spectroscopic Instrument (DESI). Our analysis uses over $420\,000$ Ly$α$ forest spectra and their correlation with the spatial distribution of more than $700\,000$ quasars. An essential facet of this work is the development of a new analysis methodology on a blinded dataset. We conducted rigorous tests using synthetic data to ensure the reliability of our methodology and findings before unblinding. Additionally, we conducted multiple data splits to assess the consistency of the results and scrutinized various analysis approaches to confirm their robustness. For a given value of the sound horizon ($r_d$), we measure the expansion at $z_{\rm eff}=2.33$ with 2\% precision, $H(z_{\rm eff}) = (239.2 \pm 4.8) (147.09~{\rm Mpc} /r_d)$ km/s/Mpc. Similarly, we present a 2.4\% measurement of the transverse comoving distance to the same redshift, $D_M(z_{\rm eff}) = (5.84 \pm 0.14) (r_d/147.09~{\rm Mpc})$ Gpc. Together with other DESI BAO measurements at lower redshifts, these results are used in a companion paper to constrain cosmological parameters.
△ Less
Submitted 12 April, 2024; v1 submitted 3 April, 2024;
originally announced April 2024.
-
DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars
Authors:
DESI Collaboration,
A. G. Adame,
J. Aguilar,
S. Ahlen,
S. Alam,
D. M. Alexander,
M. Alvarez,
O. Alves,
A. Anand,
U. Andrade,
E. Armengaud,
S. Avila,
A. Aviles,
H. Awan,
S. Bailey,
C. Baltay,
A. Bault,
J. Behera,
S. BenZvi,
F. Beutler,
D. Bianchi,
C. Blake,
R. Blum,
S. Brieden,
A. Brodzeller
, et al. (171 additional authors not shown)
Abstract:
We present the DESI 2024 galaxy and quasar baryon acoustic oscillations (BAO) measurements using over 5.7 million unique galaxy and quasar redshifts in the range 0.1<z<2.1. Divided by tracer type, we utilize 300,017 galaxies from the magnitude-limited Bright Galaxy Survey with 0.1<z<0.4, 2,138,600 Luminous Red Galaxies with 0.4<z<1.1, 2,432,022 Emission Line Galaxies with 0.8<z<1.6, and 856,652 qu…
▽ More
We present the DESI 2024 galaxy and quasar baryon acoustic oscillations (BAO) measurements using over 5.7 million unique galaxy and quasar redshifts in the range 0.1<z<2.1. Divided by tracer type, we utilize 300,017 galaxies from the magnitude-limited Bright Galaxy Survey with 0.1<z<0.4, 2,138,600 Luminous Red Galaxies with 0.4<z<1.1, 2,432,022 Emission Line Galaxies with 0.8<z<1.6, and 856,652 quasars with 0.8<z<2.1, over a ~7,500 square degree footprint. The analysis was blinded at the catalog-level to avoid confirmation bias. All fiducial choices of the BAO fitting and reconstruction methodology, as well as the size of the systematic errors, were determined on the basis of the tests with mock catalogs and the blinded data catalogs. We present several improvements to the BAO analysis pipeline, including enhancing the BAO fitting and reconstruction methods in a more physically-motivated direction, and also present results using combinations of tracers. We present a re-analysis of SDSS BOSS and eBOSS results applying the improved DESI methodology and find scatter consistent with the level of the quoted SDSS theoretical systematic uncertainties. With the total effective survey volume of ~ 18 Gpc$^3$, the combined precision of the BAO measurements across the six different redshift bins is ~0.52%, marking a 1.2-fold improvement over the previous state-of-the-art results using only first-year data. We detect the BAO in all of these six redshift bins. The highest significance of BAO detection is $9.1σ$ at the effective redshift of 0.93, with a constraint of 0.86% placed on the BAO scale. We find our measurements are systematically larger than the prediction of Planck-2018 LCDM model at z<0.8. We translate the results into transverse comoving distance and radial Hubble distance measurements, which are used to constrain cosmological models in our companion paper [abridged].
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
NL2KQL: From Natural Language to Kusto Query
Authors:
Amir H. Abdi,
Xinye Tang,
Jeremias Eichelbaum,
Mahan Das,
Alex Klein,
Nihal Irmak Pakis,
William Blum,
Daniel L Mace,
Tanvi Raja,
Namrata Padmanabhan,
Ye Xing
Abstract:
Data is growing rapidly in volume and complexity. Proficiency in database query languages is pivotal for crafting effective queries. As coding assistants become more prevalent, there is significant opportunity to enhance database query languages. The Kusto Query Language (KQL) is a widely used query language for large semi-structured data such as logs, telemetries, and time-series for big data ana…
▽ More
Data is growing rapidly in volume and complexity. Proficiency in database query languages is pivotal for crafting effective queries. As coding assistants become more prevalent, there is significant opportunity to enhance database query languages. The Kusto Query Language (KQL) is a widely used query language for large semi-structured data such as logs, telemetries, and time-series for big data analytics platforms. This paper introduces NL2KQL an innovative framework that uses large language models (LLMs) to convert natural language queries (NLQs) to KQL queries. The proposed NL2KQL framework includes several key components: Schema Refiner which narrows down the schema to its most pertinent elements; the Few-shot Selector which dynamically selects relevant examples from a few-shot dataset; and the Query Refiner which repairs syntactic and semantic errors in KQL queries. Additionally, this study outlines a method for generating large datasets of synthetic NLQ-KQL pairs which are valid within a specific database contexts. To validate NL2KQL's performance, we utilize an array of online (based on query execution) and offline (based on query parsing) metrics. Through ablation studies, the significance of each framework component is examined, and the datasets used for benchmarking are made publicly available. This work is the first of its kind and is compared with available baselines to demonstrate its effectiveness.
△ Less
Submitted 15 April, 2024; v1 submitted 2 April, 2024;
originally announced April 2024.
-
Displacement Field Analysis via Optimal Transport: Multi-Tracer Approach to Cosmological Reconstruction
Authors:
Farnik Nikakhtar,
Ravi K. Sheth,
Nikhil Padmanabhan,
Bruno Lévy,
Roya Mohayaee
Abstract:
We demonstrate the effectiveness of one of the many multi-tracer analyses enabled by Optimal Transport (OT) reconstruction. Leveraging a semi-discrete OT algorithm, we determine the displacements between initial and observed positions of biased tracers and the remaining matter field. With only redshift-space distorted final positions of biased tracers and a simple premise for the remaining mass di…
▽ More
We demonstrate the effectiveness of one of the many multi-tracer analyses enabled by Optimal Transport (OT) reconstruction. Leveraging a semi-discrete OT algorithm, we determine the displacements between initial and observed positions of biased tracers and the remaining matter field. With only redshift-space distorted final positions of biased tracers and a simple premise for the remaining mass distribution as input, OT solves the displacement field. This extracted field, assuming asymptotically uniform density and a gradient flow displacement, enables reconstruction of the initial overdensity fluctuation field. We show that the divergence of the OT displacement field is a good proxy of the linear density field, even though the method never assumes the linear theory growth. Additionally, this divergence field can be combined with the reconstructed protohalos to provide a higher signal-to-noise measurement of the BAO standard ruler than was possible with either measurement individually.
△ Less
Submitted 18 March, 2024;
originally announced March 2024.
-
A Transient Thermal Model for Power Electronics Systems
Authors:
Neelakantan Padmanabhan
Abstract:
An equation based reduced order model applicable to generalized heat equation and thermal simulations of power electronics systems developed in commercial CFD tools, is presented in this work. The model considers the physics of heat transfer between multiple objects in different mediums and presents a set of equations that can be applied to a wide range of heat transfer scenarios including conduct…
▽ More
An equation based reduced order model applicable to generalized heat equation and thermal simulations of power electronics systems developed in commercial CFD tools, is presented in this work. The model considers the physics of heat transfer between multiple objects in different mediums and presents a set of equations that can be applied to a wide range of heat transfer scenarios including conduction, natural and forced convection problems. A few case studies including heat transfer in a power electronic system are simulated in Ansys Icepak and the temperatures from the simulations are compared with the temperatures predicted by the models. The models are observed to be highly accurate when compared with the simulations. The predictive model described in this work reduces large complex simulations down to a few parameters which tremendously improves the computation speed, uses very low physical disk space and enables fast evaluation of thermal performance of the system for any changes in the input parameters.
△ Less
Submitted 25 April, 2024; v1 submitted 5 March, 2024;
originally announced March 2024.
-
Baryon Acoustic Oscillation Theory and Modelling Systematics for the DESI 2024 results
Authors:
Shi-Fan Chen,
Cullan Howlett,
Martin White,
Patrick McDonald,
Ashley J. Ross,
Hee-Jong Seo,
Nikhil Padmanabhan,
J. Aguilar,
S. Ahlen,
S. Alam,
O. Alves,
R. Blum,
D. Brooks,
X. Chen,
S. Cole,
T. M. Davis,
K. Dawson,
A. de la Macorra,
Arjun Dey,
Z. Ding,
P. Doel,
S. Ferraro,
A. Font-Ribera,
D. Forero-Sánchez,
J. E. Forero-Romero
, et al. (33 additional authors not shown)
Abstract:
This paper provides a comprehensive overview of how fitting of Baryon Acoustic Oscillations (BAO) is carried out within the upcoming Dark Energy Spectroscopic Instrument's (DESI) 2024 results using its DR1 dataset, and the associated systematic error budget from theory and modelling of the BAO. We derive new results showing how non-linearities in the clustering of galaxies can cause potential bias…
▽ More
This paper provides a comprehensive overview of how fitting of Baryon Acoustic Oscillations (BAO) is carried out within the upcoming Dark Energy Spectroscopic Instrument's (DESI) 2024 results using its DR1 dataset, and the associated systematic error budget from theory and modelling of the BAO. We derive new results showing how non-linearities in the clustering of galaxies can cause potential biases in measurements of the isotropic ($α_{\mathrm{iso}}$) and anisotropic ($α_{\mathrm{ap}}$) BAO distance scales, and how these can be effectively removed with an appropriate choice of reconstruction algorithm. We then demonstrate how theory leads to a clear choice for how to model the BAO and develop, implement and validate a new model for the remaining smooth-broadband (i.e., without BAO) component of the galaxy clustering. Finally, we explore the impact of all remaining modelling choices on the BAO constraints from DESI using a suite of high-precision simulations, arriving at a set of best-practices for DESI BAO fits, and an associated theory and modelling systematic error. Overall, our results demonstrate the remarkable robustness of the BAO to all our modelling choices and motivate a combined theory and modelling systematic error contribution to the post-reconstruction DESI BAO measurements of no more than $0.1\%$ ($0.2\%$) for its isotropic (anisotropic) distance measurements. We expect the theory and best-practices laid out to here to be applicable to other BAO experiments in the era of DESI and beyond.
△ Less
Submitted 21 February, 2024;
originally announced February 2024.
-
Explaining the Implicit Neural Canvas: Connecting Pixels to Neurons by Tracing their Contributions
Authors:
Namitha Padmanabhan,
Matthew Gwilliam,
Pulkit Kumar,
Shishira R Maiya,
Max Ehrlich,
Abhinav Shrivastava
Abstract:
The many variations of Implicit Neural Representations (INRs), where a neural network is trained as a continuous representation of a signal, have tremendous practical utility for downstream tasks including novel view synthesis, video compression, and image superresolution. Unfortunately, the inner workings of these networks are seriously under-studied. Our work, eXplaining the Implicit Neural Canv…
▽ More
The many variations of Implicit Neural Representations (INRs), where a neural network is trained as a continuous representation of a signal, have tremendous practical utility for downstream tasks including novel view synthesis, video compression, and image superresolution. Unfortunately, the inner workings of these networks are seriously under-studied. Our work, eXplaining the Implicit Neural Canvas (XINC), is a unified framework for explaining properties of INRs by examining the strength of each neuron's contribution to each output pixel. We call the aggregate of these contribution maps the Implicit Neural Canvas and we use this concept to demonstrate that the INRs which we study learn to ''see'' the frames they represent in surprising ways. For example, INRs tend to have highly distributed representations. While lacking high-level object semantics, they have a significant bias for color and edges, and are almost entirely space-agnostic. We arrive at our conclusions by examining how objects are represented across time in video INRs, using clustering to visualize similar neurons across layers and architectures, and show that this is dominated by motion. These insights demonstrate the general usefulness of our analysis framework. Our project page is available at https://namithap10.github.io/xinc.
△ Less
Submitted 18 January, 2024;
originally announced January 2024.
-
Do text-free diffusion models learn discriminative visual representations?
Authors:
Soumik Mukhopadhyay,
Matthew Gwilliam,
Yosuke Yamaguchi,
Vatsal Agarwal,
Namitha Padmanabhan,
Archana Swaminathan,
Tianyi Zhou,
Abhinav Shrivastava
Abstract:
While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We identify diffusion models, a state-of-the-art method for generative tasks, as a prime candidate. Such models involve training a U-Net to iteratively predict and re…
▽ More
While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We identify diffusion models, a state-of-the-art method for generative tasks, as a prime candidate. Such models involve training a U-Net to iteratively predict and remove noise, and the resulting model can synthesize high-fidelity, diverse, novel images. We find that the intermediate feature maps of the U-Net are diverse, discriminative feature representations. We propose a novel attention mechanism for pooling feature maps and further leverage this mechanism as DifFormer, a transformer feature fusion of features from different diffusion U-Net blocks and noise steps. We also develop DifFeed, a novel feedback mechanism tailored to diffusion. We find that diffusion models are better than GANs, and, with our fusion and feedback mechanisms, can compete with state-of-the-art unsupervised image representation learning methods for discriminative tasks - image classification with full and semi-supervision, transfer for fine-grained classification, object detection and segmentation, and semantic segmentation. Our project website (https://mgwillia.github.io/diffssl/) and code (https://github.com/soumik-kanad/diffssl) are available publicly.
△ Less
Submitted 29 November, 2023; v1 submitted 29 November, 2023;
originally announced November 2023.
-
Analysis of an iterative reconstruction method in comparison of the standard reconstruction method
Authors:
Xinyi Chen,
Nikhil Padmanabhan
Abstract:
We present a detailed analysis of a new, iterative density reconstruction algorithm. This algorithm uses a decreasing smoothing scale to better reconstruct the density field in Lagrangian space. We implement this algorithm to run on the Quijote simulations, and extend it to (a) include a smoothing kernel that smoothly goes from anisotropic to isotropic, and (b) a variant that does not correct for…
▽ More
We present a detailed analysis of a new, iterative density reconstruction algorithm. This algorithm uses a decreasing smoothing scale to better reconstruct the density field in Lagrangian space. We implement this algorithm to run on the Quijote simulations, and extend it to (a) include a smoothing kernel that smoothly goes from anisotropic to isotropic, and (b) a variant that does not correct for redshift space distortions. We compare the performance of this algorithm with the standard reconstruction method. Our examinations of the methods include cross-correlation of the reconstructed density field with the linear density field, reconstructed two-point functions, and BAO parameter fitting. We also examine the impact of various parameters, such as smoothing scale, anisotropic smoothing, tracer type/bias, and the inclusion of second order perturbation theory. We find that the two reconstruction algorithms are comparable in most of the areas we examine. In particular, both algorithms give consistent fittings of BAO parameters. The fits are robust over a range of smoothing scales. We find the iterative algorithm is significantly better at removing redshift space distortions. The new algorithm will be a promising method to be employed in the ongoing and future large-scale structure surveys.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
Scalar Field Dark Matter: Impact of Supernovae-driven blowouts on the soliton structure of low mass dark matter halos
Authors:
Victor H. Robles,
J. L. Zagorac,
N. Padmanabhan
Abstract:
We present the first study on the gravitational impact of supernova feedback in an isolated soliton and a spherically symmetric dwarf SFDM halo of virial mass $1\times 10^{10}\mathrm{M_\odot}$. We use a boson mass $m=10^{-22}\mathrm{eV/c^2}$ and a soliton core $r_c \approx 0.7$kpc, comparable to typical half-light radii of Local Group dwarf galaxies. We simulate the rapid gas removal from the cent…
▽ More
We present the first study on the gravitational impact of supernova feedback in an isolated soliton and a spherically symmetric dwarf SFDM halo of virial mass $1\times 10^{10}\mathrm{M_\odot}$. We use a boson mass $m=10^{-22}\mathrm{eV/c^2}$ and a soliton core $r_c \approx 0.7$kpc, comparable to typical half-light radii of Local Group dwarf galaxies. We simulate the rapid gas removal from the center of the soliton by a concentric external time-dependent Hernquist potential. We explore two scenarios of feedback blowouts: i) a massive single burst, and ii) multiple consecutive blowouts injecting the same total energy to the system, including various magnitudes for the blowouts in both scenarios. In all cases, we find one single blowout has a stronger effect on reducing the soliton central density. Feedback leads to central soliton densities that oscillate quasi-periodically for an isolated soliton and stochastically for a SFDM halo. The range in the density amplitude depends on the strength of the blowout, however we observe typical variations of a factor of $\geqslant$2. One important consequence of the stochastic fluctuating densities is that, if we had no prior knowledge of the system evolution, we can only know the configuration profile at a specific time within some accuracy. By fitting soliton profiles at different times to our simulated structures, we found the (1-$σ$) scatter of their time-dependent density profiles. For configurations within the 1$σ$ range, we find the inferred boson mass is typically less than 20\% different from the real value used in our simulations. Finally, we compare the observed dynamical masses of field dwarf galaxies in our Local Group with the implied range of viable solitons from our simulations and find good agreement.
△ Less
Submitted 28 August, 2023;
originally announced August 2023.
-
Mitigating the noise of DESI mocks using analytic control variates
Authors:
Boryana Hadzhiyska,
Martin J. White,
Xinyi Chen,
Lehman H. Garrison,
Joseph DeRose,
Nikhil Padmanabhan,
Cristhian Garcia-Quintero,
Juan Mena-Fernández,
Shi-Fan Chen,
Hee-Jong Seo,
Patrick McDonald,
Jessica Aguilar,
Steven Ahlen,
David Brooks,
Todd Claybaugh,
Axel de la Macorra,
Peter Doel,
Andreu Font-Ribera,
Jaime E. Forero-Romero,
Satya Gontcho A Gontcho,
Klaus Honscheid,
Anthony Kremin,
Martin Landriau,
Marc Manera,
Ramon Miquel
, et al. (8 additional authors not shown)
Abstract:
In order to address fundamental questions related to the expansion history of the Universe and its primordial nature with the next generation of galaxy experiments, we need to model reliably large-scale structure observables such as the correlation function and the power spectrum. Cosmological $N$-body simulations provide a reference through which we can test our models, but their output suffers f…
▽ More
In order to address fundamental questions related to the expansion history of the Universe and its primordial nature with the next generation of galaxy experiments, we need to model reliably large-scale structure observables such as the correlation function and the power spectrum. Cosmological $N$-body simulations provide a reference through which we can test our models, but their output suffers from sample variance on large scales. Fortunately, this is the regime where accurate analytic approximations exist. To reduce the variance, which is key to making optimal use of these simulations, we can leverage the accuracy and precision of such analytic descriptions using Control Variates (CV). The power of control variates stems from utilizing inexpensive but highly correlated surrogates of the statistics one wishes to measure. The stronger the correlation between the surrogate and the statistic of interest, the larger the variance reduction delivered by the method. We apply two control variate formulations to mock catalogs generated in anticipation of upcoming data from the Dark Energy Spectroscopic Instrument (DESI) to test the robustness of its analysis pipeline. Our CV-reduced measurements offer a factor of 5-10 improvement in the measurement error compared with the raw measurements. We explore the relevant properties of the galaxy samples that dictate this reduction and comment on the improvements we find on some of the derived quantities relevant to Baryon Acoustic Oscillation (BAO) analysis. We also provide an optimized package for computing the power spectra and other two-point statistics of an arbitrary galaxy catalog as well as a pipeline for obtaining CV-reduced measurements on any of the AbacusSummit cubic box outputs. We make our scripts publicly available and report a speed improvement of $\sim$10 for a grid size of $N_{\rm mesh} = 256^3$ compared with \texttt{nbodykit}.
△ Less
Submitted 16 October, 2023; v1 submitted 23 August, 2023;
originally announced August 2023.
-
On viewing SpaceX Starlink through the Social Media Lens
Authors:
Aryan Taneja,
Debopam Bhattacherjee,
Saikat Guha,
Venkata N. Padmanabhan
Abstract:
Multiple low-Earth orbit satellite constellations, aimed at beaming broadband connectivity from space, are currently under active deployment. While such space-based Internet is set to augment, globally, today's terrestrial connectivity, and has managed to generate significant hype, it has been largely difficult for the community to measure, quantify, or understand the nuances of these offerings in…
▽ More
Multiple low-Earth orbit satellite constellations, aimed at beaming broadband connectivity from space, are currently under active deployment. While such space-based Internet is set to augment, globally, today's terrestrial connectivity, and has managed to generate significant hype, it has been largely difficult for the community to measure, quantify, or understand the nuances of these offerings in the absence of a global measurement infrastructure -- the research community has mostly resorted to simulators, emulators, and limited measurements till now. In this paper, we identify an opportunity to use the social media `lens' to complement such measurements and mine user-centric insights on the evolving ecosystem at scale.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs
Authors:
Tongshuang Wu,
Haiyi Zhu,
Maya Albayrak,
Alexis Axon,
Amanda Bertsch,
Wenxing Deng,
Ziqi Ding,
Bill Guo,
Sireesh Gururaja,
Tzu-Sheng Kuo,
Jenny T. Liang,
Ryan Liu,
Ihita Mandal,
Jeremiah Milbauer,
Xiaolin Ni,
Namrata Padmanabhan,
Subhashini Ramkumar,
Alexis Sudjianto,
Jordan Taylor,
Ying-Jui Tseng,
Patricia Vaidos,
Zhijin Wu,
Wei Wu,
Chenyang Yang
Abstract:
LLMs have shown promise in replicating human-like behavior in crowdsourcing tasks that were previously thought to be exclusive to human abilities. However, current efforts focus mainly on simple atomic tasks. We explore whether LLMs can replicate more complex crowdsourcing pipelines. We find that modern LLMs can simulate some of crowdworkers' abilities in these "human computation algorithms," but…
▽ More
LLMs have shown promise in replicating human-like behavior in crowdsourcing tasks that were previously thought to be exclusive to human abilities. However, current efforts focus mainly on simple atomic tasks. We explore whether LLMs can replicate more complex crowdsourcing pipelines. We find that modern LLMs can simulate some of crowdworkers' abilities in these "human computation algorithms," but the level of success is variable and influenced by requesters' understanding of LLM capabilities, the specific skills required for sub-tasks, and the optimal interaction modality for performing these sub-tasks. We reflect on human and LLMs' different sensitivities to instructions, stress the importance of enabling human-facing safeguards for LLMs, and discuss the potential of training humans and LLMs with complementary skill sets. Crucially, we show that replicating crowdsourcing pipelines offers a valuable platform to investigate (1) the relative strengths of LLMs on different tasks (by cross-comparing their performances on sub-tasks) and (2) LLMs' potential in complex tasks, where they can complete part of the tasks while leaving others to humans.
△ Less
Submitted 19 July, 2023; v1 submitted 19 July, 2023;
originally announced July 2023.
-
Diffusion Models Beat GANs on Image Classification
Authors:
Soumik Mukhopadhyay,
Matthew Gwilliam,
Vatsal Agarwal,
Namitha Padmanabhan,
Archana Swaminathan,
Srinidhi Hegde,
Tianyi Zhou,
Abhinav Shrivastava
Abstract:
While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both families of tasks simultaneously. We identify diffusion models as a prime candidate. Diffusion models have risen to prominence as a state-of-the-art method for image…
▽ More
While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both families of tasks simultaneously. We identify diffusion models as a prime candidate. Diffusion models have risen to prominence as a state-of-the-art method for image generation, denoising, inpainting, super-resolution, manipulation, etc. Such models involve training a U-Net to iteratively predict and remove noise, and the resulting model can synthesize high fidelity, diverse, novel images. The U-Net architecture, as a convolution-based architecture, generates a diverse set of feature representations in the form of intermediate feature maps. We present our findings that these embeddings are useful beyond the noise prediction task, as they contain discriminative information and can also be leveraged for classification. We explore optimal methods for extracting and using these embeddings for classification tasks, demonstrating promising results on the ImageNet classification task. We find that with careful feature selection and pooling, diffusion models outperform comparable generative-discriminative methods such as BigBiGAN for classification tasks. We investigate diffusion models in the transfer learning regime, examining their performance on several fine-grained visual classification datasets. We compare these embeddings to those generated by competing architectures and pre-trainings for classification tasks.
△ Less
Submitted 17 July, 2023;
originally announced July 2023.
-
Optimal Transport Reconstruction of Biased Tracers in Redshift Space
Authors:
Farnik Nikakhtar,
Nikhil Padmanabhan,
Bruno Lévy,
Ravi K. Sheth,
Roya Mohayaee
Abstract:
Recent research has emphasized the benefits of accurately reconstructing the initial Lagrangian positions of biased tracers from their positions at a later time, to gain cosmological information. A weighted semi-discrete optimal transport algorithm can achieve the required accuracy, provided the late-time positions are known, with minimal information about the background cosmology. The algorithm's…
▽ More
Recent research has emphasized the benefits of accurately reconstructing the initial Lagrangian positions of biased tracers from their positions at a later time, to gain cosmological information. A weighted semi-discrete optimal transport algorithm can achieve the required accuracy, provided the late-time positions are known, with minimal information about the background cosmology. The algorithm's performance relies on knowing the masses of the biased tracers, and depends on how one models the distribution of the remaining mass that is not associated with these tracers. We demonstrate that simple models of the remaining mass result in accurate retrieval of the initial Lagrangian positions, which we quantify using pair statistics and the void probability function. This is true even if the input positions are affected by redshift-space distortions. The most sophisticated models assume that the masses of the tracers, and the amount and clustering of the missing mass are known; we show that the method is robust to realistic errors in the masses of the tracers and remains so as the model for the missing mass becomes increasingly crude.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
NANCY: Next-generation All-sky Near-infrared Community surveY
Authors:
Jiwon Jesse Han,
Arjun Dey,
Adrian M. Price-Whelan,
Joan Najita,
Edward F. Schlafly,
Andrew Saydjari,
Risa H. Wechsler,
Ana Bonaca,
David J Schlegel,
Charlie Conroy,
Anand Raichoor,
Alex Drlica-Wagner,
Juna A. Kollmeier,
Sergey E. Koposov,
Gurtina Besla,
Hans-Walter Rix,
Alyssa Goodman,
Douglas Finkbeiner,
Abhijeet Anand,
Matthew Ashby,
Benedict Bahr-Kalus,
Rachel Beaton,
Jayashree Behera,
Eric F. Bell,
Eric C Bellm
, et al. (184 additional authors not shown)
Abstract:
The Nancy Grace Roman Space Telescope is capable of delivering an unprecedented all-sky, high-spatial resolution, multi-epoch infrared map to the astronomical community. This opportunity arises in the midst of numerous ground- and space-based surveys that will provide extensive spectroscopy and imaging together covering the entire sky (such as Rubin/LSST, Euclid, UNIONS, SPHEREx, DESI, SDSS-V, GAL…
▽ More
The Nancy Grace Roman Space Telescope is capable of delivering an unprecedented all-sky, high-spatial resolution, multi-epoch infrared map to the astronomical community. This opportunity arises in the midst of numerous ground- and space-based surveys that will provide extensive spectroscopy and imaging together covering the entire sky (such as Rubin/LSST, Euclid, UNIONS, SPHEREx, DESI, SDSS-V, GALAH, 4MOST, WEAVE, MOONS, PFS, UVEX, NEO Surveyor, etc.). Roman can uniquely provide uniform high-spatial-resolution (~0.1 arcsec) imaging over the entire sky, vastly expanding the science reach and precision of all of these near-term and future surveys. This imaging will not only enhance other surveys, but also facilitate completely new science. By imaging the full sky over two epochs, Roman can measure the proper motions for stars across the entire Milky Way, probing 100 times fainter than Gaia out to the very edge of the Galaxy. Here, we propose NANCY: a completely public, all-sky survey that will create a high-value legacy dataset benefiting innumerable ongoing and forthcoming studies of the universe. NANCY is a pure expression of Roman's potential: it images the entire sky, at high spatial resolution, in a broad infrared bandpass that collects as many photons as possible. The majority of all ongoing astronomical surveys would benefit from incorporating observations of NANCY into their analyses, whether these surveys focus on nearby stars, the Milky Way, near-field cosmology, or the broader universe.
△ Less
Submitted 20 June, 2023;
originally announced June 2023.
-
Effective cosmic density field reconstruction with convolutional neural network
Authors:
Xinyi Chen,
Fangzhou Zhu,
Sasha Gaines,
Nikhil Padmanabhan
Abstract:
We present a cosmic density field reconstruction method that augments the traditional reconstruction algorithms with a convolutional neural network (CNN). Following Shallue $\&$ Eisenstein (2022), the key component of our method is to use the $\textit{reconstructed}$ density field as the input to the neural network. We extend this previous work by exploring how the performance of these reconstruct…
▽ More
We present a cosmic density field reconstruction method that augments the traditional reconstruction algorithms with a convolutional neural network (CNN). Following Shallue $\&$ Eisenstein (2022), the key component of our method is to use the $\textit{reconstructed}$ density field as the input to the neural network. We extend this previous work by exploring how the performance of these reconstruction ideas depends on the input reconstruction algorithm, the reconstruction parameters, and the shot noise of the density field, as well as the robustness of the method. We build an eight-layer CNN and train the network with reconstructed density fields computed from the Quijote suite of simulations. The reconstructed density fields are generated by both the standard algorithm and a new iterative algorithm. In real space at $z=0$, we find that the reconstructed field is $90\%$ correlated with the true initial density out to $k\sim 0.5 h{\rm Mpc}^{-1}$, a significant improvement over $k\sim 0.2 h{\rm Mpc}^{-1}$ achieved by the input reconstruction algorithms. We find similar improvements in redshift space, including an improved removal of redshift space distortions at small scales. We also find that the method is robust across changes in cosmology. Additionally, the CNN removes much of the variance from the choice of different reconstruction algorithms and reconstruction parameters. However, the effectiveness decreases with increasing shot noise, suggesting that such an approach is best suited to high density samples. This work highlights the additional information in the density field beyond linear scales as well as the power of complementing traditional analysis approaches with machine learning techniques.
△ Less
Submitted 18 June, 2023;
originally announced June 2023.
-
First Detection of the BAO Signal from Early DESI Data
Authors:
Jeongin Moon,
David Valcin,
Michael Rashkovetskyi,
Christoph Saulder,
Jessica Nicole Aguilar,
Steven Ahlen,
Shadab Alam,
Stephen Bailey,
Charles Baltay,
Robert Blum,
David Brooks,
Etienne Burtin,
Edmond Chaussidon,
Kyle Dawson,
Axel de la Macorra,
Arnaud de Mattia,
Govinda Dhungana,
Daniel Eisenstein,
Brenna Flaugher,
Andreu Font-Ribera,
Jaime E. Forero-Romero,
Cristhian Garcia-Quintero,
Satya Gontcho A Gontcho,
Julien Guy,
Malik Muhammad Sikandar Hanif
, et al. (43 additional authors not shown)
Abstract:
We present the first detection of the baryon acoustic oscillations (BAO) signal obtained using unblinded data collected during the initial two months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). From a selected sample of 261,291 Luminous Red Galaxies spanning the redshift interval 0.4 < z < 1.1 and covering 1651 square degrees with a 57.9% completeness le…
▽ More
We present the first detection of the baryon acoustic oscillations (BAO) signal obtained using unblinded data collected during the initial two months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). From a selected sample of 261,291 Luminous Red Galaxies spanning the redshift interval 0.4 < z < 1.1 and covering 1651 square degrees with a 57.9% completeness level, we report a ~5 sigma level BAO detection and the measurement of the BAO location at a precision of 1.7%. Using a Bright Galaxy Sample of 109,523 galaxies in the redshift range 0.1 < z < 0.5, over 3677 square degrees with a 50.0% completeness, we also detect the BAO feature at ~3 sigma significance with a 2.6% precision. These first BAO measurements represent an important milestone, acting as a quality control on the optimal performance of the complex robotically-actuated, fiber-fed DESI spectrograph, as well as an early validation of the DESI spectroscopic pipeline and data management system. Based on these first promising results, we forecast that DESI is on target to achieve a high-significance BAO detection at sub-percent precision with the completed 5-year survey data, meeting the top-level science requirements on BAO measurements. This exquisite level of precision will set new standards in cosmology and confirm DESI as the most competitive BAO experiment for the remainder of this decade.
△ Less
Submitted 19 October, 2023; v1 submitted 17 April, 2023;
originally announced April 2023.
-
Reduced order model of a convection-diffusion equation using Proper Orthogonal Decomposition
Authors:
Neelakantan Padmanabhan
Abstract:
In this work, a numerical simulation of 1D Burgers' equation is developed using finite difference method and a reduced order model (ROM) of the simulation is developed using proper orthogonal decomposition (POD). The objective of this work is to provide an introduction of the POD method to researchers interested in computational fluid dynamics (CFD). This work discusses a physical interpretation o…
▽ More
In this work, a numerical simulation of 1D Burgers' equation is developed using finite difference method and a reduced order model (ROM) of the simulation is developed using proper orthogonal decomposition (POD). The objective of this work is to provide an introduction of the POD method to researchers interested in computational fluid dynamics (CFD). This work discusses a physical interpretation of the POD method, its strengths and shortcomings and an implementation of the algorithm that may be extended to 2D, 3D Burgers' equation and other non-linear partial differential equations (PDE) of this class, to develop models for more complex systems.
△ Less
Submitted 13 March, 2023;
originally announced March 2023.
-
Soliton Formation and the Core-Halo Mass Relation: An Eigenstate Perspective
Authors:
J. Luna Zagorac,
Emily Kendall,
Nikhil Padmanabhan,
Richard Easther
Abstract:
UltraLight Dark Matter (ULDM) is an axion-like dark matter candidate with an extremely small particle mass. ULDM halos consist of a spherically symmetric solitonic core and an NFW-like skirt. We simulate halo creation via soliton mergers and use these results to explore the core-halo mass relation. We calculate the eigenstates of the merged halos and use these to isolate the solitonic core and cal…
▽ More
UltraLight Dark Matter (ULDM) is an axion-like dark matter candidate with an extremely small particle mass. ULDM halos consist of a spherically symmetric solitonic core and an NFW-like skirt. We simulate halo creation via soliton mergers and use these results to explore the core-halo mass relation. We calculate the eigenstates of the merged halos and use these to isolate the solitonic core and calculate its relative contribution to the halo mass. We compare this approach to using a fitting function to isolate the core and find a difference in masses up to 30%. We analyze three families of simulations: equal-mass mergers, unequal-mass mergers, and halos with a two-step merger history. Setting the halo mass to the initial mass in the simulation does not yield a consistent core-halo relationship. Excluding material "ejected" by the collision yields a core-halo relationship with a slope of 1/3 for simultaneous mergers and roughly 0.4 for two-step mergers. Our findings suggest there is no universal core-halo mass relationship for ULDM and shed light on the differing results for the core-halo relationship previously reported in the literature.
△ Less
Submitted 28 April, 2023; v1 submitted 19 December, 2022;
originally announced December 2022.
-
Streaming Video Analytics On The Edge With Asynchronous Cloud Support
Authors:
Anurag Ghosh,
Srinivasan Iyengar,
Stephen Lee,
Anuj Rathore,
Venkat N Padmanabhan
Abstract:
Emerging Internet of Things (IoT) and mobile computing applications are expected to support latency-sensitive deep neural network (DNN) workloads. To realize this vision, the Internet is evolving towards an edge-computing architecture, where computing infrastructure is located closer to the end device to help achieve low latency. However, edge computing may have limited resources compared to cloud…
▽ More
Emerging Internet of Things (IoT) and mobile computing applications are expected to support latency-sensitive deep neural network (DNN) workloads. To realize this vision, the Internet is evolving towards an edge-computing architecture, where computing infrastructure is located closer to the end device to help achieve low latency. However, edge computing may have limited resources compared to cloud environments and thus, cannot run large DNN models that often have high accuracy. In this work, we develop REACT, a framework that leverages cloud resources to execute large DNN models with higher accuracy to improve the accuracy of models running on edge devices. To do so, we propose a novel edge-cloud fusion algorithm that fuses edge and cloud predictions, achieving low latency and high accuracy. We extensively evaluate our approach and show that our approach can significantly improve the accuracy compared to baseline approaches. We focus specifically on object detection in videos (applicable in many video analytics scenarios) and show that the fused edge-cloud predictions can outperform the accuracy of edge-only and cloud-only scenarios by as much as 50%. We also show that REACT can achieve good performance across tradeoff points by choosing a wide range of system parameters to satisfy use-case specific constraints, such as limited network bandwidth or GPU cycles.
△ Less
Submitted 4 October, 2022;
originally announced October 2022.
-
The MegaMapper: A Stage-5 Spectroscopic Instrument Concept for the Study of Inflation and Dark Energy
Authors:
David J. Schlegel,
Juna A. Kollmeier,
Greg Aldering,
Stephen Bailey,
Charles Baltay,
Christopher Bebek,
Segev BenZvi,
Robert Besuner,
Guillermo Blanc,
Adam S. Bolton,
Ana Bonaca,
Mohamed Bouri,
David Brooks,
Elizabeth Buckley-Geer,
Zheng Cai,
Jeffrey Crane,
Regina Demina,
Joseph DeRose,
Arjun Dey,
Peter Doel,
Xiaohui Fan,
Simone Ferraro,
Douglas Finkbeiner,
Andreu Font-Ribera,
Satya Gontcho A Gontcho
, et al. (64 additional authors not shown)
Abstract:
In this white paper, we present the MegaMapper concept. The MegaMapper is a proposed ground-based experiment to measure Inflation parameters and Dark Energy from galaxy redshifts at $2<z<5$. In order to achieve path-breaking results with a mid-scale investment, the MegaMapper combines existing technologies for critical path elements and pushes innovative development in other design areas. To this…
▽ More
In this white paper, we present the MegaMapper concept. The MegaMapper is a proposed ground-based experiment to measure Inflation parameters and Dark Energy from galaxy redshifts at $2<z<5$. In order to achieve path-breaking results with a mid-scale investment, the MegaMapper combines existing technologies for critical path elements and pushes innovative development in other design areas. To this aim, we envision a 6.5-m Magellan-like telescope, with a newly designed wide field, coupled with DESI spectrographs, and small-pitch robots to achieve multiplexing of at least 26,000. This will match the expected achievable target density in the redshift range of interest and provide a 10x capability over the existing state-of the art, without a 10x increase in project budget.
△ Less
Submitted 9 September, 2022;
originally announced September 2022.
-
A Spectroscopic Road Map for Cosmic Frontier: DESI, DESI-II, Stage-5
Authors:
David J. Schlegel,
Simone Ferraro,
Greg Aldering,
Charles Baltay,
Segev BenZvi,
Robert Besuner,
Guillermo A. Blanc,
Adam S. Bolton,
Ana Bonaca,
David Brooks,
Elizabeth Buckley-Geer,
Zheng Cai,
Joseph DeRose,
Arjun Dey,
Peter Doel,
Alex Drlica-Wagner,
Xiaohui Fan,
Gaston Gutierrez,
Daniel Green,
Julien Guy,
Dragan Huterer,
Leopoldo Infante,
Patrick Jelinsky,
Dionysios Karagiannis,
Stephen M. Kent
, et al. (40 additional authors not shown)
Abstract:
In this white paper, we present an experimental road map for spectroscopic experiments beyond DESI. DESI will be a transformative cosmological survey in the 2020s, mapping 40 million galaxies and quasars and capturing a significant fraction of the available linear modes up to z=1.2. DESI-II will pilot observations of galaxies both at much higher densities and extending to higher redshifts. A Stage…
▽ More
In this white paper, we present an experimental road map for spectroscopic experiments beyond DESI. DESI will be a transformative cosmological survey in the 2020s, mapping 40 million galaxies and quasars and capturing a significant fraction of the available linear modes up to z=1.2. DESI-II will pilot observations of galaxies both at much higher densities and extending to higher redshifts. A Stage-5 experiment would build out those high-density and high-redshift observations, mapping hundreds of millions of stars and galaxies in three dimensions, to address the problems of inflation, dark energy, light relativistic species, and dark matter. These spectroscopic data will also complement the next generation of weak lensing, line intensity mapping and CMB experiments and allow them to reach their full potential.
△ Less
Submitted 8 September, 2022;
originally announced September 2022.
-
Simulating Network Paths with Recurrent Buffering Units
Authors:
Divyam Anshumaan,
Sriram Balasubramanian,
Shubham Tiwari,
Nagarajan Natarajan,
Sundararajan Sellamanickam,
Venkata N. Padmanabhan
Abstract:
Simulating physical network paths (e.g., Internet) is a cornerstone research problem in the emerging sub-field of AI-for-networking. We seek a model that generates end-to-end packet delay values in response to the time-varying load offered by a sender, which is typically a function of the previously output delays. The problem setting is unique, and renders the state-of-the-art text and time-series…
▽ More
Simulating physical network paths (e.g., Internet) is a cornerstone research problem in the emerging sub-field of AI-for-networking. We seek a model that generates end-to-end packet delay values in response to the time-varying load offered by a sender, which is typically a function of the previously output delays. The problem setting is unique, and renders the state-of-the-art text and time-series generative models inapplicable or ineffective. We formulate an ML problem at the intersection of dynamical systems, sequential decision making, and time-series modeling. We propose a novel grey-box approach to network simulation that embeds the semantics of physical network path in a new RNN-style model called RBU, providing the interpretability of standard network simulator tools, the power of neural models, the efficiency of SGD-based techniques for learning, and yielding promising results on synthetic and real-world network traces.
△ Less
Submitted 6 December, 2022; v1 submitted 23 February, 2022;
originally announced February 2022.
-
Leveraging Bitstream Metadata for Fast, Accurate, Generalized Compressed Video Quality Enhancement
Authors:
Max Ehrlich,
Jon Barker,
Namitha Padmanabhan,
Larry Davis,
Andrew Tao,
Bryan Catanzaro,
Abhinav Shrivastava
Abstract:
Video compression is a central feature of the modern internet powering technologies from social media to video conferencing. While video compression continues to mature, for many compression settings, quality loss is still noticeable. These settings nevertheless have important applications to the efficient transmission of videos over bandwidth constrained or otherwise unstable connections. In this…
▽ More
Video compression is a central feature of the modern internet powering technologies from social media to video conferencing. While video compression continues to mature, for many compression settings, quality loss is still noticeable. These settings nevertheless have important applications to the efficient transmission of videos over bandwidth constrained or otherwise unstable connections. In this work, we develop a deep learning architecture capable of restoring detail to compressed videos which leverages the underlying structure and motion information embedded in the video bitstream. We show that this improves restoration accuracy compared to prior compression correction methods and is competitive when compared with recent deep-learning-based video compression methods on rate-distortion while achieving higher throughput. Furthermore, we condition our model on quantization data which is readily available in the bitstream. This allows our single model to handle a variety of different compression quality settings which required an ensemble of models in prior work.
△ Less
Submitted 30 October, 2023; v1 submitted 31 January, 2022;
originally announced February 2022.
-
The High Latitude Spectroscopic Survey on the Nancy Grace Roman Space Telescope
Authors:
Yun Wang,
Zhongxu Zhai,
Anahita Alavi,
Elena Massara,
Alice Pisani,
Andrew Benson,
Christopher M. Hirata,
Lado Samushia,
David H. Weinberg,
James Colbert,
Olivier Doré,
Tim Eifler,
Chen Heinrich,
Shirley Ho,
Elisabeth Krause,
Nikhil Padmanabhan,
David Spergel,
Harry I. Teplitz
Abstract:
The Nancy Grace Roman Space Telescope will conduct a High Latitude Spectroscopic Survey (HLSS) over a large volume at high redshift, using the near-IR grism (1.0-1.93 $μ$m, $R=435-865$) and the 0.28 deg$^2$ wide field camera. We present a reference HLSS which maps 2000 deg$^2$ and achieves an emission line flux limit of 10$^{-16}$ erg/s/cm$^2$ at 6.5$σ$, requiring $\sim$0.6 yrs of observing time.…
▽ More
The Nancy Grace Roman Space Telescope will conduct a High Latitude Spectroscopic Survey (HLSS) over a large volume at high redshift, using the near-IR grism (1.0-1.93 $μ$m, $R=435-865$) and the 0.28 deg$^2$ wide field camera. We present a reference HLSS which maps 2000 deg$^2$ and achieves an emission line flux limit of 10$^{-16}$ erg/s/cm$^2$ at 6.5$σ$, requiring $\sim$0.6 yrs of observing time. We summarize the flowdown of the Roman science objectives to the science and technical requirements of the HLSS. We construct a mock redshift survey over the full HLSS volume by applying a semi-analytic galaxy formation model to a cosmological N-body simulation, and use this mock survey to create pixel-level simulations of 4 deg$^2$ of HLSS grism spectroscopy. We find that the reference HLSS would measure $\sim$ 10 million H$α$ galaxy redshifts that densely map large scale structure at $z=1-2$ and 2 million [OIII] galaxy redshifts that sparsely map structures at $z=2-3$. We forecast the performance of this survey for measurements of the cosmic expansion history with baryon acoustic oscillations and the growth of large scale structure with redshift space distortions. We also study possible deviations from the reference design, and find that a deep HLSS at $f_{\rm line}>7\times10^{-17}$erg/s/cm$^2$ over 4000 deg$^2$ (requiring $\sim$1.5 yrs of observing time) provides the most compelling stand-alone constraints on dark energy from Roman alone. This provides a useful reference for future optimizations. The reference survey, simulated data sets, and forecasts presented here will inform community decisions on the final scope and design of the Roman HLSS.
△ Less
Submitted 5 October, 2021;
originally announced October 2021.
-
Schrödinger-Poisson Solitons: Perturbation Theory
Authors:
J. Luna Zagorac,
Isabel Sands,
Nikhil Padmanabhan,
Richard Easther
Abstract:
Self-gravitating quantum matter may exist in a wide range of cosmological and astrophysical settings from the very early universe through to present-day boson stars. Such quantum matter arises in a number of different theories, including the Peccei-Quinn axion and UltraLight (ULDM) or Fuzzy (FDM) dark matter scenarios. We consider the dynamical evolution of perturbations to the spherically symmetr…
▽ More
Self-gravitating quantum matter may exist in a wide range of cosmological and astrophysical settings from the very early universe through to present-day boson stars. Such quantum matter arises in a number of different theories, including the Peccei-Quinn axion and UltraLight (ULDM) or Fuzzy (FDM) dark matter scenarios. We consider the dynamical evolution of perturbations to the spherically symmetric soliton, the ground state solution to the Schrödinger-Poisson system common to all these scenarios. We construct the eigenstates of the Schrödinger equation, holding the gravitational potential fixed to its ground state value. We see that the eigenstates qualitatively capture the properties seen in full ULDM simulations, including the soliton "breathing" mode, the random walk of the soliton center, and quadrupolar distortions of the soliton. We then show that the time-evolution of the gravitational potential and its impact on the perturbations can be well described within the framework of time-dependent perturbation theory. Applying our formalism to a synthetic ULDM halo reveals considerable mixing of eigenstates, even though the overall density profile is relatively stable. Our results provide a new analytic approach to understanding the evolution of these systems as well as possibilities for faster approximate simulations.
△ Less
Submitted 15 April, 2022; v1 submitted 4 September, 2021;
originally announced September 2021.
-
Optimal 1D Ly$α$ Forest Power Spectrum Estimation -- II. KODIAQ, SQUAD & XQ-100
Authors:
Naim Göksel Karaçaylı,
Nikhil Padmanabhan,
Andreu Font-Ribera,
Vid Iršič,
Michael Walther,
David Brooks,
Enrique Gaztañaga,
Robert Kehoe,
Michael Levi,
Pierros Ntelis,
Nathalie Palanque-Delabrouille,
Gregory Tarlé
Abstract:
We measure the 1D Ly$\,α$ power spectrum $P_\mathrm{1D}$ from Keck Observatory Database of Ionized Absorption toward Quasars (KODIAQ), The Spectral Quasar Absorption Database (SQUAD) and XQ-100 quasars using the optimal quadratic estimator. We combine KODIAQ and SQUAD at the spectrum level, but perform a separate XQ-100 estimation to control its large resolution corrections in check. Our final ana…
▽ More
We measure the 1D Ly$\,α$ power spectrum $P_\mathrm{1D}$ from Keck Observatory Database of Ionized Absorption toward Quasars (KODIAQ), The Spectral Quasar Absorption Database (SQUAD) and XQ-100 quasars using the optimal quadratic estimator. We combine KODIAQ and SQUAD at the spectrum level, but perform a separate XQ-100 estimation to control its large resolution corrections in check. Our final analysis measures $P_\mathrm{1D}$ at scales $k<0.1\,$s$\,$km$^{-1}$ between redshifts $z=$ 2.0 -- 4.6 using 538 quasars. This sample provides the largest number of high-resolution, high-S/N observations; and combined with the power of optimal estimator it provides exceptional precision at small scales. These small-scale modes ($k\gtrsim 0.02\,$s$\,$km$^{-1}$), unavailable in Sloan Digital Sky Survey (SDSS) and Dark Energy Spectroscopic Instrument (DESI) analyses, are sensitive to the thermal state and reionization history of the intergalactic medium, as well as the nature of dark matter. As an example, a simple Fisher forecast analysis estimates that our results can improve small-scale cut off sensitivity by more than a factor of 2.
△ Less
Submitted 1 December, 2022; v1 submitted 24 August, 2021;
originally announced August 2021.
-
Optimal 1D Ly-$α$ Forest Power Spectrum Estimation I: DESI-Lite Spectra
Authors:
Naim Göksel Karaçaylı,
Andreu Font-Ribera,
Nikhil Padmanabhan
Abstract:
The 1D Ly-$α$ forest flux power spectrum $P_{\mathrm{1D}}$ is sensitive to scales smaller than a typical galaxy survey, and hence ties to the intergalactic medium's thermal state, suppression from neutrino masses and new dark matter models. It has emerged as a competitive framework to study new physics, but also has come with various challenges and systematic errors in analysis. In this work, we r…
▽ More
The 1D Ly-$α$ forest flux power spectrum $P_{\mathrm{1D}}$ is sensitive to scales smaller than a typical galaxy survey, and hence ties to the intergalactic medium's thermal state, suppression from neutrino masses and new dark matter models. It has emerged as a competitive framework to study new physics, but also has come with various challenges and systematic errors in analysis. In this work, we revisit the optimal quadratic estimator for $P_{\mathrm{1D}}$, which is robust against the relevant problems such as pixel masking, time evolution within spectrum and quasar continuum errors. We further improve the estimator by introducing a fiducial power spectrum, which enables us to extract more information by alleviating the discreteness of band powers. We meticulously apply our method to synthetic DESI spectra and demonstrate how the estimator overcomes each challenge. We further apply an optimisation scheme that approximates the Fisher matrix to three elements per row and reduces computation time by 60%. We show that we can achieve percent precision in $P_{\mathrm{1D}}$ with 5-year DESI data in the absence of systematics and provide forecasts for different spectral qualities.
△ Less
Submitted 14 August, 2020;
originally announced August 2020.
-
Accretion History of AGN II: Constraints on AGN Spectral Parameters using the Cosmic X-ray Background
Authors:
Tonima Tasnim Ananna,
Ezequiel Treister,
Claudia M. Urry,
Claudio Ricci,
Ryan Hickox,
Nikhil Padmanabhan,
Stefano Marchesi,
Allison Kirkpatrick
Abstract:
We constrain X-ray spectral shapes for the ensemble of AGN based on the shape of the Cosmic X-ray Background (CXB). Specifically, we rule out regions of X-ray spectral parameter space that do not reproduce the CXB in the energy range 1-100 keV. The key X-ray spectral parameters are the photon index, Γ; the cutoff energy, Ecutoff; and the reflection scaling factor, R. Assuming each parameter follow…
▽ More
We constrain X-ray spectral shapes for the ensemble of AGN based on the shape of the Cosmic X-ray Background (CXB). Specifically, we rule out regions of X-ray spectral parameter space that do not reproduce the CXB in the energy range 1-100 keV. The key X-ray spectral parameters are the photon index, Γ; the cutoff energy, Ecutoff; and the reflection scaling factor, R. Assuming each parameter follows a Gaussian distribution, we first explore the parameter space using a Bayesian approach and a fixed X-ray luminosity function (XLF). For σ_E = 36 keV and σ_R = 0.14, fixed at the observed values from the Swift-BAT 70-month sample, we allow <R>, <Ecutoff > and <Γ> to vary subject to reproducing the CXB. We report results for σ_Γ = 0.1-0.5. In an alternative approach, we define the parameter distributions, then forward model to fit the CXB by perturbing the XLF using a neural network. This approach allows us to rule out parameter combinations that cannot reproduce the CXB for any XLF. The marginalized conditional probabilities for the four free parameters are: <R> = 0.99^{+0.11}_{-0.26}, <Ecutoff> = 118^{+24}_{-23}, σ_Γ = 0.101^{+0.097}_{-0.001} and <Γ> = 1.9^{+0.08}_{-0.09}. We provide an interactive online tool for users to explore any combination of <Ecutoff>, σ_E, <Γ>, σ_Γ, <R> and σ_R including different distributions for each absorption bin, subject to the integral CXB constraint. The distributions observed in many AGN samples can be ruled out by our analysis, meaning these samples can not be representative of the full AGN population. The few samples that fall within the acceptable parameter space are hard X-ray-selected, commensurate with their having fewer selection biases.
△ Less
Submitted 25 November, 2019;
originally announced November 2019.
-
Astro2020 APC White Paper: The MegaMapper: a z > 2 spectroscopic instrument for the study of Inflation and Dark Energy
Authors:
David J. Schlegel,
Juna A. Kollmeier,
Greg Aldering,
Stephen Bailey,
Charles Baltay,
Christopher Bebek,
Segev BenZvi,
Robert Besuner,
Guillermo Blanc,
Adam S. Bolton,
Mohamed Bouri,
David Brooks,
Elizabeth Buckley-Geer,
Zheng Cai,
Jeffrey Crane,
Arjun Dey,
Peter Doel,
Xiaohui Fan,
Simone Ferraro,
Andreu Font-Ribera,
Gaston Gutierrez,
Julien Guy,
Henry Heetderks,
Dragan Huterer,
Leopoldo Infante
, et al. (52 additional authors not shown)
Abstract:
MegaMapper is a proposed ground-based experiment to measure Inflation parameters and Dark Energy from galaxy redshifts at 2<z<5. A 6.5-m Magellan telescope will be coupled with DESI spectrographs to achieve multiplexing of 20,000. MegaMapper would be located at Las Campanas Observatory to fully access LSST imaging for target selection.
MegaMapper is a proposed ground-based experiment to measure Inflation parameters and Dark Energy from galaxy redshifts at 2<z<5. A 6.5-m Magellan telescope will be coupled with DESI spectrographs to achieve multiplexing of 20,000. MegaMapper would be located at Las Campanas Observatory to fully access LSST imaging for target selection.
△ Less
Submitted 25 July, 2019;
originally announced July 2019.
-
Anatomy of Cosmic Tidal Reconstruction
Authors:
Naim Goksel Karacayli,
Nikhil Padmanabhan
Abstract:
21-cm intensity surveys aim to map neutral hydrogen atoms in the universe through hyper-fine emission. Unfortunately, long-wavelength (low-wavenumber) radial modes are highly contaminated by smooth astrophysical foregrounds that are six orders of magnitude brighter than the cosmological signal. This contamination also leaks into higher radial and angular wavenumber modes and forms a foreground wed…
▽ More
21-cm intensity surveys aim to map neutral hydrogen atoms in the universe through hyper-fine emission. Unfortunately, long-wavelength (low-wavenumber) radial modes are highly contaminated by smooth astrophysical foregrounds that are six orders of magnitude brighter than the cosmological signal. This contamination also leaks into higher radial and angular wavenumber modes and forms a foreground wedge. Cosmic tidal reconstruction aims to extract the large-scale signal from anisotropic features in the local small-scale power spectrum through non-linear tidal interactions; losing small-scale modes to foreground wedge will impair its performance. In this paper, we review tidal interaction theory and estimator construction, and derive the theoretical expressions for the reconstructed spectra. We show the reconstruction is robust against peculiar velocities. Removing low line-of-sight $k$ modes, we demonstrate cross-correlation coefficient $r$ is greater than 0.7 on large scales ($k <0.1$ $h/$Mpc) even with a cutoff value $k^c_{\|}=0.1$ $h/$Mpc. Discarding wedge modes yields $0.3< r < 0.5$ and completely removes the dependency on $k^c_{\|}$. Our theoretical predictions agree with these numerical simulations.
△ Less
Submitted 2 April, 2019;
originally announced April 2019.
-
Illuminating the dark universe with a very high density galaxy redshift survey over a wide area
Authors:
Yun Wang,
Rachel Bean,
Peter Behroozi,
Chia-Hsun Chuang,
Ian Dell'antonio,
Mark Dickinson,
Olivier Dore,
Daniel Eisenstein,
Ryan Foley,
Karl Glazebrook,
Luigi Guzzo,
Christopher Hirata,
Shirley Ho,
Michael Hudson,
Bhuvnesh Jain,
Priyamvada Natarajan,
Jeff Newman,
Alvaro Orsi,
Nikhil Padmanabhan,
John Peacock,
Will Percival,
Jason Rhodes,
Eduardo Rozo,
Lado Samushia,
Dan Scolnic
, et al. (5 additional authors not shown)
Abstract:
The nature of dark energy remains a profound mystery 20 years after the discovery of cosmic acceleration. A very high number density galaxy redshift survey over a wide area (HD GRS Wide) spanning the redshift range of 0.5<z<4 using the same tracer, carried out using massively parallel wide field multi-object slit spectroscopy from space, will provide definitive dark energy measurements with minima…
▽ More
The nature of dark energy remains a profound mystery 20 years after the discovery of cosmic acceleration. A very high number density galaxy redshift survey over a wide area (HD GRS Wide) spanning the redshift range of 0.5<z<4 using the same tracer, carried out using massively parallel wide field multi-object slit spectroscopy from space, will provide definitive dark energy measurements with minimal observational systematics by design. The HD GRS Wide will illuminate the nature of dark energy, and lead to revolutionary advances in particle physics and cosmology. It will also trace the cosmic web of dark matter and provide key insight into large-scale structure in the Universe. The required observational facility can be established as part of the probe portfolio by NASA within the next decade.
△ Less
Submitted 13 March, 2019;
originally announced March 2019.
-
GUT-Scale Primordial Black Holes: Mergers and Gravitational Waves
Authors:
J. Luna Zagorac,
Richard Easther,
Nikhil Padmanabhan
Abstract:
Tight constraints on the abundance of primordial black holes can be deduced across a vast range of masses, with the exception of those light enough to fully evaporate before nucleosynthesis. This hypothetical population is almost entirely unconstrained, to the point where the early Universe could pass through a matter-dominated phase with primordial black holes as the primary component. The only o…
▽ More
Tight constraints on the abundance of primordial black holes can be deduced across a vast range of masses, with the exception of those light enough to fully evaporate before nucleosynthesis. This hypothetical population is almost entirely unconstrained, to the point where the early Universe could pass through a matter-dominated phase with primordial black holes as the primary component. The only obvious relic of this phase would be Hawking radiated gravitons which would constitute a stochastic gravitational wave background in the present-day Universe, albeit at frequencies far beyond the scope of any planned detector technology. This paper explores the effects of classical mergers in such a matter dominated phase. For certain ranges of parameters, a significant fraction of the black holes merge, providing an additional, classical source of primordial gravitational waves. The resulting stochastic background typically has a lower amplitude than the Hawking background and lies at less extreme frequencies, but is unlikely to be easily detectable, with a maximal present day density of $Ω_{GW} \sim 10^{-12}$ and frequencies between $10^{15} - 10^{19}$ Hz. We also asses the impact of radiation accretion on the lifetimes of such primordial black holes and find that it increases the black hole mass by $\sim 14 \%$ and the lifetimes by about $50 \%$. However, this does not qualitatively change any of our conclusions.
△ Less
Submitted 4 June, 2019; v1 submitted 12 March, 2019;
originally announced March 2019.
-
Ensemble photometric redshifts
Authors:
Nikhil Padmanabhan,
Martin White,
Tzu-Ching Chang,
J. D. Cohn,
Olivier Dore,
Gil Holder
Abstract:
Upcoming imaging surveys, such as LSST, will provide an unprecedented view of the Universe, but with limited resolution along the line-of-sight. Common ways to increase resolution in the third dimension, and reduce misclassifications, include observing a wider wavelength range and/or combining the broad-band imaging with higher spectral resolution data. The challenge with these approaches is match…
▽ More
Upcoming imaging surveys, such as LSST, will provide an unprecedented view of the Universe, but with limited resolution along the line-of-sight. Common ways to increase resolution in the third dimension, and reduce misclassifications, include observing a wider wavelength range and/or combining the broad-band imaging with higher spectral resolution data. The challenge with these approaches is matching the depth of these ancillary data with the original imaging survey. However, while a full 3D map is required for some science, there are many situations where only the statistical distribution of objects (dN/dz) in the line-of-sight direction is needed. In such situations, there is no need to measure the fluxes of individual objects in all of the surveys. Rather a stacking procedure can be used to perform an `ensemble photo-z'. We show how a shallow, higher spectral resolution survey can be used to measure dN/dz for stacks of galaxies which coincide in a deeper, lower resolution survey. The galaxies in the deeper survey do not even need to appear individually in the shallow survey. We give a toy model example to illustrate tradeoffs and considerations for applying this method. This approach will allow deep imaging surveys to leverage the high resolution of spectroscopic and narrow/medium band surveys underway, even when the latter do not have the same reach to high redshift.
△ Less
Submitted 4 March, 2019;
originally announced March 2019.
-
Automatic Data Registration of Geostationary Payloads for Meteorological Applications at ISRO
Authors:
Jignesh S. Bhatt,
N. Padmanabhan
Abstract:
The launch of KALPANA-1 satellite in the year 2002 heralded the establishment of an indigenous operational payload for meteorological predictions. This was further enhanced in the year 2003 with the launching of INSAT-3A satellite. The software for generating products from the data of these two satellites was taken up subsequently in the year 2004 and the same was installed at the Indian Meteorolo…
▽ More
The launch of KALPANA-1 satellite in the year 2002 heralded the establishment of an indigenous operational payload for meteorological predictions. This was further enhanced in the year 2003 with the launching of INSAT-3A satellite. The software for generating products from the data of these two satellites was taken up subsequently in the year 2004 and the same was installed at the Indian Meteorological Department, New Delhi in January 2006. Registration has been one of the most fundamental operations to generate almost all the data products from the remotely sensed data. Registration is a challenging task due to inevitable radiometric and geometric distortions during the acquisition process. Besides the presence of clouds makes the problem more complicated. In this paper, we present an algorithm for multitemporal and multiband registration. In addition, India facing reference boundaries for the CCD data of INSAT-3A have also been generated. The complete implementation is made up of the following steps: 1) automatic identification of the ground control points (GCPs) in the sensed data, 2) finding the optimal transformation model based on the match-points, and 3) resampling the transformed imagery to the reference coordinates. The proposed algorithm is demonstrated using the real datasets from KALPANA-1 and INSAT-3A. Both KALAPANA-1 and INSAT-3A have recently been decommissioned due to lack of fuel, however, the experience gained from them have given rise to a series of meteorological satellites and associated software; like INSAT-3D series which give continuous weather forecasting for the country. This paper is not so much focused on the theory (widely available in the literature) but concentrates on the implementation of operational software.
△ Less
Submitted 17 May, 2018;
originally announced May 2018.
-
WFIRST Science Investigation Team "Cosmology with the High Latitude Survey" Annual Report 2017
Authors:
Olivier Doré,
Christopher Hirata,
Yun Wang,
David Weinberg,
Ivano Baronchelli,
Andrew Benson,
Peter Capak,
Ami Choi,
Tim Eifler,
Shoubaneh Hemmati,
Shirley Ho,
Albert Izard,
Bhuvnesh Jain,
Mike Jarvis,
Alina Kiessling,
Elisabeth Krause,
Elena Massara,
Dan Masters,
Alex Merson,
Hironao Miyatake,
Andres Plazas Malagon,
Rachel Mandelbaum,
Lado Samushia,
Chaz Shapiro,
Melanie Simet
, et al. (24 additional authors not shown)
Abstract:
Cosmic acceleration is the most surprising cosmological discovery in many decades. Testing and distinguishing among possible explanations requires cosmological measurements of extremely high precision probing the full history of cosmic expansion and structure growth and, ideally, compare and contrast matter and relativistic tracers of the gravity potential. This program is one of the defining obje…
▽ More
Cosmic acceleration is the most surprising cosmological discovery in many decades. Testing and distinguishing among possible explanations requires cosmological measurements of extremely high precision probing the full history of cosmic expansion and structure growth and, ideally, compare and contrast matter and relativistic tracers of the gravity potential. This program is one of the defining objectives of the Wide-Field Infrared Survey Telescope (WFIRST), as set forth in the New Worlds, New Horizons report (NWNH) in 2010. The WFIRST mission has the ability to improve these measurements by 1-2 orders of magnitude compared to the current state of the art, while simultaneously extending their redshift grasp, greatly improving control of systematic effects, and taking a unified approach to multiple probes that provide complementary physical information and cross-checks of cosmological results. We describe in this annual report the activities of the Science Investigation Team (SIT) "Cosmology with the High Latitude Survey (HLS)" during the year 2017. This team was selected by NASA in December 2015 in order to address the stringent challenges of the WFIRST dark energy (DE) program through the Project's formulation phase. This SIT has elected to jointly address Galaxy Redshift Survey, Weak Lensing and Cluster Growth and thus fully embrace the fact that the imaging and spectroscopic elements of the HLS will be realized as an integrated observing program, and they jointly impose requirements on performance and operations. WFIRST is designed to be able to deliver a definitive result on the origin of cosmic acceleration. It is not optimized for Figure of Merit sensitivity but for control of systematic uncertainties and for having multiple techniques each with multiple cross-checks. Our SIT work focuses on understanding the potential systematics in the WFIRST DE measurements.
△ Less
Submitted 10 April, 2018;
originally announced April 2018.
-
The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: Measuring the anisotropic Baryon Acoustic Oscillations with redshift weights
Authors:
Fangzhou Zhu,
Nikhil Padmanabhan,
Ashley J. Ross,
Martin White,
Will J. Percival,
Rossana Ruggeri,
Gong-bo Zhao,
Dandan Wang,
Eva-Maria Mueller,
Etienne Burtin,
Héctor Gil-Marín,
Florian Beutler,
Jonathan Brinkmann,
Joel R. Brownstein,
Kyle Dawson,
Axel de la Macorra,
Graziano Rossi,
Donald P. Schneider,
Rita Tojeiro,
Yuting Wang
Abstract:
We present an anisotropic analysis of Baryon Acoustic Oscillation (BAO) signal from the SDSS-IV extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 14 (DR14) quasar sample. The sample consists of 147,000 quasars distributed over a redshift range of $0.8 < z < 2.2$. We apply the redshift weights technique to the clustering of quasars in this sample and achieve a 4.6 per cent measu…
▽ More
We present an anisotropic analysis of Baryon Acoustic Oscillation (BAO) signal from the SDSS-IV extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 14 (DR14) quasar sample. The sample consists of 147,000 quasars distributed over a redshift range of $0.8 < z < 2.2$. We apply the redshift weights technique to the clustering of quasars in this sample and achieve a 4.6 per cent measurement of the angular distance measurement $D_M$ at $z = 2.2$ and Hubble parameter $H$ at $z=0.8$. We parameterize the distance-redshift relation, relative to a fiducial model, as a quadratic expansion. The coefficients of this expansion are used to reconstruct the distance-redshift relation and obtain distance and Hubble parameter measurements at all redshifts within the redshift range of the sample. Reporting the result at two characteristic redshifts, we determine $D_M(z=1) = 3405\pm305 \ (r_{\rm d} / r_{\rm d, fid}) \ {\rm Mpc}$, $H(z=1) = 120.7\pm 7.3 \ (r_{\rm d,fid} / r_{\rm d}) \ {\rm km} \ {\rm s}^{-1}{\rm Mpc}^{-1}$ and $D_M(z=2) = 5325\pm249 \ (r_{\rm d} / r_{\rm d, fid}) \ {\rm Mpc}$, $H(z=2) = 189.9\pm 32.9 \ (r_{\rm d,fid} / r_{\rm d}) \ {\rm km} \ {\rm s}^{-1}{\rm Mpc}^{-1}$. These measurements are highly correlated. We assess the outlook of BAO analysis from the final quasar sample by testing the method on a set of mocks that mimic the noise level in the final sample. We demonstrate on these mocks that redshift weighting shrinks the measurement error by over 25 per cent on average. We conclude redshift weighting can bring us closer to the cosmological goal of the final quasar sample.
△ Less
Submitted 9 January, 2018;
originally announced January 2018.
-
The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: measuring the evolution of the growth rate using redshift space distortions between redshift 0.8 and 2.2
Authors:
Rossana Ruggeri,
Will J. Percival,
Hector Gil Marin,
Florian Beutler,
Eva Maria Mueller,
Fangzhou Zhu,
Nikhil Padmanabhan,
Gong-Bo Zhao,
Pauline Zarrouk,
Ariel G. Sanchez,
Julian Bautista,
Jonathan Brinkmann,
Joel R. Brownstein,
Falk Baumgarten,
Chia Hsun Chuang,
Kyle Dawson,
Hee Jong Seo,
Rita Tojeiro,
Cheng Zhao
Abstract:
We measure the growth rate and its evolution using the anisotropic clustering of the extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 14 (DR14) quasar sample, which includes $148\,659$ quasars covering the wide redshift range of $0.8 < z < 2.2$ and a sky area of $2112.90$ $\rm deg^2$. To optimise measurements we deploy a redshift-dependent weighting scheme, which allows us to…
▽ More
We measure the growth rate and its evolution using the anisotropic clustering of the extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 14 (DR14) quasar sample, which includes $148\,659$ quasars covering the wide redshift range of $0.8 < z < 2.2$ and a sky area of $2112.90$ $\rm deg^2$. To optimise measurements we deploy a redshift-dependent weighting scheme, which allows us to avoid binning, and perform the data analysis consistently including the redshift evolution across the sample. We perform the analysis in Fourier space, and use the redshift evolving power spectrum multipoles to measure the redshift space distortion parameter $fσ_8$ and parameters controlling the anisotropic projection of the cosmological perturbations. We measure $f σ_8(z=1.52)=0.43 \pm 0.05 $ and $dfσ_8/dz (z=1.52)= - 0.16 \pm 0.08$, consistent with the expectation for a $Λ$CDM cosmology as constrained by the Planck experiment.
△ Less
Submitted 10 January, 2018; v1 submitted 9 January, 2018;
originally announced January 2018.
-
The extended Baryon Oscillation Spectroscopic Survey (eBOSS): testing a new approach to measure the evolution of the structure growth
Authors:
Rossana Ruggeri,
Will J. Percival,
Eva-Maria Mueller,
Hector Gil-Marin,
Fangzhou Zhu,
Nikhil Padmanabhan,
Gong-Bo Zhao
Abstract:
The extended Baryon Oscillation Spectroscopic Survey (eBOSS) is one of the first of a new generation of galaxy redshift surveys that will cover a large range in redshift with sufficient resolution to measure the baryon acoustic oscillations (BAO) signal. For surveys covering a large redshift range we can no longer ignore cosmological evolution, meaning that either the redshift shells analysed have…
▽ More
The extended Baryon Oscillation Spectroscopic Survey (eBOSS) is one of the first of a new generation of galaxy redshift surveys that will cover a large range in redshift with sufficient resolution to measure the baryon acoustic oscillations (BAO) signal. For surveys covering a large redshift range we can no longer ignore cosmological evolution, meaning that either the redshift shells analysed have to be significantly narrower than the survey, or we have to allow for the averaging over evolving quantities. Both of these have the potential to remove signal: analysing small volumes increases the size of the Fourier window function, reducing the large-scale information, while averaging over evolving quantities can, if not performed carefully, remove differential information. It will be important to measure cosmological evolution from these surveys to explore and discriminate between models. We apply a method to optimally extract this differential information to mock catalogues designed to mimic the eBOSS quasar sample. By applying a set of weights to extract redshift space distortion measurements as a function of redshift, we demonstrate an analysis that does not invoke the problems discussed above. We show that our estimator gives unbiased constraints.
△ Less
Submitted 11 December, 2017;
originally announced December 2017.
-
Matched filtering with interferometric 21cm experiments
Authors:
Martin White,
Nikhil Padmanabhan
Abstract:
A new generation of interferometric instruments is emerging which aim to use intensity mapping of redshifted $21\,$cm radiation to measure the large-scale structure of the Universe at $z\simeq 1-2$ over wide areas of sky. While these instruments typically have limited angular resolution, they cover huge volumes and thus can be used to provide large samples of rare objects. In this paper we study h…
▽ More
A new generation of interferometric instruments is emerging which aim to use intensity mapping of redshifted $21\,$cm radiation to measure the large-scale structure of the Universe at $z\simeq 1-2$ over wide areas of sky. While these instruments typically have limited angular resolution, they cover huge volumes and thus can be used to provide large samples of rare objects. In this paper we study how well such instruments could find spatially extended large-scale structures, such as cosmic voids, using a matched filter formalism. Such a formalism allows us to work in Fourier space, the natural space for interferometers, and to study the impact of finite $u-v$ coverage, noise and foregrounds on our ability to recover voids. We find that in the absence of foregrounds such instruments would provide enormous catalogs of voids, with high completeness, but that control of foregrounds is key to realizing this goal.
△ Less
Submitted 5 July, 2017; v1 submitted 26 May, 2017;
originally announced May 2017.
-
The Galaxy Clustering Crisis in Abundance Matching
Authors:
Duncan Campbell,
Frank C. van den Bosch,
Nikhil Padmanabhan,
Yao-Yuan Mao,
Andrew R. Zentner,
Johannes U. Lange,
Fangzhou Jiang,
Antonia Villarreal
Abstract:
Galaxy clustering on small scales is significantly under-predicted by sub-halo abundance matching (SHAM) models that populate (sub-)haloes with galaxies based on peak halo mass, $M_{\rm peak}$. SHAM models based on the peak maximum circular velocity, $V_{\rm peak}$, have had much better success. The primary reason $M_{\rm peak}$ based models fail is the relatively low abundance of satellite galaxi…
▽ More
Galaxy clustering on small scales is significantly under-predicted by sub-halo abundance matching (SHAM) models that populate (sub-)haloes with galaxies based on peak halo mass, $M_{\rm peak}$. SHAM models based on the peak maximum circular velocity, $V_{\rm peak}$, have had much better success. The primary reason $M_{\rm peak}$ based models fail is the relatively low abundance of satellite galaxies produced in these models compared to those based on $V_{\rm peak}$. Despite success in predicting clustering, a simple $V_{\rm peak}$ based SHAM model results in predictions for galaxy growth that are at odds with observations. We evaluate three possible remedies that could "save" mass-based SHAM: (1) SHAM models require a significant population of "orphan" galaxies as a result of artificial disruption/merging of sub-haloes in modern high resolution dark matter simulations; (2) satellites must grow significantly after their accretion; and (3) stellar mass is significantly affected by halo assembly history. No solution is entirely satisfactory. However, regardless of the particulars, we show that popular SHAM models based on $M_{\rm peak}$ cannot be complete physical models as presented. Either $V_{\rm peak}$ truly is a better predictor of stellar mass at $z\sim 0$ and it remains to be seen how the correlation between stellar mass and $V_{\rm peak}$ comes about, or SHAM models are missing vital component(s) that significantly affect galaxy clustering.
△ Less
Submitted 17 May, 2017;
originally announced May 2017.
-
Halo assembly bias from Separate Universe simulations
Authors:
Aseem Paranjape,
Nikhil Padmanabhan
Abstract:
We present a calibration of halo assembly bias using the Separate Universe technique. Specifically, we measure the response of halo abundances at fixed mass and concentration to the presence of an infinite-wavelength initial perturbation. We develop an analytical framework for describing the concentration dependence of this peak-background split halo bias -- a measure of assembly bias -- relying o…
▽ More
We present a calibration of halo assembly bias using the Separate Universe technique. Specifically, we measure the response of halo abundances at fixed mass and concentration to the presence of an infinite-wavelength initial perturbation. We develop an analytical framework for describing the concentration dependence of this peak-background split halo bias -- a measure of assembly bias -- relying on the near-Lognormal distribution of halo concentration at fixed halo mass. The combination of this analytical framework and the Separate Universe technique allows us to achieve very high precision in the calibration of the linear assembly bias $b_1$, and qualitatively reproduces known trends such as the monotonic decrease (increase) of $b_1$ with halo concentration at large (small) masses. The same framework extends to the concentration dependence of higher order bias parameters $b_n$, and we present the first calibration of assembly bias in $b_2$. Our calibrations are directly applicable in analytical Halo Model calculations that seek to robustly detect galaxy assembly bias in observational samples. We detect a non-universality in the $b_1 - b_2$ relation arising from assembly bias, and suggest that simultaneous measurements of these bias parameters could be used to both detect the signature of assembly bias as well as mitigate its effects in cosmological analyses.
△ Less
Submitted 4 April, 2017; v1 submitted 8 December, 2016;
originally announced December 2016.