-
A novel approach to detect line emission under high background in high-resolution X-ray spectra
Authors:
Xiangyu Zhang,
Sara Algeri,
Vinay Kashyap,
Margarita Karovska
Abstract:
We develop a novel statistical approach to identify emission features or set upper limits in high-resolution spectra in the presence of high background. The method relies on detecting differences from the background using smooth tests and using classical likelihood ratio tests to characterise known shapes like emission lines. We perform signal detection or place upper limits on line fluxes while a…
▽ More
We develop a novel statistical approach to identify emission features or set upper limits in high-resolution spectra in the presence of high background. The method relies on detecting differences from the background using smooth tests and using classical likelihood ratio tests to characterise known shapes like emission lines. We perform signal detection or place upper limits on line fluxes while accounting for the problem of multiple comparisons. We illustrate the method by applying it to a Chandra LETGS+HRC-S observation of symbiotic star RT Cru, successfully detecting previously known features like the Fe line emission in the 6-7 keV range and the Iridium-edge due to the mirror coating on Chandra. We search for thermal emission lines from Ne X, Fe XVII, O VIII, and O VII, but do not detect them, and place upper limits on their intensities consistent with a $\approx$1 keV plasma. We serendipitously detect a line at 16.93 $\unicode{x212B}$ that we attribute to photoionisation or a reflection component.
△ Less
Submitted 9 March, 2023; v1 submitted 1 February, 2023;
originally announced February 2023.
-
Sequential hypothesis testing for Axion Haloscopes
Authors:
Andrea Gallo Rosso,
Sara Algeri,
Jan Conrad
Abstract:
The goal of this paper is to introduce a novel likelihood-based inferential framework for axion haloscopes which is valid under the commonly applied "rescanning" protocol. The proposed method enjoys short data acquisition times and a simple tuning of the detector configuration. Local statistical significance and power are computed analytically, avoiding the need of burdensome simulations. Adequate…
▽ More
The goal of this paper is to introduce a novel likelihood-based inferential framework for axion haloscopes which is valid under the commonly applied "rescanning" protocol. The proposed method enjoys short data acquisition times and a simple tuning of the detector configuration. Local statistical significance and power are computed analytically, avoiding the need of burdensome simulations. Adequate corrections for the look-elsewhere effect are also discussed. The performance of our inferential strategy is compared with that of a simple method which exploits the geometric probability of rescan. Finally, we exemplify the method with an application to a HAYSTAC type axion haloscope.
△ Less
Submitted 28 October, 2022;
originally announced October 2022.
-
K-2 rotated goodness-of-fit for multivariate data
Authors:
Sara Algeri
Abstract:
Consider a set of multivariate distributions, $F_1,\dots,F_M$, aiming to explain the same phenomenon. For instance, each $F_m$ may correspond to a different candidate background model for calibration data, or to one of many possible signal models we aim to validate on experimental data. In this article, we show that tests for a wide class of apparently different models $F_{m}$ can be mapped into a…
▽ More
Consider a set of multivariate distributions, $F_1,\dots,F_M$, aiming to explain the same phenomenon. For instance, each $F_m$ may correspond to a different candidate background model for calibration data, or to one of many possible signal models we aim to validate on experimental data. In this article, we show that tests for a wide class of apparently different models $F_{m}$ can be mapped into a single test for a reference distribution $Q$. As a result, valid inference for each $F_m$ can be obtained by simulating \underline{only} the distribution of the test statistic under $Q$. Furthermore, $Q$ can be chosen conveniently simple to substantially reduce the computational time.
△ Less
Submitted 5 February, 2022;
originally announced February 2022.
-
Searching for new physics with profile likelihoods: Wilks and beyond
Authors:
Sara Algeri,
Jelle Aalbers,
Knut Dundas Morå,
Jan Conrad
Abstract:
Particle physics experiments use likelihood ratio tests extensively to compare hypotheses and to construct confidence intervals. Often, the null distribution of the likelihood ratio test statistic is approximated by a $χ^2$ distribution, following a theorem due to Wilks. However, many circumstances relevant to modern experiments can cause this theorem to fail. In this paper, we review how to ident…
▽ More
Particle physics experiments use likelihood ratio tests extensively to compare hypotheses and to construct confidence intervals. Often, the null distribution of the likelihood ratio test statistic is approximated by a $χ^2$ distribution, following a theorem due to Wilks. However, many circumstances relevant to modern experiments can cause this theorem to fail. In this paper, we review how to identify these situations and construct valid inference.
△ Less
Submitted 22 November, 2019;
originally announced November 2019.
-
Detecting new signals under background mismodelling
Authors:
Sara Algeri
Abstract:
Searches for new astrophysical phenomena often involve several sources of non-random uncertainties which can lead to highly misleading results. Among these, model-uncertainty arising from background mismodelling can dramatically compromise the sensitivity of the experiment under study. Specifically, overestimating the background distribution in the signal region increases the chances of missing ne…
▽ More
Searches for new astrophysical phenomena often involve several sources of non-random uncertainties which can lead to highly misleading results. Among these, model-uncertainty arising from background mismodelling can dramatically compromise the sensitivity of the experiment under study. Specifically, overestimating the background distribution in the signal region increases the chances of missing new physics. Conversely, underestimating the background outside the signal region leads to an artificially enhanced sensitivity and a higher likelihood of claiming false discoveries. The aim of this work is to provide a unified statistical strategy to perform modelling, estimation, inference, and signal characterization under background mismodelling. The method proposed allows to incorporate the (partial) scientific knowledge available on the background distribution and provides a data-updated version of it in a purely nonparametric fashion without requiring the specification of prior distributions on the parameters. Applications in the context of dark matter searches and radio surveys show how the tools presented in this article can be used to incorporate non-stochastic uncertainty due to instrumental noise and to overcome violations of classical distributional assumptions in stacking experiments.
△ Less
Submitted 2 December, 2019; v1 submitted 15 June, 2019;
originally announced June 2019.
-
Statistical challenges in the search for dark matter
Authors:
Sara Algeri,
Melissa van Beekveld,
Nassim Bozorgnia,
Alyson Brooks,
J. Alberto Casas,
Jessi Cisewski-Kehe,
Francis-Yan Cyr-Racine,
Thomas D. P. Edwards,
Fabio Iocco,
Bradley J. Kavanagh,
Judita Mamužić,
Siddharth Mishra-Sharma,
Wolfgang Rau,
Roberto Ruiz de Austri,
Benjamin R. Safdi,
Pat Scott,
Tracy R. Slatyer,
Yue-Lin Sming Tsai,
Aaron C. Vincent,
Christoph Weniger,
Jennifer Rittenhouse West,
Robert L. Wolpert
Abstract:
The search for the particle nature of dark matter has given rise to a number of experimental, theoretical and statistical challenges. Here, we report on a number of these statistical challenges and new techniques to address them, as discussed in the DMStat workshop held Feb 26 - Mar 3 2018 at the Banff International Research Station for Mathematical Innovation and Discovery (BIRS) in Banff, Albert…
▽ More
The search for the particle nature of dark matter has given rise to a number of experimental, theoretical and statistical challenges. Here, we report on a number of these statistical challenges and new techniques to address them, as discussed in the DMStat workshop held Feb 26 - Mar 3 2018 at the Banff International Research Station for Mathematical Innovation and Discovery (BIRS) in Banff, Alberta.
△ Less
Submitted 24 July, 2018;
originally announced July 2018.
-
Testing One Hypothesis Multiple Times: The Multidimensional Case
Authors:
Sara Algeri,
David A. van Dyk
Abstract:
The identification of new rare signals in data, the detection of a sudden change in a trend, and the selection of competing models, are among the most challenging problems in statistical practice. These challenges can be tackled using a test of hypothesis where a nuisance parameter is present only under the alternative, and a computationally efficient solution can be obtained by the "Testing One H…
▽ More
The identification of new rare signals in data, the detection of a sudden change in a trend, and the selection of competing models, are among the most challenging problems in statistical practice. These challenges can be tackled using a test of hypothesis where a nuisance parameter is present only under the alternative, and a computationally efficient solution can be obtained by the "Testing One Hypothesis Multiple times" (TOHM) method. In the one-dimensional setting, a fine discretization of the space of the non-identifiable parameter is specified, and a global p-value is obtained by approximating the distribution of the supremum of the resulting stochastic process. In this paper, we propose a computationally efficient inferential tool to perform TOHM in the multidimensional setting. Here, the approximations of interest typically involve the expected Euler Characteristics (EC) of the excursion set of the underlying random field. We introduce a simple algorithm to compute the EC in multiple dimensions and for arbitrary large significance levels. This leads to an highly generalizable computational tool to perform inference under non-standard regularity conditions.
△ Less
Submitted 23 June, 2019; v1 submitted 10 March, 2018;
originally announced March 2018.
-
On methods for correcting for the look-elsewhere effect in searches for new physics
Authors:
Sara Algeri,
David A. van Dyk,
Jan Conrad,
Brandon Anderson
Abstract:
The search for new significant peaks over a energy spectrum often involves a statistical multiple hypothesis testing problem. Separate tests of hypothesis are conducted at different locations producing an ensemble of local p-values, the smallest of which is reported as evidence for the new resonance. Unfortunately, controlling the false detection rate (type I error rate) of such procedures may lea…
▽ More
The search for new significant peaks over a energy spectrum often involves a statistical multiple hypothesis testing problem. Separate tests of hypothesis are conducted at different locations producing an ensemble of local p-values, the smallest of which is reported as evidence for the new resonance. Unfortunately, controlling the false detection rate (type I error rate) of such procedures may lead to excessively stringent acceptance criteria. In the recent physics literature, two promising statistical tools have been proposed to overcome these limitations. In 2005, a method to "find needles in haystacks" was introduced by Pilla et al. [1], and a second method was later proposed by Gross and Vitells [2] in the context of the "look elsewhere effect" and trial factors. We show that, for relatively small sample sizes, the former leads to an artificial inflation of statistical power that stems from an increase in the false detection rate, whereas the two methods exhibit similar performance for large sample sizes. We apply the methods to realistic simulations of the Fermi Large Area Telescope data, in particular the search for dark matter annihilation lines. Further, we discuss the counter-intutive scenario where the look-elsewhere corrections are more conservative than much more computationally efficient corrections for multiple hypothesis testing. Finally, we provide general guidelines for navigating the tradeoffs between statistical and computational efficiency when selecting a statistical procedure for signal detection.
△ Less
Submitted 15 December, 2016; v1 submitted 11 February, 2016;
originally announced February 2016.
-
A method for comparing non-nested models with application to astrophysical searches for new physics
Authors:
Sara Algeri,
Jan Conrad,
David A. van Dyk
Abstract:
Searches for unknown physics and decisions between competing astrophysical models to explain data both rely on statistical hypothesis testing. The usual approach in searches for new physical phenomena is based on the statistical Likelihood Ratio Test (LRT) and its asymptotic properties. In the common situation, when neither of the two models under comparison is a special case of the other i.e., wh…
▽ More
Searches for unknown physics and decisions between competing astrophysical models to explain data both rely on statistical hypothesis testing. The usual approach in searches for new physical phenomena is based on the statistical Likelihood Ratio Test (LRT) and its asymptotic properties. In the common situation, when neither of the two models under comparison is a special case of the other i.e., when the hypotheses are non-nested, this test is not applicable. In astrophysics, this problem occurs when two models that reside in different parameter spaces are to be compared. An important example is the recently reported excess emission in astrophysical $γ$-rays and the question whether its origin is known astrophysics or dark matter. We develop and study a new, simple, generally applicable, frequentist method and validate its statistical properties using a suite of simulations studies. We exemplify it on realistic simulated data of the Fermi-LAT $γ$-ray satellite, where non-nested hypotheses testing appears in the search for particle dark matter.
△ Less
Submitted 19 February, 2016; v1 submitted 3 September, 2015;
originally announced September 2015.
