Showing 1–50 of 444 results for author: Bartlett, J

An "ultimate" coupled cluster method based entirely on $T_2$

Authors: Zachary W. Windom, Ajith Perera, Rodney J. Bartlett

Abstract: Electronic structure methods built around double-electron excitations have a rich history in quantum chemistry. However, it seems to be the case that such methods are only suitable in particular situations and are not naturally equipped to simultaneously handle the variety of electron correlations that might be present in chemical systems. To this end, the current work seeks a computationally effi… ▽ More Electronic structure methods built around double-electron excitations have a rich history in quantum chemistry. However, it seems to be the case that such methods are only suitable in particular situations and are not naturally equipped to simultaneously handle the variety of electron correlations that might be present in chemical systems. To this end, the current work seeks a computationally efficient, low-rank, "ultimate" coupled cluster method based exclusively on $T_2$ and its products which can effectively emulate more "complete" methods that explicitly consider higher-rank, $T_{2m}$ operators. We introduce a hierarchy of methods designed to systematically account for higher, even order cluster operators - like $T_4, T_6, \cdots, T_{2m}$ - by invoking tenets of the factorization theorem of perturbation theory and expectation-value coupled cluster theory. It is shown that each member within this methodological hierarchy is defined such that both the wavefunction and energy are correct through some order in many-body perturbation theory (MBPT), and can be extended up to arbitrarily high orders in $T_2$. The efficacy of such approximations are determined by studying the potential energy surface of several prototypical systems that are chosen to represent both non-dynamic, static, and dynamic correlation regimes. We find that the proposed hierarchy of augmented $T_2$ methods essentially reduce to standard CCD for problems where dynamic electron correlations dominate, but offer improvements in situations where non-dynamic and static correlations become relevant. A notable highlight of this work is that the cheapest methods in this hierarchy - which are correct through fifth-order in MBPT - consistently emulate the behavior of the $\mathcal{O}(N^{10})$ CCDQ method, yet only require a $\mathcal{O}(N^{6})$ algorithm by virtue of factorized intermediates. △ Less

Submitted 11 July, 2024; originally announced July 2024.

Causal Leverage Density: A General Approach to Semantic Information

Authors: Stuart J Bartlett

Abstract: I introduce a new approach to semantic information based upon the influence of erasure operations (interventions) upon distributions of a system's future trajectories through its phase space. Semantic (meaningful) information is distinguished from syntactic information by the property of having some intrinsic causal power on the future of a given system. As Shannon famously stated, syntactic infor… ▽ More I introduce a new approach to semantic information based upon the influence of erasure operations (interventions) upon distributions of a system's future trajectories through its phase space. Semantic (meaningful) information is distinguished from syntactic information by the property of having some intrinsic causal power on the future of a given system. As Shannon famously stated, syntactic information is a simple property of probability distributions (the elementary Shannon expression), or correlations between two subsystems and thus does not tell us anything about the meaning of a given message. Kolchinsky & Wolpert (2018) introduced a powerful framework for computing semantic information, which employs interventions upon the state of a system (either initial or dynamic) to erase syntactic information that might influence the viability of a subsystem (such as an organism in an environment). In this work I adapt this framework such that rather than using the viability of a subsystem, we simply observe the changes in future trajectories through a system's phase space as a result of informational interventions (erasures or scrambling). This allows for a more general formalisation of semantic information that does not assume a primary role for the viability of a subsystem (to use examples from Kolchinsky & Wolpert (2018), a rock, a hurricane, or a cell). Many systems of interest have a semantic component, such as a neural network, but may not have such an intrinsic connection to viability as living organisms or dissipative structures. Hence this simple approach to semantic information could be applied to any living, non-living or technological system in order to quantify whether a given quantity of syntactic information within it also has semantic or causal power. △ Less

Submitted 9 July, 2024; originally announced July 2024.

Factorized Quadruples and a Predictor of Higher-Level Correlation in Thermochemistry

Authors: James H. Thorpe, Zachary W. Windom, Rodney J. Bartlett, Devin A. Matthews

Abstract: Coupled cluster theory has had a momentous impact on the ab initio prediction of molecular properties, and remains a staple ingratiate in high-accuracy thermochemical model chemistries. However, these methods require inclusion of at least some connected quadruple excitations, which generally scale at best as $\mathcal{O}(N^9)$ with the number of basis functions. It very difficult to predict, a pri… ▽ More Coupled cluster theory has had a momentous impact on the ab initio prediction of molecular properties, and remains a staple ingratiate in high-accuracy thermochemical model chemistries. However, these methods require inclusion of at least some connected quadruple excitations, which generally scale at best as $\mathcal{O}(N^9)$ with the number of basis functions. It very difficult to predict, a priori, the effect correlation past CCSD(T) has on a give reaction energies. The purpose of this work is to examine cost-effective quadruple corrections based on the factorization theorem of many-body perturbation theory that may address these challenges. We show that the $\mathcal{O}(N^7)$, factorized CCSD(TQ${}_\text{f}$) method introduces minimal error to predicted correlation and reaction energies as compared to the $\mathcal{O}(N^9)$ CCSD(TQ). Further, we examine the performance of Goodson's continued fraction method in the estimation of CCSDT(Q)${}_Λ$ contributions to reaction energies, as well as a "new" method related to %TAE[(T)] that we refer to as a scaled perturbation estimator. We find that the scaled perturbation estimator based upon CCSD(TQ${}_\text{f}$)/cc-pVDZ is capable of predicting CCSDT(Q)${}_Λ$/cc-pVDZ contributions to reaction energies with an average error of 0.07 kcal mol${}^{-1}$ and a RMST of 0.52 kcal mol${}^{-1}$ when applied to a test-suite of nearly 3000 reactions. This offers a means by which to reliably ballpark how important post-CCSD(T) contributions are to reaction energies while incurring no more than CCSD(T) formal cost and a little mental math. △ Less

Submitted 3 July, 2024; originally announced July 2024.

An attractive way to correct for missing singles excitations in unitary coupled cluster doubles theory

Authors: Zachary W. Windom, Daniel Claudino, Rodney J. Bartlett

Abstract: Coupled cluster methods based exclusively on double excitations are comparatively "cheap" and interesting model chemistries, as they are typically able to capture the bulk of the dynamical electron correlation effects. The trade-off in such approximations is that the effect of neglected excitations, particularly single excitations, can be considerable. Using standard and electron pair-restricted… ▽ More Coupled cluster methods based exclusively on double excitations are comparatively "cheap" and interesting model chemistries, as they are typically able to capture the bulk of the dynamical electron correlation effects. The trade-off in such approximations is that the effect of neglected excitations, particularly single excitations, can be considerable. Using standard and electron pair-restricted $T_2$ operators to define two flavors of unitary coupled cluster doubles (UCCD) methods, we investigate the extent in which missing single excitations can be recovered from low-order corrections in many-body perturbation theory (MBPT) within the unitary coupled cluster (UCC) formalism. Our analysis includes the derivations of finite-order, UCC energy functionals which are used as a basis to define perturbative estimates of missed single excitations. This leads to the novel UCCD[4S] and UCCD[6S] methods, which consider energy corrections for missing singles excitations through fourth- and sixth-order in MBPT, respectively. We also apply the same methodology to the electron pair-restricted ansatz, but the improvements are only marginal. Our findings show that augmenting UCCD with these post hoc perturbative corrections can lead to UCCSD-quality results. △ Less

Submitted 13 June, 2024; originally announced June 2024.

Multiple imputation of missing covariates when using the Fine-Gray model

Authors: Edouard F. Bonneville, Jan Beyersmann, Ruth H. Keogh, Jonathan W. Bartlett, Tim P. Morris, Nicola Polverelli, Liesbeth C. de Wreede, Hein Putter

Abstract: The Fine-Gray model for the subdistribution hazard is commonly used for estimating associations between covariates and competing risks outcomes. When there are missing values in the covariates included in a given model, researchers may wish to multiply impute them. Assuming interest lies in estimating the risk of only one of the competing events, this paper develops a substantive-model-compatible… ▽ More The Fine-Gray model for the subdistribution hazard is commonly used for estimating associations between covariates and competing risks outcomes. When there are missing values in the covariates included in a given model, researchers may wish to multiply impute them. Assuming interest lies in estimating the risk of only one of the competing events, this paper develops a substantive-model-compatible multiple imputation approach that exploits the parallels between the Fine-Gray model and the standard (single-event) Cox model. In the presence of right-censoring, this involves first imputing the potential censoring times for those failing from competing events, and thereafter imputing the missing covariates by leveraging methodology previously developed for the Cox model in the setting without competing risks. In a simulation study, we compared the proposed approach to alternative methods, such as imputing compatibly with cause-specific Cox models. The proposed method performed well (in terms of estimation of both subdistribution log hazard ratios and cumulative incidences) when data were generated assuming proportional subdistribution hazards, and performed satisfactorily when this assumption was not satisfied. The gain in efficiency compared to a complete-case analysis was demonstrated in both the simulation study and in an applied data example on competing outcomes following an allogeneic stem cell transplantation. For individual-specific cumulative incidence estimation, assuming proportionality on the correct scale at the analysis phase appears to be more important than correctly specifying the imputation procedure used to impute the missing covariates. △ Less

Submitted 26 May, 2024; originally announced May 2024.

Bye bye, local bias: the statistics of the halo field are poorly determined by the local mass density

Authors: Deaglan J. Bartlett, Matthew Ho, Benjamin D. Wandelt

Abstract: Bias models relating the dark matter field to the spatial distribution of halos are widely used in current cosmological analyses. Many models predict halos purely from the local Eulerian matter density, yet bias models in perturbation theory require the inclusion of other local properties. We assess the validity of assuming that only the local dark matter density can be used to predict the number… ▽ More Bias models relating the dark matter field to the spatial distribution of halos are widely used in current cosmological analyses. Many models predict halos purely from the local Eulerian matter density, yet bias models in perturbation theory require the inclusion of other local properties. We assess the validity of assuming that only the local dark matter density can be used to predict the number density of halos in a model-independent way and in the non-perturbative regime. Utilising $N$-body simulations, we study the properties of the halo counts field after spatial voxels with near-equal dark matter density have been permuted. If local-in-matter-density biasing were valid, the statistical properties of the permuted and un-permuted fields would be indistinguishable since both represent equally fair draws of the stochastic biasing model. For voxels of side length $\sim4-30\,h^{-1}{\rm\,Mpc}$ and for halos less massive than $\sim10^{15}\,h^{-1}{\rm\,M_\odot}$, we find that the permuted halo field has a scale-dependent bias with greater than 25% more power on scales relevant for current surveys. These bias models remove small-scale power by not modelling correlations between neighbouring voxels, which substantially boosts large-scale power to conserve the field's total variance. This conclusion is robust to the choice of initial conditions and cosmology. Assuming local-in-matter-density halo biasing cannot, therefore, reproduce the distribution of halos across a large range of scales and halo masses, no matter how complex the model. One must either allow the biasing to be a function of other quantities and/or remove the assumption that neighbouring voxels are statistically independent. △ Less

Submitted 21 June, 2024; v1 submitted 1 May, 2024; originally announced May 2024.

Comments: 8 pages, 4 figures. Submitted

The Inefficiency of Genetic Programming for Symbolic Regression -- Extended Version

Authors: Gabriel Kronberger, Fabricio Olivetti de Franca, Harry Desmond, Deaglan J. Bartlett, Lukas Kammerer

Abstract: We analyse the search behaviour of genetic programming for symbolic regression in practically relevant but limited settings, allowing exhaustive enumeration of all solutions. This enables us to quantify the success probability of finding the best possible expressions, and to compare the search efficiency of genetic programming to random search in the space of semantically unique expressions. This… ▽ More We analyse the search behaviour of genetic programming for symbolic regression in practically relevant but limited settings, allowing exhaustive enumeration of all solutions. This enables us to quantify the success probability of finding the best possible expressions, and to compare the search efficiency of genetic programming to random search in the space of semantically unique expressions. This analysis is made possible by improved algorithms for equality saturation, which we use to improve the Exhaustive Symbolic Regression algorithm; this produces the set of semantically unique expression structures, orders of magnitude smaller than the full symbolic regression search space. We compare the efficiency of random search in the set of unique expressions and genetic programming. For our experiments we use two real-world datasets where symbolic regression has been used to produce well-fitting univariate expressions: the Nikuradse dataset of flow in rough pipes and the Radial Acceleration Relation of galaxy dynamics. The results show that genetic programming in such limited settings explores only a small fraction of all unique expressions, and evaluates expressions repeatedly that are congruent to already visited expressions. △ Less

Submitted 26 April, 2024; originally announced April 2024.

Comments: This is an extended version of the article submitted to Parallel Problem Solving from Nature (PPSN) Conference 2024

syren-halofit: A fast, interpretable, high-precision formula for the $Λ$CDM nonlinear matter power spectrum

Authors: Deaglan J. Bartlett, Benjamin D. Wandelt, Matteo Zennaro, Pedro G. Ferreira, Harry Desmond

Abstract: Rapid and accurate evaluation of the nonlinear matter power spectrum, $P(k)$, as a function of cosmological parameters and redshift is of fundamental importance in cosmology. Analytic approximations provide an interpretable solution, yet current approximations are neither fast nor accurate relative to numerical emulators. We use symbolic regression to obtain simple analytic approximations to the n… ▽ More Rapid and accurate evaluation of the nonlinear matter power spectrum, $P(k)$, as a function of cosmological parameters and redshift is of fundamental importance in cosmology. Analytic approximations provide an interpretable solution, yet current approximations are neither fast nor accurate relative to numerical emulators. We use symbolic regression to obtain simple analytic approximations to the nonlinear scale, $k_σ$, the effective spectral index, $n_{\rm eff}$, and the curvature, $C$, which are required for the halofit model. We then re-optimise the coefficients of halofit to fit a wide range of cosmologies and redshifts. We explore the space of analytic expressions to fit the residuals between $P(k)$ and the optimised predictions of halofit. Our results are designed to match the predictions of EuclidEmulator2, but are validated against $N$-body simulations. Our symbolic expressions for $k_σ$, $n_{\rm eff}$ and $C$ have root mean squared fractional errors of 0.8%, 0.2% and 0.3%, respectively, for redshifts below 3 and a wide range of cosmologies. The re-optimised halofit parameters reduce the root mean squared fractional error (compared to EuclidEmulator2) from 3% to below 2% for wavenumbers $k=9\times10^{-3}-9 \, h{\rm Mpc^{-1}}$. We introduce syren-halofit (symbolic-regression-enhanced halofit), an extension to halofit containing a short symbolic correction which improves this error to 1%. Our method is 2350 and 3170 times faster than current halofit and hmcode implementations, respectively, and 2680 and 64 times faster than EuclidEmulator2 (which requires running class) and the BACCO emulator. We obtain comparable accuracy to EuclidEmulator2 and BACCO when tested on $N$-body simulations. Our work greatly increases the speed and accuracy of symbolic approximations to $P(k)$, making them significantly faster than their numerical counterparts without loss of accuracy. △ Less

Submitted 15 April, 2024; v1 submitted 27 February, 2024; originally announced February 2024.

Comments: 11 pages, 8 figures. Accepted for publication in A&A

Journal ref: A&A 686, A150 (2024)

An assessment of frozen natural orbitals and band gaps using equation of motion coupled cluster theory: a case study on polyacene and trans-polyacetylene

Authors: Zachary W. Windom, AV Lam, Ajith Perera, Rodney J. Bartlett

Abstract: Frozen natural orbitals (FNOs) are used to augment IP/EA-EOM-CCSD calculations targeting the band gap of trans-polyacetylene and polyacene. We show the resulting electron affinities (EAs), ionization potentials (IPs), and extrapolated band gaps incur errors that are largely tunable to a desired accuracy, yet require many orders of magnitude fewer core-hours as compared to the corresponding full ca… ▽ More Frozen natural orbitals (FNOs) are used to augment IP/EA-EOM-CCSD calculations targeting the band gap of trans-polyacetylene and polyacene. We show the resulting electron affinities (EAs), ionization potentials (IPs), and extrapolated band gaps incur errors that are largely tunable to a desired accuracy, yet require many orders of magnitude fewer core-hours as compared to the corresponding full calculation. The relationship between various FNO truncation schemes and (cc-pV$n$Z) basis set is also examined. △ Less

Submitted 13 February, 2024; originally announced February 2024.

LtU-ILI: An All-in-One Framework for Implicit Inference in Astrophysics and Cosmology

Authors: Matthew Ho, Deaglan J. Bartlett, Nicolas Chartier, Carolina Cuesta-Lazaro, Simon Ding, Axel Lapel, Pablo Lemos, Christopher C. Lovell, T. Lucas Makinen, Chirag Modi, Viraj Pandya, Shivam Pandey, Lucia A. Perez, Benjamin Wandelt, Greg L. Bryan

Abstract: This paper presents the Learning the Universe Implicit Likelihood Inference (LtU-ILI) pipeline, a codebase for rapid, user-friendly, and cutting-edge machine learning (ML) inference in astrophysics and cosmology. The pipeline includes software for implementing various neural architectures, training schemata, priors, and density estimators in a manner easily adaptable to any research workflow. It i… ▽ More This paper presents the Learning the Universe Implicit Likelihood Inference (LtU-ILI) pipeline, a codebase for rapid, user-friendly, and cutting-edge machine learning (ML) inference in astrophysics and cosmology. The pipeline includes software for implementing various neural architectures, training schemata, priors, and density estimators in a manner easily adaptable to any research workflow. It includes comprehensive validation metrics to assess posterior estimate coverage, enhancing the reliability of inferred results. Additionally, the pipeline is easily parallelizable and is designed for efficient exploration of modeling hyperparameters. To demonstrate its capabilities, we present real applications across a range of astrophysics and cosmology problems, such as: estimating galaxy cluster masses from X-ray photometry; inferring cosmology from matter power spectra and halo point clouds; characterizing progenitors in gravitational wave signals; capturing physical dust parameters from galaxy colors and luminosities; and establishing properties of semi-analytic models of galaxy formation. We also include exhaustive benchmarking and comparisons of all implemented methods as well as discussions about the challenges and pitfalls of ML inference in astronomical sciences. All code and examples are made publicly available at https://github.com/maho3/ltu-ili. △ Less

Submitted 2 July, 2024; v1 submitted 6 February, 2024; originally announced February 2024.

Comments: 22 pages, 10 figures, accepted in the Open Journal of Astrophysics. Code available at https://github.com/maho3/ltu-ili

Journal ref: 2024 OJA, Vol. 7

A new "gold standard": perturbative triples corrections in unitary coupled cluster theory and prospects for quantum computing

Authors: Zachary W. Windom, Daniel Claudino, Rodney J. Bartlett

Abstract: A major difficulty in quantum simulation is the adequate treatment of a large collection of entangled particles, synonymous with electron correlation in electronic structure theory, with coupled cluster (CC) theory being the leading framework in dealing with this problem. Augmenting computationally affordable low-rank approximations in CC theory with a perturbative account of higher-rank excitatio… ▽ More A major difficulty in quantum simulation is the adequate treatment of a large collection of entangled particles, synonymous with electron correlation in electronic structure theory, with coupled cluster (CC) theory being the leading framework in dealing with this problem. Augmenting computationally affordable low-rank approximations in CC theory with a perturbative account of higher-rank excitations is a tractable and effective way of accounting for the missing electron correlation in those approximations. This is perhaps best exemplified by the "gold standard" CCSD(T) method, which bolsters the baseline CCSD with effects of triple excitations using considerations from many-body perturbation theory (MBPT). Despite this established success, such a synergy between MBPT and the unitary analog of CC theory (UCC) has not been explored. In this work, we propose a similar approach wherein converged UCCSD amplitudes, which can be obtained on a quantum computer, are leveraged by a classical computer to evaluate energy corrections associated with triple excitations - leading to the UCCSD[T] and UCCSD(T*) methods. The rationale behind these choices is shown to be rigorous by studying the properties of finite-order UCC energy functionals. Although our efforts do not support the addition of the fifth-order contribution as in the (T) correction, comparisons are nevertheless made using a hybrid UCCSD(T) approach. We assess the performance of these approaches on a collection of small molecules, and demonstrate the benefits of harnessing the inherent synergy between MBPT and UCC theories. △ Less

Submitted 11 January, 2024; originally announced January 2024.

Comments: Main text: 9 pages, 2 figures. Supplementary Material: 9 pages, 3 figures

Experimenting with Large Language Models and vector embeddings in NASA SciX

Authors: Sergi Blanco-Cuaresma, Ioana Ciucă, Alberto Accomazzi, Michael J. Kurtz, Edwin A. Henneken, Kelly E. Lockhart, Felix Grezes, Thomas Allen, Golnaz Shapurian, Carolyn S. Grant, Donna M. Thompson, Timothy W. Hostetler, Matthew R. Templeton, Shinyi Chen, Jennifer Koch, Taylor Jacovich, Daniel Chivvis, Fernanda de Macedo Alves, Jean-Claude Paquin, Jennifer Bartlett, Mugdha Polimera, Stephanie Jarmak

Abstract: Open-source Large Language Models enable projects such as NASA SciX (i.e., NASA ADS) to think out of the box and try alternative approaches for information retrieval and data augmentation, while respecting data copyright and users' privacy. However, when large language models are directly prompted with questions without any context, they are prone to hallucination. At NASA SciX we have developed a… ▽ More Open-source Large Language Models enable projects such as NASA SciX (i.e., NASA ADS) to think out of the box and try alternative approaches for information retrieval and data augmentation, while respecting data copyright and users' privacy. However, when large language models are directly prompted with questions without any context, they are prone to hallucination. At NASA SciX we have developed an experiment where we created semantic vectors for our large collection of abstracts and full-text content, and we designed a prompt system to ask questions using contextual chunks from our system. Based on a non-systematic human evaluation, the experiment shows a lower degree of hallucination and better responses when using Retrieval Augmented Generation. Further exploration is required to design new features and data augmentation processes at NASA SciX that leverages this technology while respecting the high level of trust and quality that the project holds. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: To appear in the proceedings of the 33th annual international Astronomical Data Analysis Software & Systems (ADASS XXXIII)

Nonconvergence of the Feynman-Dyson diagrammatic perturbation expansion of propagators

Authors: So Hirata, Ireneusz Grabowski, J. V. Ortiz, Rodney J. Bartlett

Abstract: Using a general-order ab initio many-body Green's function method, we numerically illustrate several pathological behaviors of the Feynman-Dyson diagrammatic perturbation expansion of one-particle many-body Green's functions as electron Feynman propagators. (i) The perturbation expansion of the frequency-dependent self-energy is not convergent at the exact self-energy in many frequency domains. (i… ▽ More Using a general-order ab initio many-body Green's function method, we numerically illustrate several pathological behaviors of the Feynman-Dyson diagrammatic perturbation expansion of one-particle many-body Green's functions as electron Feynman propagators. (i) The perturbation expansion of the frequency-dependent self-energy is not convergent at the exact self-energy in many frequency domains. (ii) An odd-perturbation-order self-energy has a qualitatively wrong shape and, as a result, many roots of the corresponding Dyson equation are nonphysical in that the poles may be complex or residues can exceed unity or be negative. (iii) A higher even-order self-energy consists of vertical lines at many frequencies, predicting numerous phantom poles with zero residues. (iv) Infinite partial resummations of diagrams by vertex or edge renormalization tend to exacerbate these pathologies. (v) The nonconvergence is caused by the nonanalyticity of the rational-function form of the exact Green's function at many frequencies, where the radius of convergence of its Taylor expansion is zero. This is consistent with the fact that (vi) Padé approximants (power-series expansions of a rational function) can largely restore the correct shape and poles of the Green's function. Nevertheless, not only does the nonconvergence render higher-order Feynman-Dyson diagrammatic perturbation theory useless for many lower-lying ionization or higher-lying electron-attachment states, but it also calls into question the validity of its combined use with the ansätze requiring the knowledge of all poles and residues. Such ansätze include the Galitskii-Migdal identity, the self-consistent Green's function methods, and some models of the algebraic diagrammatic construction. △ Less

Submitted 25 April, 2024; v1 submitted 5 December, 2023; originally announced December 2023.

A precise symbolic emulator of the linear matter power spectrum

Authors: Deaglan J. Bartlett, Lukas Kammerer, Gabriel Kronberger, Harry Desmond, Pedro G. Ferreira, Benjamin D. Wandelt, Bogdan Burlacu, David Alonso, Matteo Zennaro

Abstract: Computing the matter power spectrum, $P(k)$, as a function of cosmological parameters can be prohibitively slow in cosmological analyses, hence emulating this calculation is desirable. Previous analytic approximations are insufficiently accurate for modern applications, so black-box, uninterpretable emulators are often used. We utilise an efficient genetic programming based symbolic regression fra… ▽ More Computing the matter power spectrum, $P(k)$, as a function of cosmological parameters can be prohibitively slow in cosmological analyses, hence emulating this calculation is desirable. Previous analytic approximations are insufficiently accurate for modern applications, so black-box, uninterpretable emulators are often used. We utilise an efficient genetic programming based symbolic regression framework to explore the space of potential mathematical expressions which can approximate the power spectrum and $σ_8$. We learn the ratio between an existing low-accuracy fitting function for $P(k)$ and that obtained by solving the Boltzmann equations and thus still incorporate the physics which motivated this earlier approximation. We obtain an analytic approximation to the linear power spectrum with a root mean squared fractional error of 0.2% between $k = 9\times10^{-3} - 9 \, h{\rm \, Mpc^{-1}}$ and across a wide range of cosmological parameters, and we provide physical interpretations for various terms in the expression. Our analytic approximation is 950 times faster to evaluate than camb and 36 times faster than the neural network based matter power spectrum emulator BACCO. We also provide a simple analytic approximation for $σ_8$ with a similar accuracy, with a root mean squared fractional error of just 0.1% when evaluated across the same range of cosmologies. This function is easily invertible to obtain $A_{\rm s}$ as a function of $σ_8$ and the other cosmological parameters, if preferred. It is possible to obtain symbolic approximations to a seemingly complex function at a precision required for current and future cosmological analyses without resorting to deep-learning techniques, thus avoiding their black-box nature and large number of parameters. Our emulator will be usable long after the codes on which numerical approximations are built become outdated. △ Less

Submitted 15 April, 2024; v1 submitted 27 November, 2023; originally announced November 2023.

Comments: 9 pages, 5 figures. Accepted for publication in A&A

Journal ref: A&A 686, A209 (2024)

Constraining f(R) gravity with cross-correlation of galaxies and cosmic microwave background lensing

Authors: Raphaël Kou, Calum Murray, James G. Bartlett

Abstract: We look for signatures of the Hu-Sawicki f(R) modified gravity theory, proposed to explain the observed accelerated expansion of the universe; in observations of the galaxy distribution, the cosmic microwave background (CMB), and gravitational lensing of the CMB. We study constraints obtained by using observations of only the CMB primary anisotropies, before adding the galaxy power spectrum and it… ▽ More We look for signatures of the Hu-Sawicki f(R) modified gravity theory, proposed to explain the observed accelerated expansion of the universe; in observations of the galaxy distribution, the cosmic microwave background (CMB), and gravitational lensing of the CMB. We study constraints obtained by using observations of only the CMB primary anisotropies, before adding the galaxy power spectrum and its cross-correlation with CMB lensing. We show that cross-correlation of the galaxy distribution with lensing measurements is crucial to breaking parameter degeneracies, placing tighter constraints on the model. In particular, we set a strong upper limit on $\log{\lvert f_{R_0}\lvert }<-4.61$ at 95% confidence level. This means that while the model may explain the accelerated expansion, its impact on large-scale structure closely resembles General Relativity. Studies of this kind with future data sets will probe smaller potential deviations from General Relativity. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Comments: 11 pages, 11 figures, submitted to A&A

Journal ref: A&A 686, A193 (2024)

Optimal Inflationary Potentials

Authors: Tomás Sousa, Deaglan J. Bartlett, Harry Desmond, Pedro G. Ferreira

Abstract: Inflation is a highly favoured theory for the early Universe. It is compatible with current observations of the cosmic microwave background and large scale structure and is a driver in the quest to detect primordial gravitational waves. It is also, given the current quality of the data, highly under-determined with a large number of candidate implementations. We use a new method in symbolic regres… ▽ More Inflation is a highly favoured theory for the early Universe. It is compatible with current observations of the cosmic microwave background and large scale structure and is a driver in the quest to detect primordial gravitational waves. It is also, given the current quality of the data, highly under-determined with a large number of candidate implementations. We use a new method in symbolic regression to generate all possible simple scalar field potentials for one of two possible basis sets of operators. Treating these as single-field, slow-roll inflationary models we then score them with an information-theoretic metric ("minimum description length") that quantifies their efficiency in compressing the information in current data. We explore two possible priors on the parameter space of potentials, one related to the functions' structural complexity and one that uses a Katz back-off language model to prefer functions that may be theoretically motivated. This enables us to identify the inflaton potentials that optimally balance simplicity with accuracy at explaining current data, which may subsequently find theoretical motivation. Our exploratory study opens the door to extraction of fundamental physics directly from data, and may be augmented with more refined theoretical priors in the quest for a complete understanding of the early Universe. △ Less

Submitted 15 April, 2024; v1 submitted 25 October, 2023; originally announced October 2023.

Comments: 13+4 pages, 4 figures; Accepted for publication in Physical Review D

Journal ref: Phys. Rev. D 109, 083524 (2024)

A Joint Fermi-GBM and Swift-BAT Analysis of Gravitational-Wave Candidates from the Third Gravitational-wave Observing Run

Authors: C. Fletcher, J. Wood, R. Hamburg, P. Veres, C. M. Hui, E. Bissaldi, M. S. Briggs, E. Burns, W. H. Cleveland, M. M. Giles, A. Goldstein, B. A. Hristov, D. Kocevski, S. Lesage, B. Mailyan, C. Malacaria, S. Poolakkil, A. von Kienlin, C. A. Wilson-Hodge, The Fermi Gamma-ray Burst Monitor Team, M. Crnogorčević, J. DeLaunay, A. Tohuvavohu, R. Caputo, S. B. Cenko , et al. (1674 additional authors not shown)

Abstract: We present Fermi Gamma-ray Burst Monitor (Fermi-GBM) and Swift Burst Alert Telescope (Swift-BAT) searches for gamma-ray/X-ray counterparts to gravitational wave (GW) candidate events identified during the third observing run of the Advanced LIGO and Advanced Virgo detectors. Using Fermi-GBM on-board triggers and sub-threshold gamma-ray burst (GRB) candidates found in the Fermi-GBM ground analyses,… ▽ More We present Fermi Gamma-ray Burst Monitor (Fermi-GBM) and Swift Burst Alert Telescope (Swift-BAT) searches for gamma-ray/X-ray counterparts to gravitational wave (GW) candidate events identified during the third observing run of the Advanced LIGO and Advanced Virgo detectors. Using Fermi-GBM on-board triggers and sub-threshold gamma-ray burst (GRB) candidates found in the Fermi-GBM ground analyses, the Targeted Search and the Untargeted Search, we investigate whether there are any coincident GRBs associated with the GWs. We also search the Swift-BAT rate data around the GW times to determine whether a GRB counterpart is present. No counterparts are found. Using both the Fermi-GBM Targeted Search and the Swift-BAT search, we calculate flux upper limits and present joint upper limits on the gamma-ray luminosity of each GW. Given these limits, we constrain theoretical models for the emission of gamma-rays from binary black hole mergers. △ Less

Submitted 25 August, 2023; originally announced August 2023.

Estimating hypothetical estimands with causal inference and missing data estimators in a diabetes trial

Authors: Camila Olarte Parra, Rhian M. Daniel, David Wright, Jonathan W. Bartlett

Abstract: The recently published ICH E9 addendum on estimands in clinical trials provides a framework for precisely defining the treatment effect that is to be estimated, but says little about estimation methods. Here we report analyses of a clinical trial in type 2 diabetes, targeting the effects of randomised treatment, handling rescue treatment and discontinuation of randomised treatment using the so-cal… ▽ More The recently published ICH E9 addendum on estimands in clinical trials provides a framework for precisely defining the treatment effect that is to be estimated, but says little about estimation methods. Here we report analyses of a clinical trial in type 2 diabetes, targeting the effects of randomised treatment, handling rescue treatment and discontinuation of randomised treatment using the so-called hypothetical strategy. We show how this can be estimated using mixed models for repeated measures, multiple imputation, inverse probability of treatment weighting, G-formula and G-estimation. We describe their assumptions and practical details of their implementation using packages in R. We report the results of these analyses, broadly finding similar estimates and standard errors across the estimators. We discuss various considerations relevant when choosing an estimation approach, including computational time, how to handle missing data, whether to include post intercurrent event data in the analysis, whether and how to adjust for additional time-varying confounders, and whether and how to model different types of ICE separately. △ Less

Submitted 22 September, 2023; v1 submitted 24 August, 2023; originally announced August 2023.

Recovering high-quality FODs from a reduced number of diffusion-weighted images using a model-driven deep learning architecture

Authors: J Bartlett, C E Davey, L A Johnston, J Duan

Abstract: Fibre orientation distribution (FOD) reconstruction using deep learning has the potential to produce accurate FODs from a reduced number of diffusion-weighted images (DWIs), decreasing total imaging time. Diffusion acquisition invariant representations of the DWI signals are typically used as input to these methods to ensure that they can be applied flexibly to data with different b-vectors and b-… ▽ More Fibre orientation distribution (FOD) reconstruction using deep learning has the potential to produce accurate FODs from a reduced number of diffusion-weighted images (DWIs), decreasing total imaging time. Diffusion acquisition invariant representations of the DWI signals are typically used as input to these methods to ensure that they can be applied flexibly to data with different b-vectors and b-values; however, this means the network cannot condition its output directly on the DWI signal. In this work, we propose a spherical deconvolution network, a model-driven deep learning FOD reconstruction architecture, that ensures intermediate and output FODs produced by the network are consistent with the input DWI signals. Furthermore, we implement a fixel classification penalty within our loss function, encouraging the network to produce FODs that can subsequently be segmented into the correct number of fixels and improve downstream fixel-based analysis. Our results show that the model-based deep learning architecture achieves competitive performance compared to a state-of-the-art FOD super-resolution network, FOD-Net. Moreover, we show that the fixel classification penalty can be tuned to offer improved performance with respect to metrics that rely on accurately segmented of FODs. Our code is publicly available at https://github.com/Jbartlett6/SDNet . △ Less

Submitted 27 July, 2023; originally announced July 2023.

Comments: 10 pages, 7 figures, This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Constraints on dark matter and astrophysics from tomographic $γ$-ray cross-correlations

Authors: Anya Paopiamsap, David Alonso, Deaglan J. Bartlett, Maciej Bilicki

Abstract: We study the cross-correlation between maps of the unresolved $γ$-ray background constructed from the 12-year data release of the Fermi Large-Area Telescope, and the overdensity of galaxies in the redshift range $z\lesssim0.4$ as measured by the 2MASS Photometric Redshift survey and the WISE-SuperCOSMOS photometric survey. A signal is detected at the $8-10σ$ level, which we interpret in terms of b… ▽ More We study the cross-correlation between maps of the unresolved $γ$-ray background constructed from the 12-year data release of the Fermi Large-Area Telescope, and the overdensity of galaxies in the redshift range $z\lesssim0.4$ as measured by the 2MASS Photometric Redshift survey and the WISE-SuperCOSMOS photometric survey. A signal is detected at the $8-10σ$ level, which we interpret in terms of both astrophysical $γ$-ray sources, and WIMP dark matter decay and annihilation. The sensitivity achieved allows us to characterise the energy and redshift dependence of the signal, and we show that the latter is incompatible with a pure dark matter origin. We thus use our measurement to place an upper bound on the WIMP decay rate and the annihilation cross-section, finding constraints that are competitive with those found in other analyses. Our analysis is based on the extraction of clean model-independent observables that can then be used to constrain arbitrary astrophysical and particle physics models. In this sense we produce measurements of the $γ$-ray emissivity as a function of redshift and rest-frame energy $ε$, and of a quantity $F(ε)$ encapsulating all WIMP parameters relevant for dark matter decay or annihilation. We make these measurements, together with a full account of their statistical uncertainties, publicly available. △ Less

Submitted 9 May, 2024; v1 submitted 27 July, 2023; originally announced July 2023.

Comments: 27 pages, 13 figures. Data and code available in https://github.com/anyabua/FermiX

Modeling and testing screening mechanisms in the laboratory and in space

Authors: Valeri Vardanyan, Deaglan J. Bartlett

Abstract: The non-linear dynamics of scalar fields coupled to matter and gravity can lead to remarkable density-dependent screening effects. In this short review we present the main classes of screening mechanisms, and discuss their tests in laboratory and astrophysical systems. We particularly focus on reviewing numerical and technical aspects involved in modeling the non-linear dynamics of screening. In t… ▽ More The non-linear dynamics of scalar fields coupled to matter and gravity can lead to remarkable density-dependent screening effects. In this short review we present the main classes of screening mechanisms, and discuss their tests in laboratory and astrophysical systems. We particularly focus on reviewing numerical and technical aspects involved in modeling the non-linear dynamics of screening. In this review, we focus on tests using laboratory experiments and astrophysical systems, such as stars, galaxies and dark matter halos. △ Less

Submitted 19 July, 2023; v1 submitted 30 May, 2023; originally announced May 2023.

Comments: v1: 35 pages, 7 figures, invited review for Universe. v2: extended references

Journal ref: Universe 2023, 9(7), 340

No evidence for p- or d-wave dark matter annihilation from local large-scale structure

Authors: Andrija Kostić, Deaglan J. Bartlett, Harry Desmond

Abstract: If dark matter annihilates into standard model particles with a cross-section which is velocity dependent, then Local Group dwarf galaxies will not be the best place to search for the resulting gamma ray emission. A greater flux would be produced by more distant and massive halos, with larger velocity dispersions. We construct full-sky predictions for the gamma-ray emission from galaxy- and cluste… ▽ More If dark matter annihilates into standard model particles with a cross-section which is velocity dependent, then Local Group dwarf galaxies will not be the best place to search for the resulting gamma ray emission. A greater flux would be produced by more distant and massive halos, with larger velocity dispersions. We construct full-sky predictions for the gamma-ray emission from galaxy- and cluster-mass halos within $\sim 200 \, {\mathrm{Mpc}}$ using a suite of constrained $N$-body simulations (CSiBORG) based on the Bayesian Origin Reconstruction from Galaxies algorithm. Comparing to observations from the Fermi Large Area Telescope and marginalising over reconstruction uncertainties and other astrophysical contributions to the flux, we obtain constraints on the cross-section which are two (seven) orders of magnitude tighter than those obtained from dwarf spheroidals for $p$-wave ($d$-wave) annihilation. We find no evidence for either type of annihilation from dark matter particles with masses in the range $m_χ= 2-500 \, {\mathrm{GeV}}/c^2$, for any channel. As an example, for annihilations producing bottom quarks with $m_χ= 10 \, {\mathrm{GeV}}/c^2$, we find $a_{1} < 2.4 \times 10^{-21} \, {\mathrm{cm^3 s^{-1}}}$ and $a_{2} < 3.0 \times 10^{-18} \, {\mathrm{cm^3 s^{-1}}}$ at 95% confidence, where the product of the cross-section, $σ$, and relative particle velocity, $v$, is given by $σv = a_\ell (v/c)^{2\ell}$ and $\ell=1, 2$ for $p$-, $d$-wave annihilation, respectively. Our bounds, although failing to exclude the thermal relic cross-section for velocity-dependent annihilation channels, are among the tightest to date. △ Less

Submitted 20 April, 2023; originally announced April 2023.

Comments: 15 pages, 5 figures; submitted to Physical Review D

Search for gravitational-lensing signatures in the full third observing run of the LIGO-Virgo network

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, C. Alléné, A. Allocca, P. A. Altin , et al. (1670 additional authors not shown)

Abstract: Gravitational lensing by massive objects along the line of sight to the source causes distortions of gravitational wave-signals; such distortions may reveal information about fundamental physics, cosmology and astrophysics. In this work, we have extended the search for lensing signatures to all binary black hole events from the third observing run of the LIGO--Virgo network. We search for repeated… ▽ More Gravitational lensing by massive objects along the line of sight to the source causes distortions of gravitational wave-signals; such distortions may reveal information about fundamental physics, cosmology and astrophysics. In this work, we have extended the search for lensing signatures to all binary black hole events from the third observing run of the LIGO--Virgo network. We search for repeated signals from strong lensing by 1) performing targeted searches for subthreshold signals, 2) calculating the degree of overlap amongst the intrinsic parameters and sky location of pairs of signals, 3) comparing the similarities of the spectrograms amongst pairs of signals, and 4) performing dual-signal Bayesian analysis that takes into account selection effects and astrophysical knowledge. We also search for distortions to the gravitational waveform caused by 1) frequency-independent phase shifts in strongly lensed images, and 2) frequency-dependent modulation of the amplitude and phase due to point masses. None of these searches yields significant evidence for lensing. Finally, we use the non-detection of gravitational-wave lensing to constrain the lensing rate based on the latest merger-rate estimates and the fraction of dark matter composed of compact objects. △ Less

Submitted 17 April, 2023; originally announced April 2023.

Comments: 28 pages, 11 figures

Report number: LIGO-P2200031

Priors for symbolic regression

Authors: Deaglan J. Bartlett, Harry Desmond, Pedro G. Ferreira

Abstract: When choosing between competing symbolic models for a data set, a human will naturally prefer the "simpler" expression or the one which more closely resembles equations previously seen in a similar context. This suggests a non-uniform prior on functions, which is, however, rarely considered within a symbolic regression (SR) framework. In this paper we develop methods to incorporate detailed prior… ▽ More When choosing between competing symbolic models for a data set, a human will naturally prefer the "simpler" expression or the one which more closely resembles equations previously seen in a similar context. This suggests a non-uniform prior on functions, which is, however, rarely considered within a symbolic regression (SR) framework. In this paper we develop methods to incorporate detailed prior information on both functions and their parameters into SR. Our prior on the structure of a function is based on a $n$-gram language model, which is sensitive to the arrangement of operators relative to one another in addition to the frequency of occurrence of each operator. We also develop a formalism based on the Fractional Bayes Factor to treat numerical parameter priors in such a way that models may be fairly compared though the Bayesian evidence, and explicitly compare Bayesian, Minimum Description Length and heuristic methods for model selection. We demonstrate the performance of our priors relative to literature standards on benchmarks and a real-world dataset from the field of cosmology. △ Less

Submitted 2 June, 2023; v1 submitted 13 April, 2023; originally announced April 2023.

Comments: 8+2 pages, 2 figures. Accepted for The Genetic and Evolutionary Computation Conference (GECCO) 2023 Workshop on Symbolic Regression

Noise reduction on single-shot images using an autoencoder

Authors: Oliver. J. Bartlett, David. M. Benoit, Kevin. A. Pimbblet, Brooke Simmons, Laura Hunt

Abstract: We present an application of autoencoders to the problem of noise reduction in single-shot astronomical images and explore its suitability for upcoming large-scale surveys. Autoencoders are a machine learning model that summarises an input to identify its key features, then from this knowledge predicts a representation of a different input. The broad aim of our autoencoder model is to retain morph… ▽ More We present an application of autoencoders to the problem of noise reduction in single-shot astronomical images and explore its suitability for upcoming large-scale surveys. Autoencoders are a machine learning model that summarises an input to identify its key features, then from this knowledge predicts a representation of a different input. The broad aim of our autoencoder model is to retain morphological information (e.g., non-parametric morphological information) from the survey data whilst simultaneously reducing the noise contained in the image. We implement an autoencoder with convolutional and maxpooling layers. We test our implementation on images from the Panoramic Survey Telescope and Rapid Response System (Pan-STARRS) that contain varying levels of noise and report how successful our autoencoder is by considering Mean Squared Error (MSE), Structural Similarity Index (SSIM), the second-order moment of the brightest 20 percent of the galaxy's flux M20, and the Gini coefficient, whilst noting how the results vary between the original images, stacked images, and noise reduced images. We show that we are able to reduce noice, over many different targets of observations, whilst retaining the galaxy's morphology, with metric evaluation on a target by target analysis. We establish that this process manages to achieve a positive result in a matter of minutes, and by only using one single shot image compared to multiple survey images found in other noise reduction techniques. △ Less

Submitted 1 March, 2023; originally announced March 2023.

Comments: 13 pages, 6 figures, 6 tables, Accepted for publication in MNRAS

G-formula for causal inference via multiple imputation

Authors: Jonathan W. Bartlett, Camila Olarte Parra, Emily Granger, Ruth H. Keogh, Erik W. van Zwet, Rhian M. Daniel

Abstract: G-formula is a popular approach for estimating treatment or exposure effects from longitudinal data that are subject to time-varying confounding. G-formula estimation is typically performed by Monte-Carlo simulation, with non-parametric bootstrapping used for inference. We show that G-formula can be implemented by exploiting existing methods for multiple imputation (MI) for synthetic data. This in… ▽ More G-formula is a popular approach for estimating treatment or exposure effects from longitudinal data that are subject to time-varying confounding. G-formula estimation is typically performed by Monte-Carlo simulation, with non-parametric bootstrapping used for inference. We show that G-formula can be implemented by exploiting existing methods for multiple imputation (MI) for synthetic data. This involves using an existing modified version of Rubin's variance estimator. In practice missing data is ubiquitous in longitudinal datasets. We show that such missing data can be readily accommodated as part of the MI procedure when using G-formula, and describe how MI software can be used to implement the approach. We explore its performance using a simulation study and an application from cystic fibrosis. △ Less

Submitted 11 October, 2023; v1 submitted 27 January, 2023; originally announced January 2023.

Comments: 28 pages, 6 tables, 2 figures. Updated version includes cystic fibrosis data analysis and some added details on the possibility of obtaining a negative variance estimate

On the functional form of the radial acceleration relation

Authors: Harry Desmond, Deaglan J. Bartlett, Pedro G. Ferreira

Abstract: We apply a new method for learning equations from data -- Exhaustive Symbolic Regression (ESR) -- to late-type galaxy dynamics as encapsulated in the radial acceleration relation (RAR). Relating the centripetal acceleration due to baryons, $g_\text{bar}$, to the total dynamical acceleration, $g_\text{obs}$, the RAR has been claimed to manifest a new law of nature due to its regularity and tightnes… ▽ More We apply a new method for learning equations from data -- Exhaustive Symbolic Regression (ESR) -- to late-type galaxy dynamics as encapsulated in the radial acceleration relation (RAR). Relating the centripetal acceleration due to baryons, $g_\text{bar}$, to the total dynamical acceleration, $g_\text{obs}$, the RAR has been claimed to manifest a new law of nature due to its regularity and tightness, in agreement with Modified Newtonian Dynamics (MOND). Fits to this relation have been restricted by prior expectations to particular functional forms, while ESR affords an exhaustive and nearly prior-free search through functional parameter space to identify the equations optimally trading accuracy with simplicity. Working with the SPARC data, we find the best functions typically satisfy $g_\text{obs} \propto g_\text{bar}$ at high $g_\text{bar}$, although the coefficient of proportionality is not clearly unity and the deep-MOND limit $g_\text{obs} \propto \sqrt{g_\text{bar}}$ as $g_\text{bar} \to 0$ is little evident at all. By generating mock data according to MOND with or without the external field effect, we find that symbolic regression would not be expected to identify the generating function or reconstruct successfully the asymptotic slopes. We conclude that the limited dynamical range and significant uncertainties of the SPARC RAR preclude a definitive statement of its functional form, and hence that this data alone can neither demonstrate nor rule out law-like gravitational behaviour. △ Less

Submitted 1 March, 2023; v1 submitted 11 January, 2023; originally announced January 2023.

Comments: 12+4 pages, 4 figures, 3 tables; minor revision to match MNRAS published version

Journal ref: MNRAS 2023 521 (2): 1817-1831

Helical Organic and Inorganic Polymers

Authors: S. Hirata, Y. Shigeta, S. S. Xantheas, R. J. Bartlett

Abstract: Despite being a staple of synthetic plastics and biomolecules, helical polymers are scarcely studied with Gaussian-basis-set {\it ab initio} electron-correlated methods on an equal footing with molecules. This article introduces an {\it ab initio} second-order many-body Green's-function [MBGF(2)] method with nondiagonal, frequency-dependent Dyson self-energy for infinite helical polymers using scr… ▽ More Despite being a staple of synthetic plastics and biomolecules, helical polymers are scarcely studied with Gaussian-basis-set {\it ab initio} electron-correlated methods on an equal footing with molecules. This article introduces an {\it ab initio} second-order many-body Green's-function [MBGF(2)] method with nondiagonal, frequency-dependent Dyson self-energy for infinite helical polymers using screw-axis-symmetry-adapted Gaussian-spherical-harmonics basis functions. Together with the Gaussian-basis-set density-functional theory for energies, analytical atomic forces, translational-period force, and helical-angle force, it can compute correlated energy, quasiparticle energy bands, structures, and vibrational frequencies of an infinite helical polymer, which smoothly converge at the corresponding oligomer results. These methods can handle incommensurable structures, which have an infinite translational period and are hard to characterize by any other method, just as efficiently as commensurable structures. We apply these methods to polyethylene ($2/1$ helix), polyacetylene (Peierls' system), and polytetrafluoroethylene ($13/6$ helix) to establish the quantitative accuracy of MBGF(2)/cc-pVDZ in simulating their (angle-resolved) ultraviolet photoelectron spectra, and of B3LYP/cc-pVDZ or 6-31G** in reproducing their structures, infrared and Raman band positions, phonon dispersions, and (coherent and incoherent) inelastic neutron scattering spectra. We then predict the same properties for infinitely catenated chains of nitrogen or oxygen and discuss their possible metastable existence under ambient conditions. They include planar zigzag polyazene (N$_2$)$_x$ (Peierls' system), $11/3$-helical isotactic polyazane (NH)$_x$, $9/4$-helical isotactic polyfluoroazane (NF)$_x$, and $7/2$-helical polyoxane (O)$_x$ as potential high-energy-density materials. △ Less

Submitted 10 March, 2023; v1 submitted 15 December, 2022; originally announced December 2022.

Journal ref: J. Phys. Chem. B 2023, 127, 15, 3556-3583

Search for subsolar-mass black hole binaries in the second part of Advanced LIGO's and Advanced Virgo's third observing run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, C. Alléné, A. Allocca, P. A. Altin , et al. (1680 additional authors not shown)

Abstract: We describe a search for gravitational waves from compact binaries with at least one component with mass 0.2 $M_\odot$ -- $1.0 M_\odot$ and mass ratio $q \geq 0.1$ in Advanced LIGO and Advanced Virgo data collected between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. No signals were detected. The most significant candidate has a false alarm rate of 0.2 $\mathrm{yr}^{-1}$. We estimate t… ▽ More We describe a search for gravitational waves from compact binaries with at least one component with mass 0.2 $M_\odot$ -- $1.0 M_\odot$ and mass ratio $q \geq 0.1$ in Advanced LIGO and Advanced Virgo data collected between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. No signals were detected. The most significant candidate has a false alarm rate of 0.2 $\mathrm{yr}^{-1}$. We estimate the sensitivity of our search over the entirety of Advanced LIGO's and Advanced Virgo's third observing run, and present the most stringent limits to date on the merger rate of binary black holes with at least one subsolar-mass component. We use the upper limits to constrain two fiducial scenarios that could produce subsolar-mass black holes: primordial black holes (PBH) and a model of dissipative dark matter. The PBH model uses recent prescriptions for the merger rate of PBH binaries that include a rate suppression factor to effectively account for PBH early binary disruptions. If the PBHs are monochromatically distributed, we can exclude a dark matter fraction in PBHs $f_\mathrm{PBH} \gtrsim 0.6$ (at 90% confidence) in the probed subsolar-mass range. However, if we allow for broad PBH mass distributions we are unable to rule out $f_\mathrm{PBH} = 1$. For the dissipative model, where the dark matter has chemistry that allows a small fraction to cool and collapse into black holes, we find an upper bound $f_{\mathrm{DBH}} < 10^{-5}$ on the fraction of atomic dark matter collapsed into black holes. △ Less

Submitted 26 January, 2024; v1 submitted 2 December, 2022; originally announced December 2022.

Comments: https://dcc.ligo.org/P2200139

Fourier-Net: Fast Image Registration with Band-limited Deformation

Authors: Xi Jia, Joseph Bartlett, Wei Chen, Siyang Song, Tianyang Zhang, Xinxing Cheng, Wenqi Lu, Zhaowen Qiu, Jinming Duan

Abstract: Unsupervised image registration commonly adopts U-Net style networks to predict dense displacement fields in the full-resolution spatial domain. For high-resolution volumetric image data, this process is however resource-intensive and time-consuming. To tackle this problem, we propose the Fourier-Net, replacing the expansive path in a U-Net style network with a parameter-free model-driven decoder.… ▽ More Unsupervised image registration commonly adopts U-Net style networks to predict dense displacement fields in the full-resolution spatial domain. For high-resolution volumetric image data, this process is however resource-intensive and time-consuming. To tackle this problem, we propose the Fourier-Net, replacing the expansive path in a U-Net style network with a parameter-free model-driven decoder. Specifically, instead of our Fourier-Net learning to output a full-resolution displacement field in the spatial domain, we learn its low-dimensional representation in a band-limited Fourier domain. This representation is then decoded by our devised model-driven decoder (consisting of a zero padding layer and an inverse discrete Fourier transform layer) to the dense, full-resolution displacement field in the spatial domain. These changes allow our unsupervised Fourier-Net to contain fewer parameters and computational operations, resulting in faster inference speeds. Fourier-Net is then evaluated on two public 3D brain datasets against various state-of-the-art approaches. For example, when compared to a recent transformer-based method, named TransMorph, our Fourier-Net, which only uses 2.2\% of its parameters and 6.66\% of the multiply-add operations, achieves a 0.5\% higher Dice score and an 11.48 times faster inference speed. Code is available at \url{https://github.com/xi-jia/Fourier-Net}. △ Less

Submitted 6 July, 2023; v1 submitted 29 November, 2022; originally announced November 2022.

Comments: Copyright belongs to AAAI

Exhaustive Symbolic Regression

Authors: Deaglan J. Bartlett, Harry Desmond, Pedro G. Ferreira

Abstract: Symbolic Regression (SR) algorithms attempt to learn analytic expressions which fit data accurately and in a highly interpretable manner. Conventional SR suffers from two fundamental issues which we address here. First, these methods search the space stochastically (typically using genetic programming) and hence do not necessarily find the best function. Second, the criteria used to select the equ… ▽ More Symbolic Regression (SR) algorithms attempt to learn analytic expressions which fit data accurately and in a highly interpretable manner. Conventional SR suffers from two fundamental issues which we address here. First, these methods search the space stochastically (typically using genetic programming) and hence do not necessarily find the best function. Second, the criteria used to select the equation optimally balancing accuracy with simplicity have been variable and subjective. To address these issues we introduce Exhaustive Symbolic Regression (ESR), which systematically and efficiently considers all possible equations -- made with a given basis set of operators and up to a specified maximum complexity -- and is therefore guaranteed to find the true optimum (if parameters are perfectly optimised) and a complete function ranking subject to these constraints. We implement the minimum description length principle as a rigorous method for combining these preferences into a single objective. To illustrate the power of ESR we apply it to a catalogue of cosmic chronometers and the Pantheon+ sample of supernovae to learn the Hubble rate as a function of redshift, finding $\sim$40 functions (out of 5.2 million trial functions) that fit the data more economically than the Friedmann equation. These low-redshift data therefore do not uniquely prefer the expansion history of the standard model of cosmology. We make our code and full equation sets publicly available. △ Less

Submitted 29 May, 2023; v1 submitted 21 November, 2022; originally announced November 2022.

Comments: 15 pages, 7 figures, 2 tables. Accepted for publication in the IEEE Transactions on Evolutionary Computation

Cosmic Census: Relative Distributions of Dark Matter, Galaxies and Diffuse Gas

Authors: Raphaël Kou, James G. Bartlett

Abstract: Galaxies, diffuse gas, and dark matter make up the cosmic web that defines the large-scale structure of the Universe. We constrained the joint distribution of these constituents by cross-correlating galaxy samples binned by stellar mass from the Sloan Digital Sky Survey CMASS catalog with maps of lensing convergence and the thermal Sunyaev-Zeldovich (tSZ) effect from the Planck mission. Fitting a… ▽ More Galaxies, diffuse gas, and dark matter make up the cosmic web that defines the large-scale structure of the Universe. We constrained the joint distribution of these constituents by cross-correlating galaxy samples binned by stellar mass from the Sloan Digital Sky Survey CMASS catalog with maps of lensing convergence and the thermal Sunyaev-Zeldovich (tSZ) effect from the Planck mission. Fitting a halo-based model to our measured angular power spectra (galaxy-galaxy, galaxy-lensing convergence, and galaxy-tSZ) at a median redshift of $z=0.53$, we detected variation with stellar mass of the galaxy satellite fraction and galaxy spatial distribution within host halos. We find a tSZ-halo hydrostatic mass bias, $b_h$, such that $(1-b_h)=0.6\pm0.05$, with a hint of a larger bias, $b_h$, at the high stellar mass end. The normalization of the galaxy-cosmic microwave background lensing convergence cross-power spectrum shows that galaxies trace the matter distribution without an indication of stochasticity ($A=0.98\pm 0.09$). We forecast that next-generation cosmic microwave background experiments will improve the constraints on the hydrostatic bias by a factor of two and will be able to constrain the small-scale distribution of dark matter, hence informing the theory of feedback processes. △ Less

Submitted 25 July, 2023; v1 submitted 14 November, 2022; originally announced November 2022.

Comments: 22 pages, 12 figures

Journal ref: A&A 675, A149 (2023)

Search for gravitational-wave transients associated with magnetar bursts in Advanced LIGO and Advanced Virgo data from the third observing run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, A. Allocca, P. A. Altin , et al. (1645 additional authors not shown)

Abstract: Gravitational waves are expected to be produced from neutron star oscillations associated with magnetar giant flares and short bursts. We present the results of a search for short-duration (milliseconds to seconds) and long-duration ($\sim$ 100 s) transient gravitational waves from 13 magnetar short bursts observed during Advanced LIGO, Advanced Virgo and KAGRA's third observation run. These 13 bu… ▽ More Gravitational waves are expected to be produced from neutron star oscillations associated with magnetar giant flares and short bursts. We present the results of a search for short-duration (milliseconds to seconds) and long-duration ($\sim$ 100 s) transient gravitational waves from 13 magnetar short bursts observed during Advanced LIGO, Advanced Virgo and KAGRA's third observation run. These 13 bursts come from two magnetars, SGR 1935$+$2154 and Swift J1818.0$-$1607. We also include three other electromagnetic burst events detected by Fermi GBM which were identified as likely coming from one or more magnetars, but they have no association with a known magnetar. No magnetar giant flares were detected during the analysis period. We find no evidence of gravitational waves associated with any of these 16 bursts. We place upper bounds on the root-sum-square of the integrated gravitational-wave strain that reach $2.2 \times 10^{-23}$ $/\sqrt{\text{Hz}}$ at 100 Hz for the short-duration search and $8.7 \times 10^{-23}$ $/\sqrt{\text{Hz}}$ at $450$ Hz for the long-duration search, given a detection efficiency of 50%. For a ringdown signal at 1590 Hz targeted by the short-duration search the limit is set to $1.8 \times 10^{-22}$ $/\sqrt{\text{Hz}}$. Using the estimated distance to each magnetar, we derive upper bounds on the emitted gravitational-wave energy of $3.2 \times 10^{43}$ erg ($7.3 \times 10^{43}$ erg) for SGR 1935$+$2154 and $8.2 \times 10^{42}$ erg ($2.8 \times 10^{43}$ erg) for Swift J1818.0$-$1607, for the short-duration (long-duration) search. Assuming isotropic emission of electromagnetic radiation of the burst fluences, we constrain the ratio of gravitational-wave energy to electromagnetic energy for bursts from SGR 1935$+$2154 with available fluence information. The lowest of these ratios is $3 \times 10^3$. △ Less

Submitted 19 October, 2022; originally announced October 2022.

Comments: 30 pages with appendices, 5 figures, 10 tables

Report number: LIGO-P2100387

Total and Partial Differentials as Algebraically Manipulable Entities

Authors: Maria Isabelle Fite, Jonathan Bartlett

Abstract: Differential operators usually result in derivatives expressed as a ratio of differentials. For all but the simplest derivatives, these ratios are typically not algebraically manipulable, but must be held together as a unit in order to prevent contradictions. However, this is primarily a notational and conceptual problem. The work of Abraham Robinson has shown that there is nothing contradictory a… ▽ More Differential operators usually result in derivatives expressed as a ratio of differentials. For all but the simplest derivatives, these ratios are typically not algebraically manipulable, but must be held together as a unit in order to prevent contradictions. However, this is primarily a notational and conceptual problem. The work of Abraham Robinson has shown that there is nothing contradictory about the concept of an infinitesimal differential operating in isolation. In order to make this system extend to all of calculus, however, some tweaks to standard calculus notation are required. Understanding differentials in this way actually provides a more straightforward understanding of all of calculus for students, and minimizes the number of specialized theorems students need to remember, since all terms can be freely manipulated algebraically. △ Less

Submitted 23 September, 2022; originally announced October 2022.

MSC Class: 47E99

Weighted hazard ratio estimation for delayed and diminishing treatment effect

Authors: Bharati Kumar, Jonathan W. Bartlett

Abstract: Non-proportional hazards (NPH) have been observed in confirmatory clinical trials with time to event outcomes. Under NPH, the hazard ratio does not stay constant over time and the log-rank test is no longer the most powerful test. The weighted log-rank test (WLRT) has been introduced to deal with the presence of non-proportionality. We focus our attention on the WLRT and the complementary Cox mode… ▽ More Non-proportional hazards (NPH) have been observed in confirmatory clinical trials with time to event outcomes. Under NPH, the hazard ratio does not stay constant over time and the log-rank test is no longer the most powerful test. The weighted log-rank test (WLRT) has been introduced to deal with the presence of non-proportionality. We focus our attention on the WLRT and the complementary Cox model based on the time-varying treatment effect proposed by Lin and León (2017) (doi: 10.1016/j.conctc.2017.09.004). We will investigate whether the proposed weighted hazard ratio (WHR) approach is unbiased in scenarios where the WLRT statistic is the most powerful test. In the diminishing treatment effect scenario where the WLRT statistic would be most optimal, the time-varying treatment effect estimated by the Cox model estimates the treatment effect very close to the true one. However, when the true hazard ratio is large we note that the proposed model overestimates the treatment effect and the treatment profile over time. However, in the delayed treatment scenario, the estimated treatment effect profile over time is typically close to the true profile. For both scenarios, we have demonstrated analytically that the hazard ratio functions are approximately equal under certain constraints. In conclusion, our results demonstrate that in certain scenarios where a given WLRT would be most powerful, we observe that the WHR from the corresponding Cox model is estimating the treatment effect close to the true one. △ Less

Submitted 23 September, 2022; originally announced September 2022.

Comments: 15 pages with 5 figures

Unravelling the edge spectra of non-Hermitian Chern insulators

Authors: James Bartlett, Erhai Zhao

Abstract: Non-Hermitian Chern insulators differ from their Hermitian cousins in one key aspect: their edge spectra are incredibly rich and confounding. For example, even in the simple case where the bulk spectrum consists of two bands with Chern number $\pm 1$, the edge spectrum in the slab geometry may have one or two edge states on both edges, or only at one of the edges, depending on the model parameters… ▽ More Non-Hermitian Chern insulators differ from their Hermitian cousins in one key aspect: their edge spectra are incredibly rich and confounding. For example, even in the simple case where the bulk spectrum consists of two bands with Chern number $\pm 1$, the edge spectrum in the slab geometry may have one or two edge states on both edges, or only at one of the edges, depending on the model parameters. This blatant violation of the familiar bulk-edge correspondence casts doubt on whether the bulk Chern number can still be a useful topological invariant, and demands a working theory that can predict and explain the myriad of edge spectra from the bulk Hamiltonian to restore the bulk-edge correspondence. We outline how such a theory can be set up to yield a thorough understanding of the edge phase diagram based on the notion of the generalized Brillouin zone (GBZ) and the asymptotic properties of block Toeplitz matrices. The procedure is illustrated by solving and comparing three non-Hermitian generalizations of the Qi-Wu-Zhang model, a canonical example of two-band Chern insulators. We find that, surprisingly, in many cases the phase boundaries and the number and location of the edge states can be obtained analytically. Our analysis also reveals a non-Hermitian semimetal phase whose energy-momentum spectrum forms a continuous membrane with the edge modes transversing the hole, or genus, of the membrane. Subtleties in defining the Chern number over GBZ, which in general is not a smooth manifold and may have singularities, are demonstrated using examples. The approach presented here can be generalized to more complicated models of non-Hermitian insulators or semimetals in two or three dimensions. △ Less

Submitted 3 January, 2023; v1 submitted 14 September, 2022; originally announced September 2022.

Comments: 19 pages, 12 figures

Journal ref: Phys. Rev. B 107, 035101 (2023)

CHAOS VII: A Large-Scale Direct Abundance Study in M33

Authors: Noah S. J. Rogers, Evan D. Skillman, Richard W. Pogge, Danielle A. Berg, Kevin V. Croxall, Jordan Bartlett, Karla Z. Arellano-Córdova, John Moustakas

Abstract: The dispersion in chemical abundances provides a very strong constraint on the processes that drive the chemical enrichment of galaxies. Due to its proximity, the spiral galaxy M33 has been the focus of numerous chemical abundance surveys to study the chemical enrichment and dispersion in abundances over large spatial scales. The CHemical Abundances Of Spirals (CHAOS) project has observed $\sim$10… ▽ More The dispersion in chemical abundances provides a very strong constraint on the processes that drive the chemical enrichment of galaxies. Due to its proximity, the spiral galaxy M33 has been the focus of numerous chemical abundance surveys to study the chemical enrichment and dispersion in abundances over large spatial scales. The CHemical Abundances Of Spirals (CHAOS) project has observed $\sim$100 H II regions in M33 with the Large Binocular Telescope (LBT), producing the largest homogeneous sample of electron temperatures (T$_e$) and direct abundances in this galaxy. Our LBT observations produce a robust oxygen abundance gradient of $-$0.037 $\pm$ 0.007 dex/kpc and indicate a relatively small (0.043 $\pm$ 0.015 dex) intrinsic dispersion in oxygen abundance relative to this gradient. The dispersions in N/H and N/O are similarly small and the abundances of Ne, S, Cl, and Ar relative to O are consistent with the solar ratio as expected for $α$-process or $α$-process-dependent elements. Taken together, the ISM in M33 is chemically well-mixed and homogeneously enriched from inside-out with no evidence of significant abundance variations at a given radius in the galaxy. Our results are compared to those of the numerous studies in the literature, and we discuss possible contaminating sources that can inflate abundance dispersion measurements. Importantly, if abundances are derived from a single T$_e$ measurement and T$_e$-T$_e$ relationships are relied on for inferring the temperature in the unmeasured ionization zone, this can lead to systematic biases which increase the measured dispersion up to 0.11 dex. △ Less

Submitted 8 September, 2022; originally announced September 2022.

Comments: 52 pages, 13 figures, accepted for publication in The Astrophysical Journal

Model-based cross-correlation search for gravitational waves from the low-mass X-ray binary Scorpius X-1 in LIGO O3 data

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, C. Alléné, A. Allocca, P. A. Altin , et al. (1670 additional authors not shown)

Abstract: We present the results of a model-based search for continuous gravitational waves from the low-mass X-ray binary Scorpius X-1 using LIGO detector data from the third observing run of Advanced LIGO, Advanced Virgo and KAGRA. This is a semicoherent search which uses details of the signal model to coherently combine data separated by less than a specified coherence time, which can be adjusted to bala… ▽ More We present the results of a model-based search for continuous gravitational waves from the low-mass X-ray binary Scorpius X-1 using LIGO detector data from the third observing run of Advanced LIGO, Advanced Virgo and KAGRA. This is a semicoherent search which uses details of the signal model to coherently combine data separated by less than a specified coherence time, which can be adjusted to balance sensitivity with computing cost. The search covered a range of gravitational-wave frequencies from 25Hz to 1600Hz, as well as ranges in orbital speed, frequency and phase determined from observational constraints. No significant detection candidates were found, and upper limits were set as a function of frequency. The most stringent limits, between 100Hz and 200Hz, correspond to an amplitude h0 of about 1e-25 when marginalized isotropically over the unknown inclination angle of the neutron star's rotation axis, or less than 4e-26 assuming the optimal orientation. The sensitivity of this search is now probing amplitudes predicted by models of torque balance equilibrium. For the usual conservative model assuming accretion at the surface of the neutron star, our isotropically-marginalized upper limits are close to the predicted amplitude from about 70Hz to 100Hz; the limits assuming the neutron star spin is aligned with the most likely orbital angular momentum are below the conservative torque balance predictions from 40Hz to 200Hz. Assuming a broader range of accretion models, our direct limits on gravitational-wave amplitude delve into the relevant parameter space over a wide range of frequencies, to 500Hz or more. △ Less

Submitted 2 January, 2023; v1 submitted 6 September, 2022; originally announced September 2022.

Comments: 19 pages, Open Access Journal PDF

Report number: LIGO-P2100110-v13

Journal ref: The Astrophysical Journal Letters, 941, L30 (2022)

U-Net vs Transformer: Is U-Net Outdated in Medical Image Registration?

Authors: Xi Jia, Joseph Bartlett, Tianyang Zhang, Wenqi Lu, Zhaowen Qiu, Jinming Duan

Abstract: Due to their extreme long-range modeling capability, vision transformer-based networks have become increasingly popular in deformable image registration. We believe, however, that the receptive field of a 5-layer convolutional U-Net is sufficient to capture accurate deformations without needing long-range dependencies. The purpose of this study is therefore to investigate whether U-Net-based metho… ▽ More Due to their extreme long-range modeling capability, vision transformer-based networks have become increasingly popular in deformable image registration. We believe, however, that the receptive field of a 5-layer convolutional U-Net is sufficient to capture accurate deformations without needing long-range dependencies. The purpose of this study is therefore to investigate whether U-Net-based methods are outdated compared to modern transformer-based approaches when applied to medical image registration. For this, we propose a large kernel U-Net (LKU-Net) by embedding a parallel convolutional block to a vanilla U-Net in order to enhance the effective receptive field. On the public 3D IXI brain dataset for atlas-based registration, we show that the performance of the vanilla U-Net is already comparable with that of state-of-the-art transformer-based networks (such as TransMorph), and that the proposed LKU-Net outperforms TransMorph by using only 1.12% of its parameters and 10.8% of its mult-adds operations. We further evaluate LKU-Net on a MICCAI Learn2Reg 2021 challenge dataset for inter-subject registration, our LKU-Net also outperforms TransMorph on this dataset and ranks first on the public leaderboard as of the submission of this work. With only modest modifications to the vanilla U-Net, we show that U-Net can outperform transformer-based architectures on inter-subject and atlas-based 3D medical image registration. Code is available at https://github.com/xi-jia/LKU-Net. △ Less

Submitted 13 August, 2022; v1 submitted 7 August, 2022; originally announced August 2022.

Comments: Accepted to MICCAI-MLMI 2022

Advances in Prediction of Readmission Rates Using Long Term Short Term Memory Networks on Healthcare Insurance Data

Authors: Shuja Khalid, Francisco Matos, Ayman Abunimer, Joel Bartlett, Richard Duszak, Michal Horny, Judy Gichoya, Imon Banerjee, Hari Trivedi

Abstract: 30-day hospital readmission is a long standing medical problem that affects patients' morbidity and mortality and costs billions of dollars annually. Recently, machine learning models have been created to predict risk of inpatient readmission for patients with specific diseases, however no model exists to predict this risk across all patients. We developed a bi-directional Long Short Term Memory (… ▽ More 30-day hospital readmission is a long standing medical problem that affects patients' morbidity and mortality and costs billions of dollars annually. Recently, machine learning models have been created to predict risk of inpatient readmission for patients with specific diseases, however no model exists to predict this risk across all patients. We developed a bi-directional Long Short Term Memory (LSTM) Network that is able to use readily available insurance data (inpatient visits, outpatient visits, and drug prescriptions) to predict 30 day re-admission for any admitted patient, regardless of reason. The top-performing model achieved an ROC AUC of 0.763 (0.011) when using historical, inpatient, and post-discharge data. The LSTM model significantly outperformed a baseline random forest classifier, indicating that understanding the sequence of events is important for model prediction. Incorporation of 30-days of historical data also significantly improved model performance compared to inpatient data alone, indicating that a patients clinical history prior to admission, including outpatient visits and pharmacy data is a strong contributor to readmission. Our results demonstrate that a machine learning model is able to predict risk of inpatient readmission with reasonable accuracy for all patients using structured insurance billing data. Because billing data or equivalent surrogates can be extracted from sites, such a model could be deployed to identify patients at risk for readmission before they are discharged, or to assign more robust follow up (closer follow up, home health, mailed medications) to at-risk patients after discharge. △ Less

Submitted 30 June, 2022; originally announced July 2022.

Comments: 7 pages, 3 figures, 3 tables

Constraints on dark matter annihilation and decay from the large-scale structure of the nearby universe

Authors: Deaglan J. Bartlett, Andrija Kostić, Harry Desmond, Jens Jasche, Guilhem Lavaux

Abstract: Decaying or annihilating dark matter particles could be detected through gamma-ray emission from the species they decay or annihilate into. This is usually done by modelling the flux from specific dark matter-rich objects such as the Milky Way halo, Local Group dwarfs, and nearby groups. However, these objects are expected to have significant emission from baryonic processes as well, and the analy… ▽ More Decaying or annihilating dark matter particles could be detected through gamma-ray emission from the species they decay or annihilate into. This is usually done by modelling the flux from specific dark matter-rich objects such as the Milky Way halo, Local Group dwarfs, and nearby groups. However, these objects are expected to have significant emission from baryonic processes as well, and the analyses discard gamma-ray data over most of the sky. Here we construct full-sky templates for gamma-ray flux from the large-scale structure within $\sim$200 Mpc by means of a suite of constrained $N$-body simulations (CSiBORG) produced using the Bayesian Origin Reconstruction from Galaxies algorithm. Marginalising over uncertainties in this reconstruction, small-scale structure, and parameters describing astrophysical contributions to the observed gamma-ray sky, we compare to observations from the Fermi Large Area Telescope to constrain dark matter annihilation cross sections and decay rates through a Markov Chain Monte Carlo analysis. We rule out the thermal relic cross section for $s$-wave annihilation for all $m_χ\lesssim 7 {\rm \, GeV}/c^2$ at 95\% confidence if the annihilation produces gluons or quarks less massive than the bottom quark. We infer a contribution to the gamma-ray sky with the same spatial distribution as dark matter decay at $3.3σ$. Although this could be due to dark matter decay via these channels with a decay rate $Γ\approx 6 \times 10^{-28} {\rm \, s^{-1}}$, we find that a power-law spectrum of index $p=-2.75^{+0.71}_{-0.46}$, likely of baryonic origin, is preferred by the data. △ Less

Submitted 30 November, 2022; v1 submitted 25 May, 2022; originally announced May 2022.

Comments: 24 pages, 9 figures, 1 table. Accepted for publication in Physical Review D

Journal ref: Phys. Rev. D 106, 103526 (2022)

Structure Unbiased Adversarial Model for Medical Image Segmentation

Authors: Tianyang Zhang, Shaoming Zheng, Jun Cheng, Xi Jia, Joseph Bartlett, Xinxing Cheng, Huazhu Fu, Zhaowen Qiu, Jiang Liu, Jinming Duan

Abstract: Generative models have been widely proposed in image recognition to generate more images where the distribution is similar to that of the real ones. It often introduces a discriminator network to differentiate the real data from the generated ones. Such models utilise a discriminator network tasked with differentiating style transferred data from data contained in the target dataset. However in do… ▽ More Generative models have been widely proposed in image recognition to generate more images where the distribution is similar to that of the real ones. It often introduces a discriminator network to differentiate the real data from the generated ones. Such models utilise a discriminator network tasked with differentiating style transferred data from data contained in the target dataset. However in doing so the network focuses on discrepancies in the intensity distribution and may overlook structural differences between the datasets. In this paper we formulate a new image-to-image translation problem to ensure that the structure of the generated images is similar to that in the target dataset. We propose a simple, yet powerful Structure-Unbiased Adversarial (SUA) network which accounts for both intensity and structural differences between the training and test sets when performing image segmentation. It consists of a spatial transformation block followed by an intensity distribution rendering module. The spatial transformation block is proposed to reduce the structure gap between the two images, and also produce an inverse deformation field to warp the final segmented image back. The intensity distribution rendering module then renders the deformed structure to an image with the target intensity distribution. Experimental results show that the proposed SUA method has the capability to transfer both intensity distribution and structural content between multiple datasets. △ Less

Submitted 11 August, 2022; v1 submitted 25 May, 2022; originally announced May 2022.

Comments: Will revise the paper and resubmit

Search for continuous gravitational wave emission from the Milky Way center in O3 LIGO--Virgo data

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, A. Allocca, P. A. Altin , et al. (1645 additional authors not shown)

Abstract: We present a directed search for continuous gravitational wave (CW) signals emitted by spinning neutron stars located in the inner parsecs of the Galactic Center (GC). Compelling evidence for the presence of a numerous population of neutron stars has been reported in the literature, turning this region into a very interesting place to look for CWs. In this search, data from the full O3 LIGO--Virgo… ▽ More We present a directed search for continuous gravitational wave (CW) signals emitted by spinning neutron stars located in the inner parsecs of the Galactic Center (GC). Compelling evidence for the presence of a numerous population of neutron stars has been reported in the literature, turning this region into a very interesting place to look for CWs. In this search, data from the full O3 LIGO--Virgo run in the detector frequency band $[10,2000]\rm~Hz$ have been used. No significant detection was found and 95$\%$ confidence level upper limits on the signal strain amplitude were computed, over the full search band, with the deepest limit of about $7.6\times 10^{-26}$ at $\simeq 142\rm~Hz$. These results are significantly more constraining than those reported in previous searches. We use these limits to put constraints on the fiducial neutron star ellipticity and r-mode amplitude. These limits can be also translated into constraints in the black hole mass -- boson mass plane for a hypothetical population of boson clouds around spinning black holes located in the GC. △ Less

Submitted 9 April, 2022; originally announced April 2022.

Comments: 25 pages, 5 figures

Measuring weak lensing masses on individual clusters

Authors: Calum Murray, James G. Bartlett, Emmanuel Artis, Jean-Baptiste Melin

Abstract: We present weak lensing mass estimates for a sample of 458 galaxy clusters from the redMaPPer Sloan Digital Sky Survey DR8 catalogue using Hyper Suprime-Cam weak lensing data. We develop a method to quickly estimate cluster masses from weak lensing shear and use this method to estimate weak lensing masses for each of the galaxy clusters in our sample. Subsequently, we constrain the mass-richness r… ▽ More We present weak lensing mass estimates for a sample of 458 galaxy clusters from the redMaPPer Sloan Digital Sky Survey DR8 catalogue using Hyper Suprime-Cam weak lensing data. We develop a method to quickly estimate cluster masses from weak lensing shear and use this method to estimate weak lensing masses for each of the galaxy clusters in our sample. Subsequently, we constrain the mass-richness relation as well as the intrinsic scatter between the cluster richness and the measured weak lensing masses. When calculating the mass-richness relation for all clusters with a richness $λ>20$, we find a tension in the slope of the mass-richness relation with the Dark Energy Survey Year 1 stacked weak lensing analysis. For a reduced sample of clusters with a richness $λ>40$, our results are consistent with the Dark Energy Survey Year 1 analysis. △ Less

Submitted 5 April, 2022; originally announced April 2022.

Comments: 7 pages, 7 figures. Monthly Notices of the Royal Astronomical Society (2022)

Search for Gravitational Waves Associated with Fast Radio Bursts Detected by CHIME/FRB During the LIGO--Virgo Observing Run O3a

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, the CHIME/FRB Collaboration, :, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca , et al. (1633 additional authors not shown)

Abstract: We search for gravitational-wave transients associated with fast radio bursts (FRBs) detected by the Canadian Hydrogen Intensity Mapping Experiment Fast Radio Burst Project (CHIME/FRB), during the first part of the third observing run of Advanced LIGO and Advanced Virgo (1 April 2019 15:00 UTC-1 Oct 2019 15:00 UTC). Triggers from 22 FRBs were analyzed with a search that targets compact binary coal… ▽ More We search for gravitational-wave transients associated with fast radio bursts (FRBs) detected by the Canadian Hydrogen Intensity Mapping Experiment Fast Radio Burst Project (CHIME/FRB), during the first part of the third observing run of Advanced LIGO and Advanced Virgo (1 April 2019 15:00 UTC-1 Oct 2019 15:00 UTC). Triggers from 22 FRBs were analyzed with a search that targets compact binary coalescences with at least one neutron star component. A targeted search for generic gravitational-wave transients was conducted on 40 FRBs. We find no significant evidence for a gravitational-wave association in either search. Given the large uncertainties in the distances of the FRBs inferred from the dispersion measures in our sample, however, this does not conclusively exclude any progenitor models that include emission of a gravitational wave of the types searched for from any of these FRB events. We report $90\%$ confidence lower bounds on the distance to each FRB for a range of gravitational-wave progenitor models. By combining the inferred maximum distance information for each FRB with the sensitivity of the gravitational-wave searches, we set upper limits on the energy emitted through gravitational waves for a range of emission scenarios. We find values of order $10^{51}$-$10^{57}$ erg for a range of different emission models with central gravitational wave frequencies in the range 70-3560 Hz. Finally, we also found no significant coincident detection of gravitational waves with the repeater, FRB 20200120E, which is the closest known extragalactic FRB. △ Less

Submitted 22 March, 2022; originally announced March 2022.

Comments: 35 pages, 6 figures, 8 tables

Report number: P2100124

Snowmass 2021 CMB-S4 White Paper

Authors: Kevork Abazajian, Arwa Abdulghafour, Graeme E. Addison, Peter Adshead, Zeeshan Ahmed, Marco Ajello, Daniel Akerib, Steven W. Allen, David Alonso, Marcelo Alvarez, Mustafa A. Amin, Mandana Amiri, Adam Anderson, Behzad Ansarinejad, Melanie Archipley, Kam S. Arnold, Matt Ashby, Han Aung, Carlo Baccigalupi, Carina Baker, Abhishek Bakshi, Debbie Bard, Denis Barkats, Darcy Barron, Peter S. Barry , et al. (331 additional authors not shown)

Abstract: This Snowmass 2021 White Paper describes the Cosmic Microwave Background Stage 4 project CMB-S4, which is designed to cross critical thresholds in our understanding of the origin and evolution of the Universe, from the highest energies at the dawn of time through the growth of structure to the present day. We provide an overview of the science case, the technical design, and project plan. This Snowmass 2021 White Paper describes the Cosmic Microwave Background Stage 4 project CMB-S4, which is designed to cross critical thresholds in our understanding of the origin and evolution of the Universe, from the highest energies at the dawn of time through the growth of structure to the present day. We provide an overview of the science case, the technical design, and project plan. △ Less

Submitted 15 March, 2022; originally announced March 2022.

Comments: Contribution to Snowmass 2021. arXiv admin note: substantial text overlap with arXiv:1908.01062, arXiv:1907.04473

First joint observation by the underground gravitational-wave detector, KAGRA, with GEO600

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, A. Allocca, P. A. Altin , et al. (1647 additional authors not shown)

Abstract: We report the results of the first joint observation of the KAGRA detector with GEO600. KAGRA is a cryogenic and underground gravitational-wave detector consisting of a laser interferometer with three-kilometer arms, and located in Kamioka, Gifu, Japan. GEO600 is a British--German laser interferometer with 600 m arms, and located near Hannover, Germany. GEO600 and KAGRA performed a joint observing… ▽ More We report the results of the first joint observation of the KAGRA detector with GEO600. KAGRA is a cryogenic and underground gravitational-wave detector consisting of a laser interferometer with three-kilometer arms, and located in Kamioka, Gifu, Japan. GEO600 is a British--German laser interferometer with 600 m arms, and located near Hannover, Germany. GEO600 and KAGRA performed a joint observing run from April 7 to 20, 2020. We present the results of the joint analysis of the GEO--KAGRA data for transient gravitational-wave signals, including the coalescence of neutron-star binaries and generic unmodeled transients. We also perform dedicated searches for binary coalescence signals and generic transients associated with gamma-ray burst events observed during the joint run. No gravitational-wave events were identified. We evaluate the minimum detectable amplitude for various types of transient signals and the spacetime volume for which the network is sensitive to binary neutron-star coalescences. We also place lower limits on the distances to the gamma-ray bursts analysed based on the non-detection of an associated gravitational-wave signal for several signal models, including binary coalescences. These analyses demonstrate the feasibility and utility of KAGRA as a member of the global gravitational-wave detector network. △ Less

Submitted 19 August, 2022; v1 submitted 2 March, 2022; originally announced March 2022.

Comments: Matches with published version

Report number: LIGO-P2100286

Journal ref: Progress of Theoretical and Experimental Physics, Volume 2022, Issue 6, 063F01 (2022)

The scatter in the galaxy-halo connection: a machine learning analysis

Authors: Richard Stiskalek, Deaglan J. Bartlett, Harry Desmond, Dhayaa Anbajagane

Abstract: We apply machine learning, a powerful method for uncovering complex correlations in high-dimensional data, to the galaxy-halo connection of cosmological hydrodynamical simulations. The mapping between galaxy and halo variables is stochastic in the absence of perfect information, but conventional machine learning models are deterministic and hence cannot capture its intrinsic scatter. To overcome t… ▽ More We apply machine learning, a powerful method for uncovering complex correlations in high-dimensional data, to the galaxy-halo connection of cosmological hydrodynamical simulations. The mapping between galaxy and halo variables is stochastic in the absence of perfect information, but conventional machine learning models are deterministic and hence cannot capture its intrinsic scatter. To overcome this limitation, we design an ensemble of neural networks with a Gaussian loss function that predict probability distributions, allowing us to model statistical uncertainties in the galaxy-halo connection as well as its best-fit trends. We extract a number of galaxy and halo variables from the Horizon-AGN and IllustrisTNG100-1 simulations and quantify the extent to which knowledge of some subset of one enables prediction of the other. This allows us to identify the key features of the galaxy-halo connection and investigate the origin of its scatter in various projections. We find that while halo properties beyond mass account for up to 50 per cent of the scatter in the halo-to-stellar mass relation, the prediction of stellar half-mass radius or total gas mass is not substantially improved by adding further halo properties. We also use these results to investigate semi-analytic models for galaxy size in the two simulations, finding that assumptions relating galaxy size to halo size or spin are not successful. △ Less

Submitted 8 June, 2022; v1 submitted 28 February, 2022; originally announced February 2022.

Comments: 20 pages, 11 figures. Accepted in MNRAS

Estimands and their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions

Authors: Kelly Van Lancker, Sergey Tarima, Jonathan Bartlett, Madeline Bauer, Bharani Bharani-Dharan, Frank Bretz, Nancy Flournoy, Hege Michiels, Camila Olarte Parra, James L Rosenberger, Suzie Cro

Abstract: The COVID-19 pandemic continues to affect the conduct of clinical trials globally. Complications may arise from pandemic-related operational challenges such as site closures, travel limitations and interruptions to the supply chain for the investigational product, or from health-related challenges such as COVID-19 infections. Some of these complications lead to unforeseen intercurrent events in th… ▽ More The COVID-19 pandemic continues to affect the conduct of clinical trials globally. Complications may arise from pandemic-related operational challenges such as site closures, travel limitations and interruptions to the supply chain for the investigational product, or from health-related challenges such as COVID-19 infections. Some of these complications lead to unforeseen intercurrent events in the sense that they affect either the interpretation or the existence of the measurements associated with the clinical question of interest. In this article, we demonstrate how the ICH E9(R1) Addendum on estimands and sensitivity analyses provides a rigorous basis to discuss potential pandemic-related trial disruptions and to embed these disruptions in the context of study objectives and design elements. We introduce several hypothetical estimand strategies and review various causal inference and missing data methods, as well as a statistical method that combines unbiased and possibly biased estimators for estimation. To illustrate, we describe the features of a stylized trial, and how it may have been impacted by the pandemic. This stylized trial will then be re-visited by discussing the changes to the estimand and the estimator to account for pandemic disruptions. Finally, we outline considerations for designing future trials in the context of unforeseen disruptions. △ Less

Submitted 7 February, 2022; originally announced February 2022.

Search for gravitational waves from Scorpius X-1 with a hidden Markov model in O3 LIGO data

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, A. Allocca, P. A. Altin , et al. (1647 additional authors not shown)

Abstract: Results are presented for a semi-coherent search for continuous gravitational waves from the low-mass X-ray binary Scorpius X-1, using a hidden Markov model (HMM) to allow for spin wandering. This search improves on previous HMM-based searches of Laser Interferometer Gravitational-wave Observatory (LIGO) data by including the orbital period in the search template grid, and by analyzing data from t… ▽ More Results are presented for a semi-coherent search for continuous gravitational waves from the low-mass X-ray binary Scorpius X-1, using a hidden Markov model (HMM) to allow for spin wandering. This search improves on previous HMM-based searches of Laser Interferometer Gravitational-wave Observatory (LIGO) data by including the orbital period in the search template grid, and by analyzing data from the latest (third) observing run (O3). In the frequency range searched, from 60 to 500 Hz, we find no evidence of gravitational radiation. This is the most sensitive search for Scorpius X-1 using a HMM to date. For the most sensitive sub-band, starting at $256.06$Hz, we report an upper limit on gravitational wave strain (at $95 \%$ confidence) of $h_{0}^{95\%}=6.16\times10^{-26}$, assuming the orbital inclination angle takes its electromagnetically restricted value $ι=44^{\circ}$. The upper limits on gravitational wave strain reported here are on average a factor of $\sim 3$ lower than in the O2 HMM search. This is the first Scorpius X-1 HMM search with upper limits that reach below the indirect torque-balance limit for certain sub-bands, assuming $ι=44^{\circ}$. △ Less

Submitted 25 January, 2022; originally announced January 2022.

Comments: 23 pages, 5 figures

Report number: LIGO-P2100405