Showing 1–50 of 100 results for author: Battaglia, P

Euclid: Early Release Observations -- Dwarf galaxies in the Perseus galaxy cluster

Authors: F. R. Marleau, J. -C. Cuillandre, M. Cantiello, D. Carollo, P. -A. Duc, R. Habas, L. K. Hunt, P. Jablonka, M. Mirabile, M. Mondelin, M. Poulain, T. Saifollahi, R. Sánchez-Janssen, E. Sola, M. Urbano, R. Zöller, M. Bolzonella, A. Lançon, R. Laureijs, O. Marchal, M. Schirmer, C. Stone, A. Boselli, A. Ferré-Mateu, N. A. Hatch , et al. (171 additional authors not shown)

Abstract: We make use of the unprecedented depth, spatial resolution, and field of view of the Euclid Early Release Observations of the Perseus galaxy cluster to detect and characterise the dwarf galaxy population in this massive system. The Euclid high resolution VIS and combined VIS+NIR colour images were visually inspected and dwarf galaxy candidates were identified. Their morphologies, the presence of n… ▽ More We make use of the unprecedented depth, spatial resolution, and field of view of the Euclid Early Release Observations of the Perseus galaxy cluster to detect and characterise the dwarf galaxy population in this massive system. The Euclid high resolution VIS and combined VIS+NIR colour images were visually inspected and dwarf galaxy candidates were identified. Their morphologies, the presence of nuclei, and their globular cluster (GC) richness were visually assessed, complementing an automatic detection of the GC candidates. Structural and photometric parameters, including Euclid filter colours, were extracted from 2-dimensional fitting. Based on this analysis, a total of 1100 dwarf candidates were found across the image, with 638 appearing to be new identifications. The majority (96%) are classified as dwarf ellipticals, 53% are nucleated, 26% are GC-rich, and 6% show disturbed morphologies. A relatively high fraction of galaxies, 8%, are categorised as ultra-diffuse galaxies. The majority of the dwarfs follow the expected scaling relations. Globally, the GC specific frequency, S_N, of the Perseus dwarfs is intermediate between those measured in the Virgo and Coma clusters. While the dwarfs with the largest GC counts are found throughout the Euclid field of view, those located around the east-west strip, where most of the brightest cluster members are found, exhibit larger S_N values, on average. The spatial distribution of the dwarfs, GCs, and intracluster light show a main iso-density/isophotal centre displaced to the west of the bright galaxy light distribution. The ERO imaging of the Perseus cluster demonstrates the unique capability of Euclid to concurrently detect and characterise large samples of dwarfs, their nuclei, and their GC systems, allowing us to construct a detailed picture of the formation and evolution of galaxies over a wide range of mass scales and environments. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 44 pages, 24 figures, 5 tables, paper submitted to A&A as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. IV. The NISP Calibration Unit

Authors: Euclid Collaboration, F. Hormuth, K. Jahnke, M. Schirmer, C. G. -Y. Lee, T. Scott, R. Barbier, S. Ferriol, W. Gillard, F. Grupp, R. Holmes, W. Holmes, B. Kubik, J. Macias-Perez, M. Laurent, J. Marpaud, M. Marton, E. Medinaceli, G. Morgante, R. Toledo-Moreo, M. Trifoglio, Hans-Walter Rix, A. Secroun, M. Seiffert, P. Stassi , et al. (310 additional authors not shown)

Abstract: The near-infrared calibration unit (NI-CU) on board Euclid's Near-Infrared Spectrometer and Photometer (NISP) is the first astronomical calibration lamp based on light-emitting diodes (LEDs) to be operated in space. Euclid is a mission in ESA's Cosmic Vision 2015-2025 framework, to explore the dark universe and provide a next-level characterisation of the nature of gravitation, dark matter, and da… ▽ More The near-infrared calibration unit (NI-CU) on board Euclid's Near-Infrared Spectrometer and Photometer (NISP) is the first astronomical calibration lamp based on light-emitting diodes (LEDs) to be operated in space. Euclid is a mission in ESA's Cosmic Vision 2015-2025 framework, to explore the dark universe and provide a next-level characterisation of the nature of gravitation, dark matter, and dark energy. Calibrating photometric and spectrometric measurements of galaxies to better than 1.5% accuracy in a survey homogeneously mapping ~14000 deg^2 of extragalactic sky requires a very detailed characterisation of near-infrared (NIR) detector properties, as well their constant monitoring in flight. To cover two of the main contributions - relative pixel-to-pixel sensitivity and non-linearity characteristics - as well as support other calibration activities, NI-CU was designed to provide spatially approximately homogeneous (<12% variations) and temporally stable illumination (0.1%-0.2% over 1200s) over the NISP detector plane, with minimal power consumption and energy dissipation. NI-CU is covers the spectral range ~[900,1900] nm - at cryo-operating temperature - at 5 fixed independent wavelengths to capture wavelength-dependent behaviour of the detectors, with fluence over a dynamic range of >=100 from ~15 ph s^-1 pixel^-1 to >1500 ph s^-1 pixel^-1. For this functionality, NI-CU is based on LEDs. We describe the rationale behind the decision and design process, describe the challenges in sourcing the right LEDs, as well as the qualification process and lessons learned. We also provide a description of the completed NI-CU, its capabilities and performance as well as its limits. NI-CU has been integrated into NISP and the Euclid satellite, and since Euclid's launch in July 2023 has started supporting survey operations. △ Less

Submitted 10 July, 2024; v1 submitted 22 May, 2024; originally announced May 2024.

Comments: Paper accepted for publication in A&A as part of the special issue 'Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. III. The NISP Instrument

Authors: Euclid Collaboration, K. Jahnke, W. Gillard, M. Schirmer, A. Ealet, T. Maciaszek, E. Prieto, R. Barbier, C. Bonoli, L. Corcione, S. Dusini, F. Grupp, F. Hormuth, S. Ligori, L. Martin, G. Morgante, C. Padilla, R. Toledo-Moreo, M. Trifoglio, L. Valenziano, R. Bender, F. J. Castander, B. Garilli, P. B. Lilje, H. -W. Rix , et al. (412 additional authors not shown)

Abstract: The Near-Infrared Spectrometer and Photometer (NISP) on board the Euclid satellite provides multiband photometry and R>=450 slitless grism spectroscopy in the 950-2020nm wavelength range. In this reference article we illuminate the background of NISP's functional and calibration requirements, describe the instrument's integral components, and provide all its key properties. We also sketch the proc… ▽ More The Near-Infrared Spectrometer and Photometer (NISP) on board the Euclid satellite provides multiband photometry and R>=450 slitless grism spectroscopy in the 950-2020nm wavelength range. In this reference article we illuminate the background of NISP's functional and calibration requirements, describe the instrument's integral components, and provide all its key properties. We also sketch the processes needed to understand how NISP operates and is calibrated, and its technical potentials and limitations. Links to articles providing more details and technical background are included. NISP's 16 HAWAII-2RG (H2RG) detectors with a plate scale of 0.3" pix^-1 deliver a field-of-view of 0.57deg^2. In photo mode, NISP reaches a limiting magnitude of ~24.5AB mag in three photometric exposures of about 100s exposure time, for point sources and with a signal-to-noise ratio (SNR) of 5. For spectroscopy, NISP's point-source sensitivity is a SNR = 3.5 detection of an emission line with flux ~2x10^-16erg/s/cm^2 integrated over two resolution elements of 13.4A, in 3x560s grism exposures at 1.6 mu (redshifted Ha). Our calibration includes on-ground and in-flight characterisation and monitoring of detector baseline, dark current, non-linearity, and sensitivity, to guarantee a relative photometric accuracy of better than 1.5%, and relative spectrophotometry to better than 0.7%. The wavelength calibration must be better than 5A. NISP is the state-of-the-art instrument in the NIR for all science beyond small areas available from HST and JWST - and an enormous advance due to its combination of field size and high throughput of telescope and instrument. During Euclid's 6-year survey covering 14000 deg^2 of extragalactic sky, NISP will be the backbone for determining distances of more than a billion galaxies. Its NIR data will become a rich reference imaging and spectroscopy data set for the coming decades. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue 'Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. I. Overview of the Euclid mission

Authors: Euclid Collaboration, Y. Mellier, Abdurro'uf, J. A. Acevedo Barroso, A. Achúcarro, J. Adamek, R. Adam, G. E. Addison, N. Aghanim, M. Aguena, V. Ajani, Y. Akrami, A. Al-Bahlawan, A. Alavi, I. S. Albuquerque, G. Alestas, G. Alguero, A. Allaoui, S. W. Allen, V. Allevato, A. V. Alonso-Tetilla, B. Altieri, A. Alvarez-Candal, A. Amara, L. Amendola , et al. (1086 additional authors not shown)

Abstract: The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14… ▽ More The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14,000 deg^2 of extragalactic sky. In addition to accurate weak lensing and clustering measurements that probe structure formation over half of the age of the Universe, its primary probes for cosmology, these exquisite data will enable a wide range of science. This paper provides a high-level overview of the mission, summarising the survey characteristics, the various data-processing steps, and data products. We also highlight the main science objectives and expected performance. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue`Euclid on Sky'

Euclid: Identifying the reddest high-redshift galaxies in the Euclid Deep Fields with gradient-boosted trees

Authors: T. Signor, G. Rodighiero, L. Bisigello, M. Bolzonella, K. I. Caputi, E. Daddi, G. De Lucia, A. Enia, L. Gabarra, C. Gruppioni, A. Humphrey, F. La Franca, C. Mancini, L. Pozzetti, S. Serjeant, L. Spinoglio, S. E. van Mierlo, S. Andreon, N. Auricchio, M. Baldi, S. Bardelli, P. Battaglia, R. Bender, C. Bodendorf, D. Bonino , et al. (116 additional authors not shown)

Abstract: Dusty, distant, massive ($M_*\gtrsim 10^{11}\,\rm M_\odot$) galaxies are usually found to show a remarkable star-formation activity, contributing on the order of $25\%$ of the cosmic star-formation rate density at $z\approx3$--$5$, and up to $30\%$ at $z\sim7$ from ALMA observations. Nonetheless, they are elusive in classical optical surveys, and current near-infrared surveys are able to detect th… ▽ More Dusty, distant, massive ($M_*\gtrsim 10^{11}\,\rm M_\odot$) galaxies are usually found to show a remarkable star-formation activity, contributing on the order of $25\%$ of the cosmic star-formation rate density at $z\approx3$--$5$, and up to $30\%$ at $z\sim7$ from ALMA observations. Nonetheless, they are elusive in classical optical surveys, and current near-infrared surveys are able to detect them only in very small sky areas. Since these objects have low space densities, deep and wide surveys are necessary to obtain statistically relevant results about them. Euclid will be potentially capable of delivering the required information, but, given the lack of spectroscopic features at these distances within its bands, it is still unclear if it will be possible to identify and characterize these objects. The goal of this work is to assess the capability of Euclid, together with ancillary optical and near-infrared data, to identify these distant, dusty and massive galaxies, based on broadband photometry. We used a gradient-boosting algorithm to predict both the redshift and spectral type of objects at high $z$. To perform such an analysis we make use of simulated photometric observations derived using the SPRITZ software. The gradient-boosting algorithm was found to be accurate in predicting both the redshift and spectral type of objects within the Euclid Deep Survey simulated catalog at $z>2$. In particular, we study the analog of HIEROs (i.e. sources with $H-[4.5]>2.25$), combining Euclid and Spitzer data at the depth of the Deep Fields. We found that the dusty population at $3\lesssim z\lesssim 7$ is well identified, with a redshift RMS and OLF of only $0.55$ and $8.5\%$ ($H_E\leq26$), respectively. Our findings suggest that with Euclid we will obtain meaningful insights into the role of massive and dusty galaxies in the cosmic star-formation rate over time. △ Less

Submitted 5 April, 2024; v1 submitted 7 February, 2024; originally announced February 2024.

Comments: 18 pages, 13 figures, accepted in A&A

Journal ref: A&A 685, A127 (2024)

Euclid preparation: TBD. The pre-launch Science Ground Segment simulation framework

Authors: Euclid Collaboration, S. Serrano, P. Hudelot, G. Seidel, J. E. Pollack, E. Jullo, F. Torradeflot, D. Benielli, R. Fahed, T. Auphan, J. Carretero, H. Aussel, P. Casenove, F. J. Castander, J. E. Davies, N. Fourmanoit, S. Huot, A. Kara, E. Keihanen, S. Kermiche, K. Okumura, J. Zoubian, A. Ealet, A. Boucaud, H. Bretonniere , et al. (251 additional authors not shown)

Abstract: The European Space Agency's Euclid mission is one of the upcoming generation of large-scale cosmology surveys, which will map the large-scale structure in the Universe with unprecedented precision. The development and validation of the SGS pipeline requires state-of-the-art simulations with a high level of complexity and accuracy that include subtle instrumental features not accounted for previous… ▽ More The European Space Agency's Euclid mission is one of the upcoming generation of large-scale cosmology surveys, which will map the large-scale structure in the Universe with unprecedented precision. The development and validation of the SGS pipeline requires state-of-the-art simulations with a high level of complexity and accuracy that include subtle instrumental features not accounted for previously as well as faster algorithms for the large-scale production of the expected Euclid data products. In this paper, we present the Euclid SGS simulation framework as applied in a large-scale end-to-end simulation exercise named Science Challenge 8. Our simulation pipeline enables the swift production of detailed image simulations for the construction and validation of the Euclid mission during its qualification phase and will serve as a reference throughout operations. Our end-to-end simulation framework starts with the production of a large cosmological N-body & mock galaxy catalogue simulation. We perform a selection of galaxies down to I_E=26 and 28 mag, respectively, for a Euclid Wide Survey spanning 165 deg^2 and a 1 deg^2 Euclid Deep Survey. We build realistic stellar density catalogues containing Milky Way-like stars down to H<26. Using the latest instrumental models for both the Euclid instruments and spacecraft as well as Euclid-like observing sequences, we emulate with high fidelity Euclid satellite imaging throughout the mission's lifetime. We present the SC8 data set consisting of overlapping visible and near-infrared Euclid Wide Survey and Euclid Deep Survey imaging and low-resolution spectroscopy along with ground-based. This extensive data set enables end-to-end testing of the entire ground segment data reduction and science analysis pipeline as well as the Euclid mission infrastructure, paving the way to future scientific and technical developments and enhancements. △ Less

Submitted 2 January, 2024; originally announced January 2024.

Comments: 38 pages, 25 figures, A&A submitted

GenCast: Diffusion-based ensemble forecasting for medium-range weather

Authors: Ilan Price, Alvaro Sanchez-Gonzalez, Ferran Alet, Tom R. Andersson, Andrew El-Kadi, Dominic Masters, Timo Ewalds, Jacklynn Stott, Shakir Mohamed, Peter Battaglia, Remi Lam, Matthew Willson

Abstract: Weather forecasts are fundamentally uncertain, so predicting the range of probable weather scenarios is crucial for important decisions, from warning the public about hazardous weather, to planning renewable energy use. Here, we introduce GenCast, a probabilistic weather model with greater skill and speed than the top operational medium-range weather forecast in the world, the European Centre for… ▽ More Weather forecasts are fundamentally uncertain, so predicting the range of probable weather scenarios is crucial for important decisions, from warning the public about hazardous weather, to planning renewable energy use. Here, we introduce GenCast, a probabilistic weather model with greater skill and speed than the top operational medium-range weather forecast in the world, the European Centre for Medium-Range Forecasts (ECMWF)'s ensemble forecast, ENS. Unlike traditional approaches, which are based on numerical weather prediction (NWP), GenCast is a machine learning weather prediction (MLWP) method, trained on decades of reanalysis data. GenCast generates an ensemble of stochastic 15-day global forecasts, at 12-hour steps and 0.25 degree latitude-longitude resolution, for over 80 surface and atmospheric variables, in 8 minutes. It has greater skill than ENS on 97.4% of 1320 targets we evaluated, and better predicts extreme weather, tropical cyclones, and wind power production. This work helps open the next chapter in operational weather forecasting, where critical weather-dependent decisions are made with greater accuracy and efficiency. △ Less

Submitted 1 May, 2024; v1 submitted 25 December, 2023; originally announced December 2023.

Comments: Main text 11 pages, Appendices 76 pages

Neural General Circulation Models for Weather and Climate

Authors: Dmitrii Kochkov, Janni Yuval, Ian Langmore, Peter Norgaard, Jamie Smith, Griffin Mooers, Milan Klöwer, James Lottes, Stephan Rasp, Peter Düben, Sam Hatfield, Peter Battaglia, Alvaro Sanchez-Gonzalez, Matthew Willson, Michael P. Brenner, Stephan Hoyer

Abstract: General circulation models (GCMs) are the foundation of weather and climate prediction. GCMs are physics-based simulators which combine a numerical solver for large-scale dynamics with tuned representations for small-scale processes such as cloud formation. Recently, machine learning (ML) models trained on reanalysis data achieved comparable or better skill than GCMs for deterministic weather fore… ▽ More General circulation models (GCMs) are the foundation of weather and climate prediction. GCMs are physics-based simulators which combine a numerical solver for large-scale dynamics with tuned representations for small-scale processes such as cloud formation. Recently, machine learning (ML) models trained on reanalysis data achieved comparable or better skill than GCMs for deterministic weather forecasting. However, these models have not demonstrated improved ensemble forecasts, or shown sufficient stability for long-term weather and climate simulations. Here we present the first GCM that combines a differentiable solver for atmospheric dynamics with ML components, and show that it can generate forecasts of deterministic weather, ensemble weather and climate on par with the best ML and physics-based methods. NeuralGCM is competitive with ML models for 1-10 day forecasts, and with the European Centre for Medium-Range Weather Forecasts ensemble prediction for 1-15 day forecasts. With prescribed sea surface temperature, NeuralGCM can accurately track climate metrics such as global mean temperature for multiple decades, and climate forecasts with 140 km resolution exhibit emergent phenomena such as realistic frequency and trajectories of tropical cyclones. For both weather and climate, our approach offers orders of magnitude computational savings over conventional GCMs. Our results show that end-to-end deep learning is compatible with tasks performed by conventional GCMs, and can enhance the large-scale physical simulations that are essential for understanding and predicting the Earth system. △ Less

Submitted 7 March, 2024; v1 submitted 13 November, 2023; originally announced November 2023.

Comments: 92 pages, 54 figures

Euclid's Near-Infrared Spectrometer and Photometer ready for flight -- review of final performance

Authors: E. Medinaceli, L. Valenziano, N. Auricchio, E. Franceschi, F. Gianotti, P. Battaglia, R. Farinelli, A. Balestra, S. Dusini, C. Sirignano, E. Borsato, L. Stanco, A. Renzi, A. Troja, L. Gabarra, S. Ligori, V. Capobianco, L. Corcione, D. Bonino, G. Sirri, L. Patrizii, M. Tenti, D. Di Ferdinando, C. Valieri, N. Mauri , et al. (22 additional authors not shown)

Abstract: ESA's mission Euclid, while undertaking its final integration stage, is fully qualified. Euclid will perform an extragalactic survey ($0<z<2$) by observing in the visible and near-infrared wavelength range. To detect infrared radiation, it is equipped with the Near Infrared Spectrometer and Photometer (NISP) instrument, operating in the 0.9--2 $μ$m range. In this paper, after introducing the surve… ▽ More ESA's mission Euclid, while undertaking its final integration stage, is fully qualified. Euclid will perform an extragalactic survey ($0<z<2$) by observing in the visible and near-infrared wavelength range. To detect infrared radiation, it is equipped with the Near Infrared Spectrometer and Photometer (NISP) instrument, operating in the 0.9--2 $μ$m range. In this paper, after introducing the survey strategy, we focus our attention on the NISP Data Processing Unit's Application Software, highlighting the experimental process to obtain the final parametrization of the on-board processing of data produced by the array of 16 Teledyne HAWAII-2RG (HgCdTe) detectors. We report results from the latest ground test campaigns with the flight configuration hardware - complete optical system (Korsh anastigmat telescope), detectors array (0.56 deg$^2$ field of view), and readout systems (16 Digital Control Units and Sidecar ASICs). The performance of the on-board processing is then presented. We also describe a major issue found during the final test phase. We show how the problem was identified and solved thanks to an intensive coordinated effort of an independent review `Tiger' team, lead by ESA, and a team of NISP experts from the Euclid Consortium. An extended PLM level campaign at ambient temperature in Liège and a dedicated test campaign conducted in Marseille on the NISP EQM model eventually confirmed the resolution of the problem. Finally, we report examples of the outstanding spectrometric (using a Blue and two Red Grisms) and photometric performance of the NISP instrument, as derived from the end-to-end payload module test campaign at FOCAL 5 -- CSL; these results include the photometric Point Spread Function (PSF) determination and the spectroscopic dispersion verification. △ Less

Submitted 6 November, 2023; originally announced November 2023.

Comments: 12 pages, 14 figures

Journal ref: Proc. SPIE 12180, Space Telescopes and Instrumentation 2022: Optical, Infrared, and Millimeter Wave, 121801L (27 August 2022)

Euclid: The search for primordial features

Authors: M. Ballardini, Y. Akrami, F. Finelli, D. Karagiannis, B. Li, Y. Li, Z. Sakr, D. Sapone, A. Achúcarro, M. Baldi, N. Bartolo, G. Cañas-Herrera, S. Casas, R. Murgia, H. A. Winther, M. Viel, A. Andrews, J. Jasche, G. Lavaux, D. K. Hazra, D. Paoletti, J. Valiviita, A. Amara, S. Andreon, N. Auricchio , et al. (104 additional authors not shown)

Abstract: Primordial features, in particular oscillatory signals, imprinted in the primordial power spectrum of density perturbations represent a clear window of opportunity for detecting new physics at high-energy scales. Future spectroscopic and photometric measurements from the $Euclid$ space mission will provide unique constraints on the primordial power spectrum, thanks to the redshift coverage and hig… ▽ More Primordial features, in particular oscillatory signals, imprinted in the primordial power spectrum of density perturbations represent a clear window of opportunity for detecting new physics at high-energy scales. Future spectroscopic and photometric measurements from the $Euclid$ space mission will provide unique constraints on the primordial power spectrum, thanks to the redshift coverage and high-accuracy measurement of nonlinear scales, thus allowing us to investigate deviations from the standard power-law primordial power spectrum. We consider two models with primordial undamped oscillations superimposed on the matter power spectrum, one linearly spaced in $k$-space the other logarithmically spaced in $k$-space. We forecast uncertainties applying a Fisher matrix method to spectroscopic galaxy clustering, weak lensing, photometric galaxy clustering, cross correlation between photometric probes, spectroscopic galaxy clustering bispectrum, CMB temperature and $E$-mode polarization, temperature-polarization cross correlation, and CMB weak lensing. We also study a nonlinear density reconstruction method to retrieve the oscillatory signals in the primordial power spectrum. We find the following percentage relative errors in the feature amplitude with $Euclid$ primary probes for the linear (logarithmic) feature model: 21% (22%) in the pessimistic settings and 18% (18%) in the optimistic settings at 68.3% confidence level (CL) using GC$_{\rm sp}$+WL+GC$_{\rm ph}$+XC. Combining all the sources of information explored expected from $Euclid$ in combination with future SO-like CMB experiment, we forecast ${\cal A}_{\rm lin} \simeq 0.010 \pm 0.001$ at 68.3% CL and ${\cal A}_{\rm log} \simeq 0.010 \pm 0.001$ for GC$_{\rm sp}$(PS rec + BS)+WL+GC$_{\rm ph}$+XC+SO-like both for the optimistic and pessimistic settings over the frequency range $(1,\,10^{2.1})$. △ Less

Submitted 29 March, 2024; v1 submitted 29 September, 2023; originally announced September 2023.

Comments: 23 pages, 9 figures, 4 tables

Journal ref: A&A 683, A220 (2024)

Diffusion Generative Inverse Design

Authors: Marin Vlastelica, Tatiana López-Guevara, Kelsey Allen, Peter Battaglia, Arnaud Doucet, Kimberley Stachenfeld

Abstract: Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the system state will evolve over time, and the design challenge is to optimize the initial conditions that lead to a target outcome. Recent developments in learned… ▽ More Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the system state will evolve over time, and the design challenge is to optimize the initial conditions that lead to a target outcome. Recent developments in learned simulation have shown that graph neural networks (GNNs) can be used for accurate, efficient, differentiable estimation of simulator dynamics, and support high-quality design optimization with gradient- or sampling-based optimization procedures. However, optimizing designs from scratch requires many expensive model queries, and these procedures exhibit basic failures on either non-convex or high-dimensional problems. In this work, we show how denoising diffusion models (DDMs) can be used to solve inverse design problems efficiently and propose a particle sampling algorithm for further improving their efficiency. We perform experiments on a number of fluid dynamics design challenges, and find that our approach substantially reduces the number of calls to the simulator compared to standard techniques. △ Less

Submitted 18 September, 2023; v1 submitted 5 September, 2023; originally announced September 2023.

Comments: ICML workshop on Structured Probabilistic Inference & Generative Modeling

WeatherBench 2: A benchmark for the next generation of data-driven global weather models

Authors: Stephan Rasp, Stephan Hoyer, Alexander Merose, Ian Langmore, Peter Battaglia, Tyler Russel, Alvaro Sanchez-Gonzalez, Vivian Yang, Rob Carver, Shreya Agrawal, Matthew Chantry, Zied Ben Bouallegue, Peter Dueben, Carla Bromberg, Jared Sisk, Luke Barrington, Aaron Bell, Fei Sha

Abstract: WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and… ▽ More WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and state-of-the-art models: https://sites.research.google/weatherbench. This paper describes the design principles of the evaluation framework and presents results for current state-of-the-art physical and data-driven weather models. The metrics are based on established practices for evaluating weather forecasts at leading operational weather centers. We define a set of headline scores to provide an overview of model performance. In addition, we also discuss caveats in the current evaluation setup and challenges for the future of data-driven weather forecasting. △ Less

Submitted 26 January, 2024; v1 submitted 29 August, 2023; originally announced August 2023.

Euclid preparation. XXIX. Water ice in spacecraft part I: The physics of ice formation and contamination

Authors: Euclid Collaboration, M. Schirmer, K. Thürmer, B. Bras, M. Cropper, J. Martin-Fleitas, Y. Goueffon, R. Kohley, A. Mora, M. Portaluppi, G. D. Racca, A. D. Short, S. Szmolka, L. M. Gaspar Venancio, M. Altmann, Z. Balog, U. Bastian, M. Biermann, D. Busonero, C. Fabricius, F. Grupp, C. Jordi, W. Löffler, A. Sagristà Sellés, N. Aghanim , et al. (196 additional authors not shown)

Abstract: Molecular contamination is a well-known problem in space flight. Water is the most common contaminant and alters numerous properties of a cryogenic optical system. Too much ice means that Euclid's calibration requirements and science goals cannot be met. Euclid must then be thermally decontaminated, a long and risky process. We need to understand how iced optics affect the data and when a decontam… ▽ More Molecular contamination is a well-known problem in space flight. Water is the most common contaminant and alters numerous properties of a cryogenic optical system. Too much ice means that Euclid's calibration requirements and science goals cannot be met. Euclid must then be thermally decontaminated, a long and risky process. We need to understand how iced optics affect the data and when a decontamination is required. This is essential to build adequate calibration and survey plans, yet a comprehensive analysis in the context of an astrophysical space survey has not been done before. In this paper we look at other spacecraft with well-documented outgassing records, and we review the formation of thin ice films. A mix of amorphous and crystalline ices is expected for Euclid. Their surface topography depends on the competing energetic needs of the substrate-water and the water-water interfaces, and is hard to predict with current theories. We illustrate that with scanning-tunnelling and atomic-force microscope images. Industrial tools exist to estimate contamination, and we must understand their uncertainties. We find considerable knowledge errors on the diffusion and sublimation coefficients, limiting the accuracy of these tools. We developed a water transport model to compute contamination rates in Euclid, and find general agreement with industry estimates. Tests of the Euclid flight hardware in space simulators did not pick up contamination signals; our in-flight calibrations observations will be much more sensitive. We must understand the link between the amount of ice on the optics and its effect on Euclid's data. Little research is available about this link, possibly because other spacecraft can decontaminate easily, quenching the need for a deeper understanding. In our second paper we quantify the various effects of iced optics on spectrophotometric data. △ Less

Submitted 23 May, 2023; v1 submitted 17 May, 2023; originally announced May 2023.

Comments: 35 pages, 22 figures, A&A in press. Changes to previous version: language edits, added Z. Bolag as author in the arxiv PDF (was listed in the ASCII author list and in the journal PDF, but not in the arxiv PDF). This version is identical to the journal version

Journal ref: A&A 675, A142 (2023)

GraphCast: Learning skillful medium-range global weather forecasting

Authors: Remi Lam, Alvaro Sanchez-Gonzalez, Matthew Willson, Peter Wirnsberger, Meire Fortunato, Ferran Alet, Suman Ravuri, Timo Ewalds, Zach Eaton-Rosen, Weihua Hu, Alexander Merose, Stephan Hoyer, George Holland, Oriol Vinyals, Jacklynn Stott, Alexander Pritzel, Shakir Mohamed, Peter Battaglia

Abstract: Global medium-range weather forecasting is critical to decision-making across many social and economic domains. Traditional numerical weather prediction uses increased compute resources to improve forecast accuracy, but cannot directly use historical weather data to improve the underlying model. We introduce a machine learning-based method called "GraphCast", which can be trained directly from rea… ▽ More Global medium-range weather forecasting is critical to decision-making across many social and economic domains. Traditional numerical weather prediction uses increased compute resources to improve forecast accuracy, but cannot directly use historical weather data to improve the underlying model. We introduce a machine learning-based method called "GraphCast", which can be trained directly from reanalysis data. It predicts hundreds of weather variables, over 10 days at 0.25 degree resolution globally, in under one minute. We show that GraphCast significantly outperforms the most accurate operational deterministic systems on 90% of 1380 verification targets, and its forecasts support better severe event prediction, including tropical cyclones, atmospheric rivers, and extreme temperatures. GraphCast is a key advance in accurate and efficient weather forecasting, and helps realize the promise of machine learning for modeling complex dynamical systems. △ Less

Submitted 4 August, 2023; v1 submitted 24 December, 2022; originally announced December 2022.

Comments: GraphCast code and trained weights are available at: https://github.com/deepmind/graphcast

Learning rigid dynamics with face interaction graph networks

Authors: Kelsey R. Allen, Yulia Rubanova, Tatiana Lopez-Guevara, William Whitney, Alvaro Sanchez-Gonzalez, Peter Battaglia, Tobias Pfaff

Abstract: Simulating rigid collisions among arbitrary shapes is notoriously difficult due to complex geometry and the strong non-linearity of the interactions. While graph neural network (GNN)-based models are effective at learning to simulate complex physical dynamics, such as fluids, cloth and articulated bodies, they have been less effective and efficient on rigid-body physics, except with very simple sh… ▽ More Simulating rigid collisions among arbitrary shapes is notoriously difficult due to complex geometry and the strong non-linearity of the interactions. While graph neural network (GNN)-based models are effective at learning to simulate complex physical dynamics, such as fluids, cloth and articulated bodies, they have been less effective and efficient on rigid-body physics, except with very simple shapes. Existing methods that model collisions through the meshes' nodes are often inaccurate because they struggle when collisions occur on faces far from nodes. Alternative approaches that represent the geometry densely with many particles are prohibitively expensive for complex shapes. Here we introduce the Face Interaction Graph Network (FIGNet) which extends beyond GNN-based methods, and computes interactions between mesh faces, rather than nodes. Compared to learned node- and particle-based methods, FIGNet is around 4x more accurate in simulating complex shape interactions, while also 8x more computationally efficient on sparse, rigid meshes. Moreover, FIGNet can learn frictional dynamics directly from real-world data, and can be more accurate than analytical solvers given modest amounts of training data. FIGNet represents a key step forward in one of the few remaining physical domains which have seen little competition from learned simulators, and offers allied fields such as robotics, graphics and mechanical design a new tool for simulation and model-based planning. △ Less

Submitted 7 December, 2022; originally announced December 2022.

Euclid Near Infrared Spectrometer and Photometer instrument flight model presentation, performance and ground calibration results summary

Authors: T. Maciaszek, A. Ealet, W. Gillard, K. Jahnke, R. Barbier, E. Prieto, W. Bon, A. Bonnefoi, A. Caillat, M. Carle, A. Costille, F. Ducret, C. Fabron, B. Foulon, J. L. Gimenez, E. Grassi, M. Jaquet, D. Le Mignant, L. Martin, T. Pamplona, P. Sanchez, J. C. Clémens, L. Caillat, M. Niclas, A. Secroun , et al. (73 additional authors not shown)

Abstract: The NISP (Near Infrared Spectrometer and Photometer) is one of the two Euclid instruments. It operates in the near-IR spectral region (950-2020nm) as a photometer and spectrometer. The instrument is composed of: a cold (135 K) optomechanical subsystem consisting of a Silicon carbide structure, an optical assembly, a filter wheel mechanism, a grism wheel mechanism, a calibration unit, and a thermal… ▽ More The NISP (Near Infrared Spectrometer and Photometer) is one of the two Euclid instruments. It operates in the near-IR spectral region (950-2020nm) as a photometer and spectrometer. The instrument is composed of: a cold (135 K) optomechanical subsystem consisting of a Silicon carbide structure, an optical assembly, a filter wheel mechanism, a grism wheel mechanism, a calibration unit, and a thermal control system, a detection system based on a mosaic of 16 H2RG with their front-end readout electronic, and a warm electronic system (290 K) composed of a data processing / detector control unit and of an instrument control unit that interfaces with the spacecraft via a 1553 bus for command and control and via Spacewire links for science data. This paper presents: the final architecture of the flight model instrument and subsystems, and the performance and the ground calibration measurement done at NISP level and at Euclid Payload Module level at operational cold temperature. △ Less

Submitted 18 October, 2022; originally announced October 2022.

Comments: 18 pages, to appear in Proceedings of the SPIE

Journal ref: Proceedings of the SPIE, Volume 12180, id. 121801K 18 pp. (2022)

MultiScale MeshGraphNets

Authors: Meire Fortunato, Tobias Pfaff, Peter Wirnsberger, Alexander Pritzel, Peter Battaglia

Abstract: In recent years, there has been a growing interest in using machine learning to overcome the high cost of numerical simulation, with some learned models achieving impressive speed-ups over classical solvers whilst maintaining accuracy. However, these methods are usually tested at low-resolution settings, and it remains to be seen whether they can scale to the costly high-resolution simulations tha… ▽ More In recent years, there has been a growing interest in using machine learning to overcome the high cost of numerical simulation, with some learned models achieving impressive speed-ups over classical solvers whilst maintaining accuracy. However, these methods are usually tested at low-resolution settings, and it remains to be seen whether they can scale to the costly high-resolution simulations that we ultimately want to tackle. In this work, we propose two complementary approaches to improve the framework from MeshGraphNets, which demonstrated accurate predictions in a broad range of physical systems. MeshGraphNets relies on a message passing graph neural network to propagate information, and this structure becomes a limiting factor for high-resolution simulations, as equally distant points in space become further apart in graph space. First, we demonstrate that it is possible to learn accurate surrogate dynamics of a high-resolution system on a much coarser mesh, both removing the message passing bottleneck and improving performance; and second, we introduce a hierarchical approach (MultiScale MeshGraphNets) which passes messages on two different resolutions (fine and coarse), significantly improving the accuracy of MeshGraphNets while requiring less computational resources. △ Less

Submitted 2 October, 2022; originally announced October 2022.

Journal ref: 2nd AI4Science Workshop at the 39th International Conference on Machine Learning (ICML), 2022

Learned Force Fields Are Ready For Ground State Catalyst Discovery

Authors: Michael Schaarschmidt, Morgane Riviere, Alex M. Ganose, James S. Spencer, Alexander L. Gaunt, James Kirkpatrick, Simon Axelrod, Peter W. Battaglia, Jonathan Godwin

Abstract: We present evidence that learned density functional theory (``DFT'') force fields are ready for ground state catalyst discovery. Our key finding is that relaxation using forces from a learned potential yields structures with similar or lower energy to those relaxed using the RPBE functional in over 50\% of evaluated systems, despite the fact that the predicted forces differ significantly from the… ▽ More We present evidence that learned density functional theory (``DFT'') force fields are ready for ground state catalyst discovery. Our key finding is that relaxation using forces from a learned potential yields structures with similar or lower energy to those relaxed using the RPBE functional in over 50\% of evaluated systems, despite the fact that the predicted forces differ significantly from the ground truth. This has the surprising implication that learned potentials may be ready for replacing DFT in challenging catalytic systems such as those found in the Open Catalyst 2020 dataset. Furthermore, we show that a force field trained on a locally harmonic energy surface with the same minima as a target DFT energy is also able to find lower or similar energy structures in over 50\% of cases. This ``Easy Potential'' converges in fewer steps than a standard model trained on true energies and forces, which further accelerates calculations. Its success illustrates a key point: learned potentials can locate energy minima even when the model has high force errors. The main requirement for structure optimisation is simply that the learned potential has the correct minima. Since learned potentials are fast and scale linearly with system size, our results open the possibility of quickly finding ground states for large systems. △ Less

Submitted 26 September, 2022; originally announced September 2022.

TF-GNN: Graph Neural Networks in TensorFlow

Authors: Oleksandr Ferludin, Arno Eigenwillig, Martin Blais, Dustin Zelle, Jan Pfeifer, Alvaro Sanchez-Gonzalez, Wai Lok Sibon Li, Sami Abu-El-Haija, Peter Battaglia, Neslihan Bulut, Jonathan Halcrow, Filipe Miguel Gonçalves de Almeida, Pedro Gonnet, Liangze Jiang, Parth Kothari, Silvio Lattanzi, André Linhares, Brandon Mayer, Vahab Mirrokni, John Palowitch, Mihir Paradkar, Jennifer She, Anton Tsitsulin, Kevin Villela, Lisa Wang , et al. (2 additional authors not shown)

Abstract: TensorFlow-GNN (TF-GNN) is a scalable library for Graph Neural Networks in TensorFlow. It is designed from the bottom up to support the kinds of rich heterogeneous graph data that occurs in today's information ecosystems. In addition to enabling machine learning researchers and advanced developers, TF-GNN offers low-code solutions to empower the broader developer community in graph learning. Many… ▽ More TensorFlow-GNN (TF-GNN) is a scalable library for Graph Neural Networks in TensorFlow. It is designed from the bottom up to support the kinds of rich heterogeneous graph data that occurs in today's information ecosystems. In addition to enabling machine learning researchers and advanced developers, TF-GNN offers low-code solutions to empower the broader developer community in graph learning. Many production models at Google use TF-GNN, and it has been recently released as an open source project. In this paper we describe the TF-GNN data model, its Keras message passing API, and relevant capabilities such as graph sampling and distributed training. △ Less

Submitted 23 July, 2023; v1 submitted 7 July, 2022; originally announced July 2022.

Pre-training via Denoising for Molecular Property Prediction

Authors: Sheheryar Zaidi, Michael Schaarschmidt, James Martens, Hyunjik Kim, Yee Whye Teh, Alvaro Sanchez-Gonzalez, Peter Battaglia, Razvan Pascanu, Jonathan Godwin

Abstract: Many important problems involving molecular property prediction from 3D structures have limited data, posing a generalization challenge for neural networks. In this paper, we describe a pre-training technique based on denoising that achieves a new state-of-the-art in molecular property prediction by utilizing large datasets of 3D molecular structures at equilibrium to learn meaningful representati… ▽ More Many important problems involving molecular property prediction from 3D structures have limited data, posing a generalization challenge for neural networks. In this paper, we describe a pre-training technique based on denoising that achieves a new state-of-the-art in molecular property prediction by utilizing large datasets of 3D molecular structures at equilibrium to learn meaningful representations for downstream tasks. Relying on the well-known link between denoising autoencoders and score-matching, we show that the denoising objective corresponds to learning a molecular force field -- arising from approximating the Boltzmann distribution with a mixture of Gaussians -- directly from equilibrium structures. Our experiments demonstrate that using this pre-training objective significantly improves performance on multiple benchmarks, achieving a new state-of-the-art on the majority of targets in the widely used QM9 dataset. Our analysis then provides practical insights into the effects of different factors -- dataset sizes, model size and architecture, and the choice of upstream and downstream datasets -- on pre-training. △ Less

Submitted 24 October, 2022; v1 submitted 31 May, 2022; originally announced June 2022.

Transframer: Arbitrary Frame Prediction with Generative Models

Authors: Charlie Nash, João Carreira, Jacob Walker, Iain Barr, Andrew Jaegle, Mateusz Malinowski, Peter Battaglia

Abstract: We present a general-purpose framework for image modelling and vision tasks based on probabilistic frame prediction. Our approach unifies a broad range of tasks, from image segmentation, to novel view synthesis and video interpolation. We pair this framework with an architecture we term Transframer, which uses U-Net and Transformer components to condition on annotated context frames, and outputs s… ▽ More We present a general-purpose framework for image modelling and vision tasks based on probabilistic frame prediction. Our approach unifies a broad range of tasks, from image segmentation, to novel view synthesis and video interpolation. We pair this framework with an architecture we term Transframer, which uses U-Net and Transformer components to condition on annotated context frames, and outputs sequences of sparse, compressed image features. Transframer is the state-of-the-art on a variety of video generation benchmarks, is competitive with the strongest models on few-shot view synthesis, and can generate coherent 30 second videos from a single image without any explicit geometric information. A single generalist Transframer simultaneously produces promising results on 8 tasks, including semantic segmentation, image classification and optical flow prediction with no task-specific architectural components, demonstrating that multi-task computer vision can be tackled using probabilistic image models. Our approach can in principle be applied to a wide range of applications that require learning the conditional structure of annotated image-formatted data. △ Less

Submitted 9 May, 2022; v1 submitted 17 March, 2022; originally announced March 2022.

Rediscovering orbital mechanics with machine learning

Authors: Pablo Lemos, Niall Jeffrey, Miles Cranmer, Shirley Ho, Peter Battaglia

Abstract: We present an approach for using machine learning to automatically discover the governing equations and hidden properties of real physical systems from observations. We train a "graph neural network" to simulate the dynamics of our solar system's Sun, planets, and large moons from 30 years of trajectory data. We then use symbolic regression to discover an analytical expression for the force law im… ▽ More We present an approach for using machine learning to automatically discover the governing equations and hidden properties of real physical systems from observations. We train a "graph neural network" to simulate the dynamics of our solar system's Sun, planets, and large moons from 30 years of trajectory data. We then use symbolic regression to discover an analytical expression for the force law implicitly learned by the neural network, which our results showed is equivalent to Newton's law of gravitation. The key assumptions that were required were translational and rotational equivariance, and Newton's second and third laws of motion. Our approach correctly discovered the form of the symbolic force law. Furthermore, our approach did not require any assumptions about the masses of planets and moons or physical constants. They, too, were accurately inferred through our methods. Though, of course, the classical law of gravitation has been known since Isaac Newton, our result serves as a validation that our method can discover unknown laws and hidden properties from observed data. More broadly this work represents a key step toward realizing the potential of machine learning for accelerating scientific discovery. △ Less

Submitted 4 February, 2022; originally announced February 2022.

Comments: 12 pages, 6 figures, under review

Physical Design using Differentiable Learned Simulators

Authors: Kelsey R. Allen, Tatiana Lopez-Guevara, Kimberly Stachenfeld, Alvaro Sanchez-Gonzalez, Peter Battaglia, Jessica Hamrick, Tobias Pfaff

Abstract: Designing physical artifacts that serve a purpose - such as tools and other functional structures - is central to engineering as well as everyday human behavior. Though automating design has tremendous promise, general-purpose methods do not yet exist. Here we explore a simple, fast, and robust approach to inverse design which combines learned forward simulators based on graph neural networks with… ▽ More Designing physical artifacts that serve a purpose - such as tools and other functional structures - is central to engineering as well as everyday human behavior. Though automating design has tremendous promise, general-purpose methods do not yet exist. Here we explore a simple, fast, and robust approach to inverse design which combines learned forward simulators based on graph neural networks with gradient-based design optimization. Our approach solves high-dimensional problems with complex physical dynamics, including designing surfaces and tools to manipulate fluid flows and optimizing the shape of an airfoil to minimize drag. This framework produces high-quality designs by propagating gradients through trajectories of hundreds of steps, even when using models that were pre-trained for single-step predictions on data substantially different from the design tasks. In our fluid manipulation tasks, the resulting designs outperformed those found by sampling-based optimization techniques. In airfoil design, they matched the quality of those obtained with a specialized solver. Our results suggest that despite some remaining challenges, machine learning-based simulators are maturing to the point where they can support general-purpose design optimization across a variety of domains. △ Less

Submitted 1 February, 2022; originally announced February 2022.

Comments: First three authors contributed equally

Learned Coarse Models for Efficient Turbulence Simulation

Authors: Kimberly Stachenfeld, Drummond B. Fielding, Dmitrii Kochkov, Miles Cranmer, Tobias Pfaff, Jonathan Godwin, Can Cui, Shirley Ho, Peter Battaglia, Alvaro Sanchez-Gonzalez

Abstract: Turbulence simulation with classical numerical solvers requires high-resolution grids to accurately resolve dynamics. Here we train learned simulators at low spatial and temporal resolutions to capture turbulent dynamics generated at high resolution. We show that our proposed model can simulate turbulent dynamics more accurately than classical numerical solvers at the comparably low resolutions ac… ▽ More Turbulence simulation with classical numerical solvers requires high-resolution grids to accurately resolve dynamics. Here we train learned simulators at low spatial and temporal resolutions to capture turbulent dynamics generated at high resolution. We show that our proposed model can simulate turbulent dynamics more accurately than classical numerical solvers at the comparably low resolutions across various scientifically relevant metrics. Our model is trained end-to-end from data and is capable of learning a range of challenging chaotic and turbulent dynamics at low resolution, including trajectories generated by the state-of-the-art Athena++ engine. We show that our simpler, general-purpose architecture outperforms various more specialized, turbulence-specific architectures from the learned turbulence simulation literature. In general, we see that learned simulators yield unstable trajectories; however, we show that tuning training noise and temporal downsampling solves this problem. We also find that while generalization beyond the training distribution is a challenge for learned models, training noise, added loss constraints, and dataset augmentation can help. Broadly, we conclude that our learned simulator outperforms traditional solvers run on coarser grids, and emphasize that simple design choices can offer stability and robust generalization. △ Less

Submitted 22 April, 2022; v1 submitted 30 December, 2021; originally announced December 2021.

Journal ref: (2022) International Conference on Learning Representations

Constraint-based graph network simulator

Authors: Yulia Rubanova, Alvaro Sanchez-Gonzalez, Tobias Pfaff, Peter Battaglia

Abstract: In the area of physical simulations, nearly all neural-network-based methods directly predict future states from the input states. However, many traditional simulation engines instead model the constraints of the system and select the state which satisfies them. Here we present a framework for constraint-based learned simulation, where a scalar constraint function is implemented as a graph neural… ▽ More In the area of physical simulations, nearly all neural-network-based methods directly predict future states from the input states. However, many traditional simulation engines instead model the constraints of the system and select the state which satisfies them. Here we present a framework for constraint-based learned simulation, where a scalar constraint function is implemented as a graph neural network, and future predictions are computed by solving the optimization problem defined by the learned constraint. Our model achieves comparable or better accuracy to top learned simulators on a variety of challenging physical domains, and offers several unique advantages. We can improve the simulation accuracy on a larger system by applying more solver iterations at test time. We also can incorporate novel hand-designed constraints at test time and simulate new dynamics which were not present in the training data. Our constraint-based framework shows how key techniques from traditional simulation and numerical methods can be leveraged as inductive biases in machine learning simulators. △ Less

Submitted 28 January, 2022; v1 submitted 16 December, 2021; originally announced December 2021.

Learning ground states of quantum Hamiltonians with graph networks

Authors: Dmitrii Kochkov, Tobias Pfaff, Alvaro Sanchez-Gonzalez, Peter Battaglia, Bryan K. Clark

Abstract: Solving for the lowest energy eigenstate of the many-body Schrodinger equation is a cornerstone problem that hinders understanding of a variety of quantum phenomena. The difficulty arises from the exponential nature of the Hilbert space which casts the governing equations as an eigenvalue problem of exponentially large, structured matrices. Variational methods approach this problem by searching fo… ▽ More Solving for the lowest energy eigenstate of the many-body Schrodinger equation is a cornerstone problem that hinders understanding of a variety of quantum phenomena. The difficulty arises from the exponential nature of the Hilbert space which casts the governing equations as an eigenvalue problem of exponentially large, structured matrices. Variational methods approach this problem by searching for the best approximation within a lower-dimensional variational manifold. In this work we use graph neural networks to define a structured variational manifold and optimize its parameters to find high quality approximations of the lowest energy solutions on a diverse set of Heisenberg Hamiltonians. Using graph networks we learn distributed representations that by construction respect underlying physical symmetries of the problem and generalize to problems of larger size. Our approach achieves state-of-the-art results on a set of quantum many-body benchmark problems and works well on problems whose solutions are not positive-definite. The discussed techniques hold promise of being a useful tool for studying quantum many-body systems and providing insights into optimization and implicit modeling of exponentially-sized objects. △ Less

Submitted 12 October, 2021; originally announced October 2021.

Comments: 19 pages, 9 figures

ETA Prediction with Graph Neural Networks in Google Maps

Authors: Austin Derrow-Pinion, Jennifer She, David Wong, Oliver Lange, Todd Hester, Luis Perez, Marc Nunkesser, Seongjae Lee, Xueying Guo, Brett Wiltshire, Peter W. Battaglia, Vishal Gupta, Ang Li, Zhongwen Xu, Alvaro Sanchez-Gonzalez, Yujia Li, Petar Veličković

Abstract: Travel-time prediction constitutes a task of high importance in transportation networks, with web mapping services like Google Maps regularly serving vast quantities of travel time queries from users and enterprises alike. Further, such a task requires accounting for complex spatiotemporal interactions (modelling both the topological properties of the road network and anticipating events -- such a… ▽ More Travel-time prediction constitutes a task of high importance in transportation networks, with web mapping services like Google Maps regularly serving vast quantities of travel time queries from users and enterprises alike. Further, such a task requires accounting for complex spatiotemporal interactions (modelling both the topological properties of the road network and anticipating events -- such as rush hours -- that may occur in the future). Hence, it is an ideal target for graph representation learning at scale. Here we present a graph neural network estimator for estimated time of arrival (ETA) which we have deployed in production at Google Maps. While our main architecture consists of standard GNN building blocks, we further detail the usage of training schedule methods such as MetaGradients in order to make our model robust and production-ready. We also provide prescriptive studies: ablating on various architectural decisions and training regimes, and qualitative analyses on real-world situations where our model provides a competitive edge. Our GNN proved powerful when deployed, significantly reducing negative ETA outcomes in several regions compared to the previous production baseline (40+% in cities like Sydney). △ Less

Submitted 25 August, 2021; originally announced August 2021.

Comments: To appear at CIKM 2021 (Applied Research Track). 10 pages, 4 figures

Euclid preparation: I. The Euclid Wide Survey

Authors: R. Scaramella, J. Amiaux, Y. Mellier, C. Burigana, C. S. Carvalho, J. -C. Cuillandre, A. Da Silva, A. Derosa, J. Dinis, E. Maiorano, M. Maris, I. Tereno, R. Laureijs, T. Boenke, G. Buenadicha, X. Dupac, L. M. Gaspar Venancio, P. Gómez-Álvarez, J. Hoar, J. Lorenzo Alvarez, G. D. Racca, G. Saavedra-Criado, J. Schwartz, R. Vavrek, M. Schirmer , et al. (216 additional authors not shown)

Abstract: Euclid is an ESA mission designed to constrain the properties of dark energy and gravity via weak gravitational lensing and galaxy clustering. It will carry out a wide area imaging and spectroscopy survey (EWS) in visible and near-infrared, covering roughly 15,000 square degrees of extragalactic sky on six years. The wide-field telescope and instruments are optimized for pristine PSF and reduced s… ▽ More Euclid is an ESA mission designed to constrain the properties of dark energy and gravity via weak gravitational lensing and galaxy clustering. It will carry out a wide area imaging and spectroscopy survey (EWS) in visible and near-infrared, covering roughly 15,000 square degrees of extragalactic sky on six years. The wide-field telescope and instruments are optimized for pristine PSF and reduced straylight, producing very crisp images. This paper presents the building of the Euclid reference survey: the sequence of pointings of EWS, Deep fields, Auxiliary fields for calibrations, and spacecraft movements followed by Euclid as it operates in a step-and-stare mode from its orbit around the Lagrange point L2. Each EWS pointing has four dithered frames; we simulate the dither pattern at pixel level to analyse the effective coverage. We use up-to-date models for the sky background to define the Euclid region-of-interest (RoI). The building of the reference survey is highly constrained from calibration cadences, spacecraft constraints and background levels; synergies with ground-based coverage are also considered. Via purposely-built software optimized to prioritize best sky areas, produce a compact coverage, and ensure thermal stability, we generate a schedule for the Auxiliary and Deep fields observations and schedule the RoI with EWS transit observations. The resulting reference survey RSD_2021A fulfills all constraints and is a good proxy for the final solution. Its wide survey covers 14,500 square degrees. The limiting AB magnitudes ($5σ$ point-like source) achieved in its footprint are estimated to be 26.2 (visible) and 24.5 (near-infrared); for spectroscopy, the H$_α$ line flux limit is $2\times 10^{-16}$ erg cm$^{-2}$ s$^{-1}$ at 1600 nm; and for diffuse emission the surface brightness limits are 29.8 (visible) and 28.4 (near-infrared) mag arcsec$^{-2}$. △ Less

Submitted 2 August, 2021; originally announced August 2021.

Comments: 43 pages, 51 figures, submitted to A&A

Journal ref: A&A 662, A112 (2022)

Large-scale graph representation learning with very deep GNNs and self-supervision

Authors: Ravichandra Addanki, Peter W. Battaglia, David Budden, Andreea Deac, Jonathan Godwin, Thomas Keck, Wai Lok Sibon Li, Alvaro Sanchez-Gonzalez, Jacklynn Stott, Shantanu Thakoor, Petar Veličković

Abstract: Effectively and efficiently deploying graph neural networks (GNNs) at scale remains one of the most challenging aspects of graph representation learning. Many powerful solutions have only ever been validated on comparatively small datasets, often with counter-intuitive outcomes -- a barrier which has been broken by the Open Graph Benchmark Large-Scale Challenge (OGB-LSC). We entered the OGB-LSC wi… ▽ More Effectively and efficiently deploying graph neural networks (GNNs) at scale remains one of the most challenging aspects of graph representation learning. Many powerful solutions have only ever been validated on comparatively small datasets, often with counter-intuitive outcomes -- a barrier which has been broken by the Open Graph Benchmark Large-Scale Challenge (OGB-LSC). We entered the OGB-LSC with two large-scale GNNs: a deep transductive node classifier powered by bootstrapping, and a very deep (up to 50-layer) inductive graph regressor regularised by denoising objectives. Our models achieved an award-level (top-3) performance on both the MAG240M and PCQM4M benchmarks. In doing so, we demonstrate evidence of scalable self-supervised graph representation learning, and utility of very deep GNNs -- both very important open issues. Our code is publicly available at: https://github.com/deepmind/deepmind-research/tree/master/ogb_lsc. △ Less

Submitted 20 July, 2021; originally announced July 2021.

Comments: To appear at KDD Cup 2021. 13 pages, 3 figures. All authors contributed equally

Simple GNN Regularisation for 3D Molecular Property Prediction & Beyond

Authors: Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia

Abstract: In this paper we show that simple noise regularisation can be an effective way to address GNN oversmoothing. First we argue that regularisers addressing oversmoothing should both penalise node latent similarity and encourage meaningful node representations. From this observation we derive "Noisy Nodes", a simple technique in which we corrupt the input graph with noise, and add a noise correcting n… ▽ More In this paper we show that simple noise regularisation can be an effective way to address GNN oversmoothing. First we argue that regularisers addressing oversmoothing should both penalise node latent similarity and encourage meaningful node representations. From this observation we derive "Noisy Nodes", a simple technique in which we corrupt the input graph with noise, and add a noise correcting node-level loss. The diverse node level loss encourages latent node diversity, and the denoising objective encourages graph manifold learning. Our regulariser applies well-studied methods in simple, straightforward ways which allow even generic architectures to overcome oversmoothing and achieve state of the art results on quantum chemistry tasks, and improve results significantly on Open Graph Benchmark (OGB) datasets. Our results suggest Noisy Nodes can serve as a complementary building block in the GNN toolkit. △ Less

Submitted 15 March, 2022; v1 submitted 15 June, 2021; originally announced June 2021.

Comments: ICLR 2022 Camera Ready

Generating Images with Sparse Representations

Authors: Charlie Nash, Jacob Menick, Sander Dieleman, Peter W. Battaglia

Abstract: The high dimensionality of images presents architecture and sampling-efficiency challenges for likelihood-based generative models. Previous approaches such as VQ-VAE use deep autoencoders to obtain compact representations, which are more practical as inputs for likelihood-based models. We present an alternative approach, inspired by common image compression methods like JPEG, and convert images to… ▽ More The high dimensionality of images presents architecture and sampling-efficiency challenges for likelihood-based generative models. Previous approaches such as VQ-VAE use deep autoencoders to obtain compact representations, which are more practical as inputs for likelihood-based models. We present an alternative approach, inspired by common image compression methods like JPEG, and convert images to quantized discrete cosine transform (DCT) blocks, which are represented sparsely as a sequence of DCT channel, spatial location, and DCT coefficient triples. We propose a Transformer-based autoregressive architecture, which is trained to sequentially predict the conditional distribution of the next element in such sequences, and which scales effectively to high resolution images. On a range of image datasets, we demonstrate that our approach can generate high quality, diverse images, with sample metric scores competitive with state of the art methods. We additionally show that simple modifications to our method yield effective image colorization and super-resolution models. △ Less

Submitted 5 March, 2021; originally announced March 2021.

A Bayesian neural network predicts the dissolution of compact planetary systems

Authors: Miles Cranmer, Daniel Tamayo, Hanno Rein, Peter Battaglia, Samuel Hadden, Philip J. Armitage, Shirley Ho, David N. Spergel

Abstract: Despite over three hundred years of effort, no solutions exist for predicting when a general planetary configuration will become unstable. We introduce a deep learning architecture to push forward this problem for compact systems. While current machine learning algorithms in this area rely on scientist-derived instability metrics, our new technique learns its own metrics from scratch, enabled by a… ▽ More Despite over three hundred years of effort, no solutions exist for predicting when a general planetary configuration will become unstable. We introduce a deep learning architecture to push forward this problem for compact systems. While current machine learning algorithms in this area rely on scientist-derived instability metrics, our new technique learns its own metrics from scratch, enabled by a novel internal structure inspired from dynamics theory. Our Bayesian neural network model can accurately predict not only if, but also when a compact planetary system with three or more planets will go unstable. Our model, trained directly from short N-body time series of raw orbital elements, is more than two orders of magnitude more accurate at predicting instability times than analytical estimators, while also reducing the bias of existing machine learning algorithms by nearly a factor of three. Despite being trained on compact resonant and near-resonant three-planet configurations, the model demonstrates robust generalization to both non-resonant and higher multiplicity configurations, in the latter case outperforming models fit to that specific set of integrations. The model computes instability estimates up to five orders of magnitude faster than a numerical integrator, and unlike previous efforts provides confidence intervals on its predictions. Our inference model is publicly available in the SPOCK package, with training code open-sourced. △ Less

Submitted 11 January, 2021; originally announced January 2021.

Comments: 8 content pages, 7 appendix and references. 8 figures. Source code at: https://github.com/MilesCranmer/bnn_chaos_model inference code at https://github.com/dtamayo/spock

Graph Networks with Spectral Message Passing

Authors: Kimberly Stachenfeld, Jonathan Godwin, Peter Battaglia

Abstract: Graph Neural Networks (GNNs) are the subject of intense focus by the machine learning community for problems involving relational reasoning. GNNs can be broadly divided into spatial and spectral approaches. Spatial approaches use a form of learned message-passing, in which interactions among vertices are computed locally, and information propagates over longer distances on the graph with greater n… ▽ More Graph Neural Networks (GNNs) are the subject of intense focus by the machine learning community for problems involving relational reasoning. GNNs can be broadly divided into spatial and spectral approaches. Spatial approaches use a form of learned message-passing, in which interactions among vertices are computed locally, and information propagates over longer distances on the graph with greater numbers of message-passing steps. Spectral approaches use eigendecompositions of the graph Laplacian to produce a generalization of spatial convolutions to graph structured data which access information over short and long time scales simultaneously. Here we introduce the Spectral Graph Network, which applies message passing to both the spatial and spectral domains. Our model projects vertices of the spatial graph onto the Laplacian eigenvectors, which are each represented as vertices in a fully connected "spectral graph", and then applies learned message passing to them. We apply this model to various benchmark tasks including a graph-based variant of MNIST classification, molecular property prediction on MoleculeNet and QM9, and shortest path problems on random graphs. Our results show that the Spectral GN promotes efficient training, reaching high performance with fewer training iterations despite having more parameters. The model also provides robustness to edge dropout and outperforms baselines for the classification tasks. We also explore how these performance benefits depend on properties of the dataset. △ Less

Submitted 31 December, 2020; originally announced January 2021.

Euclid preparation: IX. EuclidEmulator2 -- Power spectrum emulation with massive neutrinos and self-consistent dark energy perturbations

Authors: Euclid Collaboration, M. Knabenhans, J. Stadel, D. Potter, J. Dakin, S. Hannestad, T. Tram, S. Marelli, A. Schneider, R. Teyssier, S. Andreon, N. Auricchio, C. Baccigalupi, A. Balaguera-Antolínez, M. Baldi, S. Bardelli, P. Battaglia, R. Bender, A. Biviano, C. Bodendorf, E. Bozzo, E. Branchini, M. Brescia, C. Burigana, R. Cabanac , et al. (109 additional authors not shown)

Abstract: We present a new, updated version of the EuclidEmulator (called EuclidEmulator2), a fast and accurate predictor for the nonlinear correction of the matter power spectrum. Percent-level accurate emulation is now supported in the eight-dimensional parameter space of $w_0w_a$CDM$+\sum m_ν$models between redshift $z=0$ and $z=3$ for spatial scales within the range 0.01 $h$/Mpc $\leq k \leq$ 10 $h$/Mpc… ▽ More We present a new, updated version of the EuclidEmulator (called EuclidEmulator2), a fast and accurate predictor for the nonlinear correction of the matter power spectrum. Percent-level accurate emulation is now supported in the eight-dimensional parameter space of $w_0w_a$CDM$+\sum m_ν$models between redshift $z=0$ and $z=3$ for spatial scales within the range 0.01 $h$/Mpc $\leq k \leq$ 10 $h$/Mpc. In order to achieve this level of accuracy, we have had to improve the quality of the underlying N-body simulations used as training data: (1) we use self-consistent linear evolution of non-dark matter species such as massive neutrinos, photons, dark energy and the metric field, (2) we perform the simulations in the so-called N-body gauge, which allows one to interpret the results in the framework of general relativity, (3) we run over 250 high-resolution simulations with $3000^3$ particles in boxes of 1 (Gpc/$h$)${}^3$ volumes based on paired-and-fixed initial conditions and (4) we provide a resolution correction that can be applied to emulated results as a post-processing step in order to drastically reduce systematic biases on small scales due to residual resolution effects in the simulations. We find that the inclusion of the dynamical dark energy parameter $w_a$ significantly increases the complexity and expense of creating the emulator. The high fidelity of EuclidEmulator2 is tested in various comparisons against N-body simulations as well as alternative fast predictors like Halofit, HMCode and CosmicEmu. A blind test is successfully performed against the Euclid Flagship v2.0 simulation. Nonlinear correction factors emulated with EuclidEmulator2 are accurate at the level of 1% or better for 0.01 $h$/Mpc $\leq k \leq$ 10 $h$/Mpc and $z\leq3$ compared to high-resolution dark matter only simulations. EuclidEmulator2 is publicly available at https://github.com/miknab/EuclidEmulator2 . △ Less

Submitted 21 October, 2020; originally announced October 2020.

Comments: 28 pages, 19 figures, submitted to MNRAS

Learning Mesh-Based Simulation with Graph Networks

Authors: Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, Peter W. Battaglia

Abstract: Mesh-based simulations are central to modeling complex physical systems in many disciplines across science and engineering. Mesh representations support powerful numerical integration methods and their resolution can be adapted to strike favorable trade-offs between accuracy and efficiency. However, high-dimensional scientific simulations are very expensive to run, and solvers and parameters must… ▽ More Mesh-based simulations are central to modeling complex physical systems in many disciplines across science and engineering. Mesh representations support powerful numerical integration methods and their resolution can be adapted to strike favorable trade-offs between accuracy and efficiency. However, high-dimensional scientific simulations are very expensive to run, and solvers and parameters must often be tuned individually to each system studied. Here we introduce MeshGraphNets, a framework for learning mesh-based simulations using graph neural networks. Our model can be trained to pass messages on a mesh graph and to adapt the mesh discretization during forward simulation. Our results show it can accurately predict the dynamics of a wide range of physical systems, including aerodynamics, structural mechanics, and cloth. The model's adaptivity supports learning resolution-independent dynamics and can scale to more complex state spaces at test time. Our method is also highly efficient, running 1-2 orders of magnitude faster than the simulation on which it is trained. Our approach broadens the range of problems on which neural network simulators can operate and promises to improve the efficiency of complex, scientific modeling tasks. △ Less

Submitted 18 June, 2021; v1 submitted 7 October, 2020; originally announced October 2020.

Journal ref: International Conference on Learning Representations (ICLR), 2021

QUBIC VII: The feedhorn-switch system of the technological demonstrator

Authors: F. Cavaliere, A. Mennella, M. Zannoni, P. Battaglia, E. S. Battistelli, D. Burke, G. D'Alessandro, P. de Bernardis, M. De Petris, C. Franceschet, L. Grandsire, J. -Ch. Hamilton, B. Maffei, E. Manzan, S. Marnieros, S. Masi, C. O'Sullivan, A. Passerini, F. Pezzotta, M. Piat, A. Tartari, S. A. Torchinsky, D. Viganò, F. Voisin, P. Ade , et al. (106 additional authors not shown)

Abstract: We present the design, manufacturing and performance of the horn-switch system developed for the technological demonstrator of QUBIC (the $Q$\&$U$ Bolometric Interferometer for Cosmology). This system is constituted of 64 back-to-back dual-band (150\,GHz and 220\,GHz) corrugated feed-horns interspersed with mechanical switches used to select desired baselines during the instrument self-calibration… ▽ More We present the design, manufacturing and performance of the horn-switch system developed for the technological demonstrator of QUBIC (the $Q$\&$U$ Bolometric Interferometer for Cosmology). This system is constituted of 64 back-to-back dual-band (150\,GHz and 220\,GHz) corrugated feed-horns interspersed with mechanical switches used to select desired baselines during the instrument self-calibration. We manufactured the horns in aluminum platelets milled by photo-chemical etching and mechanically tightened with screws. The switches are based on steel blades that open and close the wave-guide between the back-to-back horns and are operated by miniaturized electromagnets. We also show the current development status of the feedhorn-switch system for the QUBIC full instrument, based on an array of 400 horn-switch assemblies. △ Less

Submitted 1 April, 2022; v1 submitted 28 August, 2020; originally announced August 2020.

Comments: 30 pages, 28 figures. Accepted for submission to JCAP

The large scale polarization explorer (LSPE) for CMB measurements: performance forecast

Authors: The LSPE collaboration, G. Addamo, P. A. R. Ade, C. Baccigalupi, A. M. Baldini, P. M. Battaglia, E. S. Battistelli, A. Baù, P. de Bernardis, M. Bersanelli, M. Biasotti, A. Boscaleri, B. Caccianiga, S. Caprioli, F. Cavaliere, F. Cei, K. A. Cleary, F. Columbro, G. Coppi, A. Coppolecchia, F. Cuttaia, G. D'Alessandro, G. De Gasperis, M. De Petris, V. Fafone , et al. (80 additional authors not shown)

Abstract: [Abridged] The measurement of the polarization of the Cosmic Microwave Background radiation is one of the current frontiers in cosmology. In particular, the detection of the primordial B-modes, could reveal the presence of gravitational waves in the early Universe. The detection of such component is at the moment the most promising technique to probe the inflationary theory describing the very ear… ▽ More [Abridged] The measurement of the polarization of the Cosmic Microwave Background radiation is one of the current frontiers in cosmology. In particular, the detection of the primordial B-modes, could reveal the presence of gravitational waves in the early Universe. The detection of such component is at the moment the most promising technique to probe the inflationary theory describing the very early evolution of the Universe. We present the updated performance forecast of the Large Scale Polarization Explorer (LSPE), a program dedicated to the measurement of the CMB polarization. LSPE is composed of two instruments: Strip, a radiometer-based telescope on the ground in Tenerife, and SWIPE (Short-Wavelength Instrument for the Polarization Explorer) a bolometer-based instrument designed to fly on a winter arctic stratospheric long-duration balloon. The program is among the few dedicated to observation of the Northern Hemisphere, while most of the international effort is focused into ground-based observation in the Southern Hemisphere. Measurements are currently scheduled in Winter 2021/22 for SWIPE, with a flight duration up to 15 days, and in Summer 2021 with two years observations for Strip. We describe the main features of the two instruments, identifying the most critical aspects of the design, in terms of impact into performance forecast. We estimate the expected sensitivity of each instrument and propagate their combined observing power to the sensitivity to cosmological parameters, including the effect of scanning strategy, component separation, residual foregrounds and partial sky coverage. We also set requirements on the control of the most critical systematic effects and describe techniques to mitigate their impact. LSPE can reach a sensitivity in tensor-to-scalar ratio of $σ_r<0.01$, and improve constrains on other cosmological parameters. △ Less

Submitted 9 August, 2021; v1 submitted 25 August, 2020; originally announced August 2020.

Comments: Submitted to JCAP. Abstract abridged for arXiv submission

Journal ref: Journal of Cosmology and Astroparticle Physics, Volume 2021, August 2021

Graph Neural Networks in Particle Physics

Authors: Jonathan Shlomi, Peter Battaglia, Jean-Roch Vlimant

Abstract: Particle physics is a branch of science aiming at discovering the fundamental laws of matter and forces. Graph neural networks are trainable functions which operate on graphs---sets of elements and their pairwise relations---and are a central method within the broader field of geometric deep learning. They are very expressive and have demonstrated superior performance to other classical deep learn… ▽ More Particle physics is a branch of science aiming at discovering the fundamental laws of matter and forces. Graph neural networks are trainable functions which operate on graphs---sets of elements and their pairwise relations---and are a central method within the broader field of geometric deep learning. They are very expressive and have demonstrated superior performance to other classical deep learning approaches in a variety of domains. The data in particle physics are often represented by sets and graphs and as such, graph neural networks offer key advantages. Here we review various applications of graph neural networks in particle physics, including different graph constructions, model architectures and learning objectives, as well as key open problems in particle physics for which graph neural networks are promising. △ Less

Submitted 21 October, 2020; v1 submitted 27 July, 2020; originally announced July 2020.

Comments: 29 pages, 11 figures, submitted to Machine Learning: Science and Technology, Focus on Machine Learning for Fundamental Physics collection

Predicting the long-term stability of compact multiplanet systems

Authors: Daniel Tamayo, Miles Cranmer, Samuel Hadden, Hanno Rein, Peter Battaglia, Alysa Obertas, Philip J. Armitage, Shirley Ho, David Spergel, Christian Gilbertson, Naireen Hussain, Ari Silburt, Daniel Jontof-Hutter, Kristen Menou

Abstract: We combine analytical understanding of resonant dynamics in two-planet systems with machine learning techniques to train a model capable of robustly classifying stability in compact multi-planet systems over long timescales of $10^9$ orbits. Our Stability of Planetary Orbital Configurations Klassifier (SPOCK) predicts stability using physically motivated summary statistics measured in integrations… ▽ More We combine analytical understanding of resonant dynamics in two-planet systems with machine learning techniques to train a model capable of robustly classifying stability in compact multi-planet systems over long timescales of $10^9$ orbits. Our Stability of Planetary Orbital Configurations Klassifier (SPOCK) predicts stability using physically motivated summary statistics measured in integrations of the first $10^4$ orbits, thus achieving speed-ups of up to $10^5$ over full simulations. This computationally opens up the stability constrained characterization of multi-planet systems. Our model, trained on $\approx 100,000$ three-planet systems sampled at discrete resonances, generalizes both to a sample spanning a continuous period-ratio range, as well as to a large five-planet sample with qualitatively different configurations to our training dataset. Our approach significantly outperforms previous methods based on systems' angular momentum deficit, chaos indicators, and parametrized fits to numerical integrations. We use SPOCK to constrain the free eccentricities between the inner and outer pairs of planets in the Kepler-431 system of three approximately Earth-sized planets to both be below 0.05. Our stability analysis provides significantly stronger eccentricity constraints than currently achievable through either radial velocity or transit duration measurements for small planets, and within a factor of a few of systems that exhibit transit timing variations (TTVs). Given that current exoplanet detection strategies now rarely allow for strong TTV constraints (Hadden et al., 2019), SPOCK enables a powerful complementary method for precisely characterizing compact multi-planet systems. We publicly release SPOCK for community use. △ Less

Submitted 14 July, 2020; v1 submitted 13 July, 2020; originally announced July 2020.

Comments: Published week of July 13th in Proceedings of the National Academy of Sciences: https://www.pnas.org/cgi/doi/10.1073/pnas.2001258117. Check out simple usage of package (and regenerate paper figures) at: https://github.com/dtamayo/spock

Discovering Symbolic Models from Deep Learning with Inductive Biases

Authors: Miles Cranmer, Alvaro Sanchez-Gonzalez, Peter Battaglia, Rui Xu, Kyle Cranmer, David Spergel, Shirley Ho

Abstract: We develop a general approach to distill symbolic representations of a learned deep model by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The technique works as follows: we first encourage sparse latent representations when we train a GNN in a supervised setting, then we apply symbolic regression to components of the learned model to extract explicit physical rela… ▽ More We develop a general approach to distill symbolic representations of a learned deep model by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The technique works as follows: we first encourage sparse latent representations when we train a GNN in a supervised setting, then we apply symbolic regression to components of the learned model to extract explicit physical relations. We find the correct known equations, including force laws and Hamiltonians, can be extracted from the neural network. We then apply our method to a non-trivial cosmology example-a detailed dark matter simulation-and discover a new analytic formula which can predict the concentration of dark matter from the mass distribution of nearby cosmic structures. The symbolic expressions extracted from the GNN using our technique also generalized to out-of-distribution data better than the GNN itself. Our approach offers alternative directions for interpreting neural networks and discovering novel physical principles from the representations they learn. △ Less

Submitted 17 November, 2020; v1 submitted 19 June, 2020; originally announced June 2020.

Comments: Accepted to NeurIPS 2020. 9 pages content + 16 pages appendix/references. Supporting code found at https://github.com/MilesCranmer/symbolic_deep_learning

Progress report on the Large Scale Polarization Explorer

Authors: L. Lamagna, G. Addamo, P. A. R. Ade, C. Baccigalupi, A. M. Baldini, P. M. Battaglia, E. Battistelli, A. Baù, M. Bersanelli, M. Biasotti, C. Boragno, A. Boscaleri, B. Caccianiga, S. Caprioli, F. Cavaliere, F. Cei, K. A. Cleary, F. Columbro, G. Coppi, A. Coppolecchia, D. Corsini, F. Cuttaia, G. D'Alessandro, P. de Bernardis, G. De Gasperis , et al. (74 additional authors not shown)

Abstract: The Large Scale Polarization Explorer (LSPE) is a cosmology program for the measurement of large scale curl-like features (B-modes) in the polarization of the Cosmic Microwave Background. Its goal is to constrain the background of inflationary gravity waves traveling through the universe at the time of matter-radiation decoupling. The two instruments of LSPE are meant to synergically operate by co… ▽ More The Large Scale Polarization Explorer (LSPE) is a cosmology program for the measurement of large scale curl-like features (B-modes) in the polarization of the Cosmic Microwave Background. Its goal is to constrain the background of inflationary gravity waves traveling through the universe at the time of matter-radiation decoupling. The two instruments of LSPE are meant to synergically operate by covering a large portion of the northern microwave sky. LSPE/STRIP is a coherent array of receivers planned to be operated from the Teide Observatory in Tenerife, for the control and characterization of the low-frequency polarized signals of galactic origin; LSPE/SWIPE is a balloon-borne bolometric polarimeter based on 330 large throughput multi-moded detectors, designed to measure the CMB polarization at 150 GHz and to monitor the polarized emission by galactic dust above 200 GHz. The combined performance and the expected level of systematics mitigation will allow LSPE to constrain primordial B-modes down to a tensor/scalar ratio of $10^{-2}$. We here report the status of the STRIP pre-commissioning phase and the progress in the characterization of the key subsystems of the SWIPE payload (namely the cryogenic polarization modulation unit and the multi-moded TES pixels) prior to receiver integration. △ Less

Submitted 5 May, 2020; v1 submitted 3 May, 2020; originally announced May 2020.

Comments: 8 pages, 5 figures, Accepted for publication in Journal of Low Temperature Physics

Lagrangian Neural Networks

Authors: Miles Cranmer, Sam Greydanus, Stephan Hoyer, Peter Battaglia, David Spergel, Shirley Ho

Abstract: Accurate models of the world are built upon notions of its underlying symmetries. In physics, these symmetries correspond to conservation laws, such as for energy and momentum. Yet even though neural network models see increasing use in the physical sciences, they struggle to learn these symmetries. In this paper, we propose Lagrangian Neural Networks (LNNs), which can parameterize arbitrary Lagra… ▽ More Accurate models of the world are built upon notions of its underlying symmetries. In physics, these symmetries correspond to conservation laws, such as for energy and momentum. Yet even though neural network models see increasing use in the physical sciences, they struggle to learn these symmetries. In this paper, we propose Lagrangian Neural Networks (LNNs), which can parameterize arbitrary Lagrangians using neural networks. In contrast to models that learn Hamiltonians, LNNs do not require canonical coordinates, and thus perform well in situations where canonical momenta are unknown or difficult to compute. Unlike previous approaches, our method does not restrict the functional form of learned energies and will produce energy-conserving models for a variety of tasks. We test our approach on a double pendulum and a relativistic particle, demonstrating energy conservation where a baseline approach incurs dissipation and modeling relativity without canonical coordinates where a Hamiltonian approach fails. Finally, we show how this model can be applied to graphs and continuous systems using a Lagrangian Graph Network, and demonstrate it on the 1D wave equation. △ Less

Submitted 30 July, 2020; v1 submitted 10 March, 2020; originally announced March 2020.

Comments: 7 pages (+2 appendix). Published in ICLR 2020 Deep Differential Equations Workshop. Code at github.com/MilesCranmer/lagrangian_nns

PolyGen: An Autoregressive Generative Model of 3D Meshes

Authors: Charlie Nash, Yaroslav Ganin, S. M. Ali Eslami, Peter W. Battaglia

Abstract: Polygon meshes are an efficient representation of 3D geometry, and are of central importance in computer graphics, robotics and games development. Existing learning-based approaches have avoided the challenges of working with 3D meshes, instead using alternative object representations that are more compatible with neural architectures and training approaches. We present an approach which models th… ▽ More Polygon meshes are an efficient representation of 3D geometry, and are of central importance in computer graphics, robotics and games development. Existing learning-based approaches have avoided the challenges of working with 3D meshes, instead using alternative object representations that are more compatible with neural architectures and training approaches. We present an approach which models the mesh directly, predicting mesh vertices and faces sequentially using a Transformer-based architecture. Our model can condition on a range of inputs, including object classes, voxels, and images, and because the model is probabilistic it can produce samples that capture uncertainty in ambiguous scenarios. We show that the model is capable of producing high-quality, usable meshes, and establish log-likelihood benchmarks for the mesh-modelling task. We also evaluate the conditional models on surface reconstruction metrics against alternative methods, and demonstrate competitive performance despite not training directly on this task. △ Less

Submitted 23 February, 2020; originally announced February 2020.

Learning to Simulate Complex Physics with Graph Networks

Authors: Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, Peter W. Battaglia

Abstract: Here we present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains, involving fluids, rigid solids, and deformable materials interacting with one another. Our framework---which we term "Graph Network-based Simulators" (GNS)---represents the state of a physical system with particles, expressed as nodes in a graph, and comp… ▽ More Here we present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains, involving fluids, rigid solids, and deformable materials interacting with one another. Our framework---which we term "Graph Network-based Simulators" (GNS)---represents the state of a physical system with particles, expressed as nodes in a graph, and computes dynamics via learned message-passing. Our results show that our model can generalize from single-timestep predictions with thousands of particles during training, to different initial conditions, thousands of timesteps, and at least an order of magnitude more particles at test time. Our model was robust to hyperparameter choices across various evaluation metrics: the main determinants of long-term performance were the number of message-passing steps, and mitigating the accumulation of error by corrupting the training data with noise. Our GNS framework advances the state-of-the-art in learned physical simulation, and holds promise for solving a wide range of complex forward and inverse problems. △ Less

Submitted 14 September, 2020; v1 submitted 21 February, 2020; originally announced February 2020.

Comments: Accepted at ICML 2020

QUBIC: the Q & U Bolometric Interferometer for Cosmology

Authors: E. S. Battistelli, P. Ade, J. G. Alberro, A. Almela, G. Amico, L. H. Arnaldi, D. Auguste, J. Aumont, S. Azzoni, S. Banfi, P. Battaglia, A. Baù, B. Bèlier, D. Bennett, L. Bergè, J. -Ph. Bernard, M. Bersanelli, M. -A. Bigot-Sazy, N. Bleurvacq, J. Bonaparte, J. Bonis, A. Bottani, E. Bunn, D. Burke, D. Buzi , et al. (114 additional authors not shown)

Abstract: The Q & U Bolometric Interferometer for Cosmology, QUBIC, is an innovative experiment designed to measure the polarization of the Cosmic Microwave Background and in particular the signature left therein by the inflationary expansion of the Universe. The expected signal is extremely faint, thus extreme sensitivity and systematic control are necessary in order to attempt this measurement. QUBIC addr… ▽ More The Q & U Bolometric Interferometer for Cosmology, QUBIC, is an innovative experiment designed to measure the polarization of the Cosmic Microwave Background and in particular the signature left therein by the inflationary expansion of the Universe. The expected signal is extremely faint, thus extreme sensitivity and systematic control are necessary in order to attempt this measurement. QUBIC addresses these requirements using an innovative approach combining the sensitivity of Transition Edge Sensor cryogenic bolometers, with the deep control of systematics characteristic of interferometers. This makes QUBIC unique with respect to others classical imagers experiments devoted to the CMB polarization. In this contribution we report a description of the QUBIC instrument including recent achievements and the demonstration of the bolometric interferometry performed in lab. QUBIC will be deployed at the observation site in Alto Chorrillos, in Argentina at the end of 2019. △ Less

Submitted 28 January, 2020; originally announced January 2020.

Comments: Accepted for publication in the Journal of Low Temperature Physics

Combining Q-Learning and Search with Amortized Value Estimates

Authors: Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Tobias Pfaff, Theophane Weber, Lars Buesing, Peter W. Battaglia

Abstract: We introduce "Search with Amortized Value Estimates" (SAVE), an approach for combining model-free Q-learning with model-based Monte-Carlo Tree Search (MCTS). In SAVE, a learned prior over state-action values is used to guide MCTS, which estimates an improved set of state-action values. The new Q-estimates are then used in combination with real experience to update the prior. This effectively amort… ▽ More We introduce "Search with Amortized Value Estimates" (SAVE), an approach for combining model-free Q-learning with model-based Monte-Carlo Tree Search (MCTS). In SAVE, a learned prior over state-action values is used to guide MCTS, which estimates an improved set of state-action values. The new Q-estimates are then used in combination with real experience to update the prior. This effectively amortizes the value computation performed by MCTS, resulting in a cooperative relationship between model-free learning and model-based search. SAVE can be implemented on top of any Q-learning agent with access to a model, which we demonstrate by incorporating it into agents that perform challenging physical reasoning tasks and Atari. SAVE consistently achieves higher rewards with fewer training steps, and---in contrast to typical model-based search approaches---yields strong performance with very small search budgets. By combining real experience with information computed during search, SAVE demonstrates that it is possible to improve on both the performance of model-free learning and the computational cost of planning. △ Less

Submitted 10 January, 2020; v1 submitted 5 December, 2019; originally announced December 2019.

Comments: Published as a conference paper at ICLR 2020

QUBIC: using NbSi TESs with a bolometric interferometer to characterize the polarisation of the CMB

Authors: M. Piat, B. Bélier, L. Bergé, N. Bleurvacq, C. Chapron, S. Dheilly, L. Dumoulin, M. González, L. Grandsire, J. -Ch. Hamilton, S. Henrot-Versillé, D. T. Hoang, S. Marnieros, W. Marty, L. Montier, E. Olivieri, C. Oriol, C. Perbost, D. Prêle, D. Rambaud, M. Salatino, G. Stankowiak, J. -P. Thermeau, S. Torchinsky, F. Voisin , et al. (113 additional authors not shown)

Abstract: QUBIC (Q \& U Bolometric Interferometer for Cosmology) is an international ground-based experiment dedicated in the measurement of the polarized fluctuations of the Cosmic Microwave Background (CMB). It is based on bolometric interferometry, an original detection technique which combine the immunity to systematic effects of an interferometer with the sensitivity of low temperature incoherent detec… ▽ More QUBIC (Q \& U Bolometric Interferometer for Cosmology) is an international ground-based experiment dedicated in the measurement of the polarized fluctuations of the Cosmic Microwave Background (CMB). It is based on bolometric interferometry, an original detection technique which combine the immunity to systematic effects of an interferometer with the sensitivity of low temperature incoherent detectors. QUBIC will be deployed in Argentina, at the Alto Chorrillos mountain site near San Antonio de los Cobres, in the Salta province. The QUBIC detection chain consists in 2048 NbSi Transition Edge Sensors (TESs) cooled to 350mK.The voltage-biased TESs are read out with Time Domain Multiplexing based on Superconducting QUantum Interference Devices (SQUIDs) at 1 K and a novel SiGe Application-Specific Integrated Circuit (ASIC) at 60 K allowing to reach an unprecedented multiplexing (MUX) factor equal to 128. The QUBIC experiment is currently being characterized in the lab with a reduced number of detectors before upgrading to the full instrument. I will present the last results of this characterization phase with a focus on the detectors and readout system. △ Less

Submitted 9 December, 2019; v1 submitted 27 November, 2019; originally announced November 2019.

Comments: Conference proceedings submitted to the Journal of Low Temperature Physics for LTD18

Object-oriented state editing for HRL

Authors: Victor Bapst, Alvaro Sanchez-Gonzalez, Omar Shams, Kimberly Stachenfeld, Peter W. Battaglia, Satinder Singh, Jessica B. Hamrick

Abstract: We introduce agents that use object-oriented reasoning to consider alternate states of the world in order to more quickly find solutions to problems. Specifically, a hierarchical controller directs a low-level agent to behave as if objects in the scene were added, deleted, or modified. The actions taken by the controller are defined over a graph-based representation of the scene, with actions corr… ▽ More We introduce agents that use object-oriented reasoning to consider alternate states of the world in order to more quickly find solutions to problems. Specifically, a hierarchical controller directs a low-level agent to behave as if objects in the scene were added, deleted, or modified. The actions taken by the controller are defined over a graph-based representation of the scene, with actions corresponding to adding, deleting, or editing the nodes of a graph. We present preliminary results on three environments, demonstrating that our approach can achieve similar levels of reward as non-hierarchical agents, but with better data efficiency. △ Less

Submitted 31 October, 2019; originally announced October 2019.

Comments: 8 pages; accepted to the Perception as Generative Reasoning workshop of the 33rd Conference on Neural InformationProcessing Systems (NeurIPS 2019)

Hamiltonian Graph Networks with ODE Integrators

Authors: Alvaro Sanchez-Gonzalez, Victor Bapst, Kyle Cranmer, Peter Battaglia

Abstract: We introduce an approach for imposing physically informed inductive biases in learned simulation models. We combine graph networks with a differentiable ordinary differential equation integrator as a mechanism for predicting future states, and a Hamiltonian as an internal representation. We find that our approach outperforms baselines without these biases in terms of predictive accuracy, energy ac… ▽ More We introduce an approach for imposing physically informed inductive biases in learned simulation models. We combine graph networks with a differentiable ordinary differential equation integrator as a mechanism for predicting future states, and a Hamiltonian as an internal representation. We find that our approach outperforms baselines without these biases in terms of predictive accuracy, energy accuracy, and zero-shot generalization to time-step sizes and integrator orders not experienced during training. This advances the state-of-the-art of learned simulation, and in principle is applicable beyond physical domains. △ Less

Submitted 27 September, 2019; originally announced September 2019.

Learning Symbolic Physics with Graph Networks

Authors: Miles D. Cranmer, Rui Xu, Peter Battaglia, Shirley Ho

Abstract: We introduce an approach for imposing physically motivated inductive biases on graph networks to learn interpretable representations and improved zero-shot generalization. Our experiments show that our graph network models, which implement this inductive bias, can learn message representations equivalent to the true force vector when trained on n-body gravitational and spring-like simulations. We… ▽ More We introduce an approach for imposing physically motivated inductive biases on graph networks to learn interpretable representations and improved zero-shot generalization. Our experiments show that our graph network models, which implement this inductive bias, can learn message representations equivalent to the true force vector when trained on n-body gravitational and spring-like simulations. We use symbolic regression to fit explicit algebraic equations to our trained model's message function and recover the symbolic form of Newton's law of gravitation without prior knowledge. We also show that our model generalizes better at inference time to systems with more bodies than had been experienced during training. Our approach is extensible, in principle, to any unknown interaction law learned by a graph network, and offers a valuable technique for interpreting and inferring explicit causal theories about the world from implicit knowledge captured by deep learning. △ Less

Submitted 1 November, 2019; v1 submitted 12 September, 2019; originally announced September 2019.

Comments: 6 pages; references added + improvements to writing and clarity; accepted for an oral presentation at Machine Learning and the Physical Sciences Workshop @ NeurIPS 2019