Accelerated, Scalable and Reproducible AI-driven Gravitational Wave Detection
Authors:
E. A. Huerta,
Asad Khan,
Xiaobo Huang,
Minyang Tian,
Maksim Levental,
Ryan Chard,
Wei Wei,
Maeve Heflin,
Daniel S. Katz,
Volodymyr Kindratenko,
Dawei Mu,
Ben Blaiszik,
Ian Foster
Abstract:
The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware Accelerated Learning (HAL) cluster, using funcX as a universal distributed…
▽ More
The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware Accelerated Learning (HAL) cluster, using funcX as a universal distributed computing service. Using this workflow, an ensemble of four openly available AI models can be run on HAL to process an entire month's worth (August 2017) of advanced Laser Interferometer Gravitational-Wave Observatory data in just seven minutes, identifying all four all four binary black hole mergers previously identified in this dataset and reporting no misclassifications. This approach combines advances in AI, distributed computing, and scientific data infrastructure to open new pathways to conduct reproducible, accelerated, data-driven discovery.
△ Less
Submitted 9 July, 2021; v1 submitted 15 December, 2020;
originally announced December 2020.
HACC Cosmological Simulations: First Data Release
Authors:
Katrin Heitmann,
Thomas D. Uram,
Hal Finkel,
Nicholas Frontiere,
Salman Habib,
Adrian Pope,
Esteban Rangel,
Joseph Hollowed,
Danila Korytov,
Patricia Larsen,
Benjamin S. Allen,
Kyle Chard,
Ian Foster
Abstract:
We describe the first major public data release from cosmological simulations carried out with Argonne's HACC code. This initial release covers a range of datasets from large gravity-only simulations. The data products include halo information for multiple redshifts, down-sampled particles, and lightcone outputs. We provide data from two very large LCDM simulations as well as beyond-LCDM simulatio…
▽ More
We describe the first major public data release from cosmological simulations carried out with Argonne's HACC code. This initial release covers a range of datasets from large gravity-only simulations. The data products include halo information for multiple redshifts, down-sampled particles, and lightcone outputs. We provide data from two very large LCDM simulations as well as beyond-LCDM simulations spanning eleven w0-wa cosmologies. Our release platform uses Petrel, a research data service, located at the Argonne Leadership Computing Facility. Petrel offers fast data transfer mechanisms and authentication via Globus, enabling simple and efficient access to stored datasets. Easy browsing of the available data products is provided via a web portal that allows the user to navigate simulation products efficiently. The data hub will be extended by adding more types of data products and by enabling computational capabilities to allow direct interactions with simulation results.
△ Less
Submitted 3 October, 2019; v1 submitted 26 April, 2019;
originally announced April 2019.
