-
A data science platform to enable time-domain astronomy
Authors:
Michael W. Coughlin,
Joshua S. Bloom,
Guy Nir,
Sarah Antier,
Theophile Jegou du Laz,
Stéfan van der Walt,
Arien Crellin-Quick,
Thomas Culino,
Dmitry A. Duev,
Daniel A. Goldstein,
Brian F. Healy,
Viraj Karambelkar,
Jada Lilleboe,
Kyung Min Shin,
Leo P. Singer,
Tomas Ahumada,
Shreya Anand,
Eric C. Bellm,
Richard Dekany,
Matthew J. Graham,
Mansi M. Kasliwal,
Ivona Kostadinova,
R. Weizmann Kiendrebeogo,
Shrinivas R. Kulkarni,
Sydney Jenkins
, et al. (28 additional authors not shown)
Abstract:
SkyPortal is an open-source software package designed to efficiently discover interesting transients, manage follow-up, perform characterization, and visualize the results. By enabling fast access to archival and catalog data, cross-matching heterogeneous data streams, and the triggering and monitoring of on-demand observations for further characterization, a SkyPortal-based platform has been oper…
▽ More
SkyPortal is an open-source software package designed to efficiently discover interesting transients, manage follow-up, perform characterization, and visualize the results. By enabling fast access to archival and catalog data, cross-matching heterogeneous data streams, and the triggering and monitoring of on-demand observations for further characterization, a SkyPortal-based platform has been operating at scale for 2 yr for the Zwicky Transient Facility Phase II community, with hundreds of users, containing tens of millions of time-domain sources, interacting with dozens of telescopes, and enabling community reporting. While SkyPortal emphasizes rich user experiences (UX) across common frontend workflows, recognizing that scientific inquiry is increasingly performed programmatically, SkyPortal also surfaces an extensive and well-documented API system. From backend and frontend software to data science analysis tools and visualization frameworks, the SkyPortal design emphasizes the re-use and leveraging of best-in-class approaches, with a strong extensibility ethos. For instance, SkyPortal now leverages ChatGPT large-language models (LLMs) to automatically generate and surface source-level human-readable summaries. With the imminent re-start of the next-generation of gravitational wave detectors, SkyPortal now also includes dedicated multi-messenger features addressing the requirements of rapid multi-messenger follow-up: multi-telescope management, team/group organizing interfaces, and cross-matching of multi-messenger data streams with time-domain optical surveys, with interfaces sufficiently intuitive for the newcomers to the field. (abridged)
△ Less
Submitted 14 June, 2023; v1 submitted 28 April, 2023;
originally announced May 2023.
-
Foraging with MUSHROOMS: A Mixed-Integer Linear Programming Scheduler for Multimessenger Target of Opportunity Searches with the Zwicky Transient Facility
Authors:
B. Parazin,
Michael W. Coughlin,
Leo P. Singer,
Vaidehi Gupta,
Shreya Anand
Abstract:
Electromagnetic follow-up of gravitational wave detections is very resource intensive, taking up hours of limited observation time on dozens of telescopes. Creating more efficient schedules for follow-up will lead to a commensurate increase in counterpart location efficiency without using more telescope time. Widely used in operations research and telescope scheduling, mixed integer linear program…
▽ More
Electromagnetic follow-up of gravitational wave detections is very resource intensive, taking up hours of limited observation time on dozens of telescopes. Creating more efficient schedules for follow-up will lead to a commensurate increase in counterpart location efficiency without using more telescope time. Widely used in operations research and telescope scheduling, mixed integer linear programming (MILP) is a strong candidate to produce these higher-efficiency schedules, as it can make use of powerful commercial solvers that find globally optimal solutions to provided problems . We detail a new target of opportunity scheduling algorithm designed with Zwicky Transient Facility in mind that uses mixed integer linear programming. We compare its performance to \texttt{gwemopt}, the tuned heuristic scheduler used by the Zwicky Transient Facility and other facilities during the third LIGO-Virgo gravitational wave observing run. This new algorithm uses variable-length observing blocks to enforce cadence requirements and ensure field observability, along with having a secondary optimization step to minimize slew time. \blue{We show that by employing a hybrid method utilizing both this scheduler and \texttt{gwemopt}, the previous scheduler used, in concert, we can achieve an average improvement in detection efficiency of 3\%-11\% over \texttt{gwemopt} alone} for a simulated binary neutron star merger data set consistent with LIGO-Virgo's third observing run, highlighting the potential of mixed integer target of opportunity schedulers for future multimessenger follow-up surveys.
△ Less
Submitted 11 July, 2022; v1 submitted 28 February, 2022;
originally announced March 2022.
-
HEALPix Alchemy: Fast All-Sky Geometry and Image Arithmetic in a Relational Database for Multimessenger Astronomy Brokers
Authors:
Leo P. Singer,
B. Parazin,
Michael W. Coughlin,
Joshua S. Bloom,
Arien Crellin-Quick,
Daniel A. Goldstein,
Stéfan van der Walt
Abstract:
Efficient searches for electromagnetic counterparts to gravitational wave, high-energy neutrino, and gamma-ray burst events demand rapid processing of image arithmetic and geometry set operations in a database to cross-match galaxy catalogs, observation footprints, and all-sky images. Here we introduce HEALPix Alchemy, an open-source, pure Python implementation of a set of methods that enables rap…
▽ More
Efficient searches for electromagnetic counterparts to gravitational wave, high-energy neutrino, and gamma-ray burst events demand rapid processing of image arithmetic and geometry set operations in a database to cross-match galaxy catalogs, observation footprints, and all-sky images. Here we introduce HEALPix Alchemy, an open-source, pure Python implementation of a set of methods that enables rapid all-sky geometry calculations. HEALPix Alchemy is built upon HEALPix, a spatial indexing strategy that is widely used in astronomical databases as well as the native format of LIGO-Virgo-KAGRA gravitational-wave sky localization maps. Our approach leverages new multirange types built into the PostgreSQL 14 database engine. This enables fast all-sky queries against probabilistic multimessenger event localizations and telescope survey footprints. Questions such as "What are the galaxies contained within the 90% credible region of an event?" and "What is the rank-ordered list of the fields within an observing footprint with the highest probability of containing the event?" can be performed in less than a few seconds on commodity hardware using off-the-shelf cloud-managed database implementations without server-side database extensions. Common queries scale roughly linearly with the number of telescope pointings. As the number of fields grows into the hundreds or thousands, HEALPix Alchemy is orders of magnitude faster than other implementations. HEALPix Alchemy is now used as the spatial geometry engine within SkyPortal, which forms the basis of the Zwicky Transient Facility transient marshal, called Fritz.
△ Less
Submitted 27 April, 2022; v1 submitted 13 December, 2021;
originally announced December 2021.
-
Science with the Ultraviolet Explorer (UVEX)
Authors:
S. R. Kulkarni,
Fiona A. Harrison,
Brian W. Grefenstette,
Hannah P. Earnshaw,
Igor Andreoni,
Danielle A. Berg,
Joshua S. Bloom,
S. Bradley Cenko,
Ryan Chornock,
Jessie L. Christiansen,
Michael W. Coughlin,
Alexander Wuollet Criswell,
Behnam Darvish,
Kaustav K. Das,
Kishalay De,
Luc Dessart,
Don Dixon,
Bas Dorsman,
Kareem El-Badry,
Christopher Evans,
K. E. Saavik Ford,
Christoffer Fremling,
Boris T. Gansicke,
Suvi Gezari,
Y. Goetberg
, et al. (31 additional authors not shown)
Abstract:
UVEX is a proposed medium class Explorer mission designed to provide crucial missing capabilities that will address objectives central to a broad range of modern astrophysics. The UVEX design has two co-aligned wide-field imagers operating in the FUV and NUV and a powerful broadband medium resolution spectrometer. In its two-year baseline mission, UVEX will perform a multi-cadence synoptic all-sky…
▽ More
UVEX is a proposed medium class Explorer mission designed to provide crucial missing capabilities that will address objectives central to a broad range of modern astrophysics. The UVEX design has two co-aligned wide-field imagers operating in the FUV and NUV and a powerful broadband medium resolution spectrometer. In its two-year baseline mission, UVEX will perform a multi-cadence synoptic all-sky survey 50/100 times deeper than GALEX in the NUV/FUV, cadenced surveys of the Large and Small Magellanic Clouds, rapid target of opportunity followup, as well as spectroscopic followup of samples of stars and galaxies. The science program is built around three pillars. First, UVEX will explore the low-mass, low-metallicity galaxy frontier through imaging and spectroscopic surveys that will probe key aspects of the evolution of galaxies by understanding how star formation and stellar evolution at low metallicities affect the growth and evolution of low-metallicity, low-mass galaxies in the local universe. Such galaxies contain half the mass in the local universe, and are analogs for the first galaxies, but observed at distances that make them accessible to detailed study. Second, UVEX will explore the dynamic universe through time-domain surveys and prompt spectroscopic followup capability will probe the environments, energetics, and emission processes in the early aftermaths of gravitational wave-discovered compact object mergers, discover hot, fast UV transients, and diagnose the early stages of stellar explosions. Finally, UVEX will become a key community resource by leaving a large all-sky legacy data set, enabling a wide range of scientific studies and filling a gap in the new generation of wide-field, sensitive optical and infrared surveys provided by the Rubin, Euclid, and Roman observatories. This paper discusses the scientific potential of UVEX, and the broad scientific program.
△ Less
Submitted 17 January, 2023; v1 submitted 30 November, 2021;
originally announced November 2021.
-
Target of Opportunity Observations of Gravitational Wave Events with Vera C. Rubin Observatory
Authors:
Igor Andreoni,
Raffaella Margutti,
Om Sharan Salafia,
B. Parazin,
V. Ashley Villar,
Michael W. Coughlin,
Peter Yoachim,
Kris Mortensen,
Daniel Brethauer,
S. J. Smartt,
Mansi M. Kasliwal,
Kate D. Alexander,
Shreya Anand,
E. Berger,
Maria Grazia Bernardini,
Federica B. Bianco,
Peter K. Blanchard,
Joshua S. Bloom,
Enzo Brocato,
Mattia Bulla,
Regis Cartier,
S. Bradley Cenko,
Ryan Chornock,
Christopher M. Copperwheat,
Alessandra Corsi
, et al. (30 additional authors not shown)
Abstract:
The discovery of the electromagnetic counterpart to the binary neutron star merger GW170817 has opened the era of gravitational-wave multi-messenger astronomy. Rapid identification of the optical/infrared kilonova enabled a precise localization of the source, which paved the way to deep multi-wavelength follow-up and its myriad of related science results. Fully exploiting this new territory of exp…
▽ More
The discovery of the electromagnetic counterpart to the binary neutron star merger GW170817 has opened the era of gravitational-wave multi-messenger astronomy. Rapid identification of the optical/infrared kilonova enabled a precise localization of the source, which paved the way to deep multi-wavelength follow-up and its myriad of related science results. Fully exploiting this new territory of exploration requires the acquisition of electromagnetic data from samples of neutron star mergers and other gravitational wave sources. After GW170817, the frontier is now to map the diversity of kilonova properties and provide more stringent constraints on the Hubble constant, and enable new tests of fundamental physics. The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) can play a key role in this field in the 2020s, when an improved network of gravitational-wave detectors is expected to reach a sensitivity that will enable the discovery of a high rate of merger events involving neutron stars (about tens per year) out to distances of several hundred Mpc. We design comprehensive target-of-opportunity observing strategies for follow-up of gravitational-wave triggers that will make the Rubin Observatory the premier instrument for discovery and early characterization of neutron star and other compact object mergers, and yet unknown classes of gravitational wave events.
△ Less
Submitted 20 April, 2022; v1 submitted 2 November, 2021;
originally announced November 2021.
