-
The Future of Astronomical Data Infrastructure: Meeting Report
Authors:
Michael R. Blanton,
Janet D. Evans,
Dara Norman,
William O'Mullane,
Adrian Price-Whelan,
Luca Rizzi,
Alberto Accomazzi,
Megan Ansdell,
Stephen Bailey,
Paul Barrett,
Steven Berukoff,
Adam Bolton,
Julian Borrill,
Kelle Cruz,
Julianne Dalcanton,
Vandana Desai,
Gregory P. Dubois-Felsmann,
Frossie Economou,
Henry Ferguson,
Bryan Field,
Dan Foreman-Mackey,
Jaime Forero-Romero,
Niall Gaffney,
Kim Gillies,
Matthew J. Graham
, et al. (47 additional authors not shown)
Abstract:
The astronomical community is grappling with the increasing volume and complexity of data produced by modern telescopes, due to difficulties in reducing, accessing, analyzing, and combining archives of data. To address this challenge, we propose the establishment of a coordinating body, an "entity," with the specific mission of enhancing the interoperability, archiving, distribution, and productio…
▽ More
The astronomical community is grappling with the increasing volume and complexity of data produced by modern telescopes, due to difficulties in reducing, accessing, analyzing, and combining archives of data. To address this challenge, we propose the establishment of a coordinating body, an "entity," with the specific mission of enhancing the interoperability, archiving, distribution, and production of both astronomical data and software. This report is the culmination of a workshop held in February 2023 on the Future of Astronomical Data Infrastructure. Attended by 70 scientists and software professionals from ground-based and space-based missions and archives spanning the entire spectrum of astronomical research, the group deliberated on the prevailing state of software and data infrastructure in astronomy, identified pressing issues, and explored potential solutions. In this report, we describe the ecosystem of astronomical data, its existing flaws, and the many gaps, duplication, inconsistencies, barriers to access, drags on productivity, missed opportunities, and risks to the long-term integrity of essential data sets. We also highlight the successes and failures in a set of deep dives into several different illustrative components of the ecosystem, included as an appendix.
△ Less
Submitted 7 November, 2023;
originally announced November 2023.
-
End-to-end science operations in the era of extremely large telescopes
Authors:
Olivier R. Hainaut,
Marie Lemoine-Busserolle,
Christophe Dumas,
Robert W. Goodrich,
Bryan W. Miller,
Michael F. Sterzik,
Thomas Bierwirth,
Sidney Wolff,
Andrew W. Stephens,
Gelys Trancho,
Warren Skidmore,
Kim Gillies
Abstract:
Observatory end-to-end science operations is the overall process starting with a scientific question, represented by a proposal requesting observing time, and ending with the analysis of observation data addressing that question, and including all the intermediate steps needed to plan, schedule, obtain, and process these observations. Increasingly complex observing facilities demand a highly effic…
▽ More
Observatory end-to-end science operations is the overall process starting with a scientific question, represented by a proposal requesting observing time, and ending with the analysis of observation data addressing that question, and including all the intermediate steps needed to plan, schedule, obtain, and process these observations. Increasingly complex observing facilities demand a highly efficient science operations approach and at the same time be user friendly to the astronomical user community and enable the highest possible scientific return. Therefore, this process is supported by a collection of tools. In this paper, we describe the overall end-to-end process and its implementation for the three upcoming extremely large telescopes (ELTs), ESO's ELT, the Thirty Meter Telescope (TMT), and the Giant Magellan Telescope (GMT).
△ Less
Submitted 10 March, 2022;
originally announced March 2022.
-
The Infrared Imaging Spectrograph (IRIS) for TMT: final software design update
Authors:
Edward L. Chapin,
Jennifer Dunn,
Takashi Nakamoto,
Jiman Simon Sohn,
Arun Surya,
Chris Johnson,
Shelley Wright,
Andrea Zonca,
David Andersen,
Eric Chisholm,
Kim Gillies,
Yutaka Hayano,
Glen Herriot,
Dan Kerley,
James Larkin,
Ryuji Suzuki
Abstract:
The InfraRed Imaging Spectrograph (IRIS) is the first-light client instrument for the Narrow Field Infrared Adaptive Optics System (NFIRAOS) on the Thirty Meter Telescope (TMT). Now approaching the end of its final design phase, we provide an overview of the instrument control software. The design is challenging since IRIS has interfaces with many systems at different stages of development (e.g.,…
▽ More
The InfraRed Imaging Spectrograph (IRIS) is the first-light client instrument for the Narrow Field Infrared Adaptive Optics System (NFIRAOS) on the Thirty Meter Telescope (TMT). Now approaching the end of its final design phase, we provide an overview of the instrument control software. The design is challenging since IRIS has interfaces with many systems at different stages of development (e.g., NFIRAOS, telescope control system, observatory sequencers), and will be built using the newly-developed TMT Common Software (CSW), which provides framework code (Java/Scala), and services (e.g., commands, telemetry). Lower-level software will be written in a combination of Java and C/C++ to communicate with hardware, such as motion controllers and infrared detectors. The overall architecture and philosophy of the IRIS software is presented, as well as a summary of the individual software components and their interactions with other systems.
△ Less
Submitted 13 August, 2021;
originally announced August 2021.
-
The Infrared Imaging Spectrograph (IRIS) for TMT: closed-loop adaptive optics while dithering
Authors:
Edward L. Chapin,
Jennifer Dunn,
David Andersen,
Glen Herriot,
Dan Kerley,
Takashi Nakamoto,
Jimmy Johnson,
Lianqi Wang,
Gelys Trancho,
Eric Chisholm,
Brent Ellerbroek,
Kim Gillies,
Yutaka Hayano,
James Larkin,
Luc Simard,
Mark Sirota,
Ryuji Suzuki,
Bob Weber,
Shelley Wright,
Kai Zhang
Abstract:
The InfraRed Imaging Spectrograph (IRIS) is the first-light client instrument for the Narrow Field Infrared Adaptive Optics System (NFIRAOS) on the Thirty Meter Telescope (TMT). IRIS includes three natural guide star (NGS) On-Instrument Wavefront Sensors (OIWFS) to measure tip/tilt and focus errors in the instrument focal plane. NFIRAOS also has an internal natural guide star wavefront sensor, and…
▽ More
The InfraRed Imaging Spectrograph (IRIS) is the first-light client instrument for the Narrow Field Infrared Adaptive Optics System (NFIRAOS) on the Thirty Meter Telescope (TMT). IRIS includes three natural guide star (NGS) On-Instrument Wavefront Sensors (OIWFS) to measure tip/tilt and focus errors in the instrument focal plane. NFIRAOS also has an internal natural guide star wavefront sensor, and IRIS and NFIRAOS must precisely coordinate the motions of their wavefront sensor positioners to track the locations of NGSs while the telescope is dithering (offsetting the telescope to cover more area), to avoid a costly re-acquisition time penalty. First, we present an overview of the sequencing strategy for all of the involved subsystems. We then predict the motion of the telescope during dithers based on finite-element models provided by TMT, and finally analyze latency and jitter issues affecting the propagation of position demands from the telescope control system to individual motor controllers.
△ Less
Submitted 22 August, 2018;
originally announced August 2018.
-
The Infrared Imaging Spectrograph (IRIS) for TMT: advancing the data reduction system
Authors:
Gregory L. Walth,
Shelley A. Wright,
Nils-Erik Rundquist,
David Andersen,
Edward Chapin,
Eric Chisholm,
Tuan Do,
Jennifer Dunn,
Brent Ellerbroek,
Kim Gillies,
Yutaka Hayano,
Chris Johnson,
James Larkin,
Takashi Nakamoto,
Reed Riddle,
Luc Simard,
Roger Smith,
Ryuji Suzuki,
Ji Man Sohn,
Robert Weber,
Jason Weissd,
Kai Zhang
Abstract:
Infrared Imaging Spectrograph (IRIS) is the first light instrument for the Thirty Meter Telescope (TMT) that consists of a near-infrared (0.84 to 2.4 micron) imager and integral field spectrograph (IFS) which operates at the diffraction-limit utilizing the Narrow-Field Infrared Adaptive Optics System (NFIRAOS). The imager will have a 34 arcsec x 34 arcsec field of view with 4 milliarcsecond (mas)…
▽ More
Infrared Imaging Spectrograph (IRIS) is the first light instrument for the Thirty Meter Telescope (TMT) that consists of a near-infrared (0.84 to 2.4 micron) imager and integral field spectrograph (IFS) which operates at the diffraction-limit utilizing the Narrow-Field Infrared Adaptive Optics System (NFIRAOS). The imager will have a 34 arcsec x 34 arcsec field of view with 4 milliarcsecond (mas) pixels. The IFS consists of a lenslet array and slicer, enabling four plate scales from 4 mas to 50 mas, multiple gratings and filters, which in turn will operate hundreds of individual modes. IRIS, operating in concert with NFIRAOS will pose many challenges for the data reduction system (DRS). Here we present the updated design of the real-time and post-processing DRS. The DRS will support two modes of operation of IRIS: (1) writing the raw readouts sent from the detectors and performing the sampling on all of the readouts for a given exposure to create a raw science frame; and (2) reduction of data from the imager, lenslet array and slicer IFS. IRIS is planning to save the raw readouts for a given exposure to enable sophisticated processing capabilities to the end users, such as the ability to remove individual poor seeing readouts to improve signal-to-noise, or from advanced knowledge of the point spread function (PSF). The readout processor (ROP) is a key part of the IRIS DRS design for writing and sampling of the raw readouts into a raw science frame, which will be passed to the TMT data archive. We discuss the use of sub-arrays on the imager detectors for saturation/persistence mitigation, on-detector guide windows, and fast readout science cases (< 1 second).
△ Less
Submitted 22 August, 2018;
originally announced August 2018.
-
The Infrared Imaging Spectrograph (IRIS) for TMT: Data Reduction System
Authors:
Gregory Walth,
Shelley A. Wright,
Jason Weiss,
James E. Larkin,
Anna M. Moore,
Edward L. Chapin,
Tuan Do,
Jennifer Dunn,
Brent Ellerbroek,
Kim Gillies,
Yutaka Hayano,
Chris Johnson,
Daniel Marshall,
Reed L. Riddle,
Luc Simard,
Ji Man Sohn,
Ryuji Suzuki,
James Wincensten
Abstract:
IRIS (InfraRed Imaging Spectrograph) is the diffraction-limited first light instrument for the Thirty Meter Telescope (TMT) that consists of a near-infrared (0.84 to 2.4 $μ$m) imager and integral field spectrograph (IFS). The IFS makes use of a lenslet array and slicer for spatial sampling, which will be able to operate in 100's of different modes, including a combination of four plate scales from…
▽ More
IRIS (InfraRed Imaging Spectrograph) is the diffraction-limited first light instrument for the Thirty Meter Telescope (TMT) that consists of a near-infrared (0.84 to 2.4 $μ$m) imager and integral field spectrograph (IFS). The IFS makes use of a lenslet array and slicer for spatial sampling, which will be able to operate in 100's of different modes, including a combination of four plate scales from 4 milliarcseconds (mas) to 50 mas with a large range of filters and gratings. The imager will have a field of view of 34$\times$34 arcsec$^{2}$ with a plate scale of 4 mas with many selectable filters. We present the preliminary design of the data reduction system (DRS) for IRIS that need to address all of these observing modes. Reduction of IRIS data will have unique challenges since it will provide real-time reduction and analysis of the imaging and spectroscopic data during observational sequences, as well as advanced post-processing algorithms. The DRS will support three basic modes of operation of IRIS; reducing data from the imager, the lenslet IFS, and slicer IFS. The DRS will be written in Python, making use of open-source astronomical packages available. In addition to real-time data reduction, the DRS will utilize real-time visualization tools, providing astronomers with up-to-date evaluation of the target acquisition and data quality. The quicklook suite will include visualization tools for 1D, 2D, and 3D raw and reduced images. We discuss the overall requirements of the DRS and visualization tools, as well as necessary calibration data to achieve optimal data quality in order to exploit science cases across all cosmic distance scales.
△ Less
Submitted 4 August, 2016;
originally announced August 2016.
-
The Infrared Imaging Spectrograph (IRIS) for TMT: motion planning with collision avoidance for the on-instrument wavefront sensors
Authors:
Edward L. Chapin,
Jennifer Dunn,
Jason Weiss,
Kim Gillies,
Yutaka Hayano,
Chris Johnson,
James Larkin,
Anna Moore,
Reed L. Riddle,
Ji Man Sohn,
Roger Smith,
Ryuji Suzuki,
Gregory Walth,
Shelley Wright
Abstract:
The InfraRed Imaging Spectrograph (IRIS) will be a first-light client instrument for the Narrow Field Infrared Adaptive Optics System (NFIRAOS) on the Thirty Meter Telescope. IRIS includes three configurable tip/tilt (TT) or tip/tilt/focus (TTF) On-Instrument Wavefront Sensors (OIWFS). These sensors are positioned over natural guide star (NGS) asterisms using movable polar-coordinate pick-off arms…
▽ More
The InfraRed Imaging Spectrograph (IRIS) will be a first-light client instrument for the Narrow Field Infrared Adaptive Optics System (NFIRAOS) on the Thirty Meter Telescope. IRIS includes three configurable tip/tilt (TT) or tip/tilt/focus (TTF) On-Instrument Wavefront Sensors (OIWFS). These sensors are positioned over natural guide star (NGS) asterisms using movable polar-coordinate pick-off arms (POA) that patrol an approximately 2-arcminute circular field-of-view (FOV). The POAs are capable of colliding with one another, so an algorithm for coordinated motion that avoids contact is required. We have adopted an approach in which arm motion is evaluated using the gradient descent of a scalar potential field that includes an attractive component towards the goal configuration (locations of target stars), and repulsive components to avoid obstacles (proximity to adjacent arms). The resulting vector field is further modified by adding a component transverse to the repulsive gradient to avoid problematic local minima in the potential. We present path planning simulations using this computationally inexpensive technique, which exhibit smooth and efficient trajectories.
△ Less
Submitted 4 August, 2016;
originally announced August 2016.
