-
Integration of Data Reduction and Near Real-Time Archiving into the Keck Observing Model
Authors:
Max Brodheim,
John O'Meara,
Jeffrey A. Mader,
G. Bruce Berriman,
Matthew Brown,
Lucas Furhman,
Tyler Tucker,
Christopher R. Gelino,
Meca S. Lynn,
Melanie A. Swain
Abstract:
The W. M. Keck Observatory is welcoming a new era where data reduction and archiving are tightly integrated into our observing model, under the auspices of the Observatory's Data Services Initiative (DSI) project. While previously the Keck Observatory Archive (KOA) archived minimally processed, raw science data the day after observing, Keck is transitioning to a model in which it archives both raw…
▽ More
The W. M. Keck Observatory is welcoming a new era where data reduction and archiving are tightly integrated into our observing model, under the auspices of the Observatory's Data Services Initiative (DSI) project. While previously the Keck Observatory Archive (KOA) archived minimally processed, raw science data the day after observing, Keck is transitioning to a model in which it archives both raw frames and reduced data in near real-time. These data will be made available to observers and collaborators immediately upon ingestion through a dedicated new interface that will support collaboration and sharing among teams, as well as stream data directly to personal computers without access to WMKO's internal networks. Both the raw and science-ready data products will be made publicly available upon the expiration of data protections.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
Advancements in Streamlining Time-Domain and Multi-Messenger Astronomy Follow-Up Infrastructure at Keck Observatory
Authors:
Chien-Hsiu Lee,
Jeffrey A. Mader,
Tyler Coda,
Jo Hayashi,
Max Brodheim,
Lucas Fuhrman
Abstract:
With active time-domain surveys like the Zwicky Transient Facility, the anticipated Rubin Observatory's Legacy Survey of Space and Time, and multi-messenger experiments such as LIGO/VIRGO/KANGRA for gravitational wave detection and IceCube for high-energy neutrino events, there is a new era in both time-domain and multi-messenger astronomy. The Astro2020 decadal survey highlights effectively respo…
▽ More
With active time-domain surveys like the Zwicky Transient Facility, the anticipated Rubin Observatory's Legacy Survey of Space and Time, and multi-messenger experiments such as LIGO/VIRGO/KANGRA for gravitational wave detection and IceCube for high-energy neutrino events, there is a new era in both time-domain and multi-messenger astronomy. The Astro2020 decadal survey highlights effectively responding to these astronomical alerts in a timely manner as a priority, and thus, there is an urgent need for the development of a seamless follow-up infrastructure at existing facilities that are capable of following up on detections at the survey depths. At the W. M. Keck Observatory (WMKO), we are actively constructing critical infrastructure, aimed at facilitating the Target-of-Opportunity (ToO) trigger, optimizing observational planning, streamlining data acquisition, and enhancing data product accessibility. In this document, we provide an overview of these developing services and place them in context of existing observatory infrastructure like the Keck Observatory Archive (KOA) and Data Services Initiative (DSI).
△ Less
Submitted 2 May, 2024;
originally announced May 2024.
-
A case study in adaptable and reusable infrastructure at the Keck Observatory Archive: VO interfaces, moving targets, and more
Authors:
G. Bruce Berriman,
Richard W. Cohen,
Andrew Colson,
Christopher R. Gelino,
John C. Good,
Mihseh Kong,
Anastasia C. Laity,
Jeffrey A. Mader,
Melanie A. Swain,
Hien D. Tran,
Shin-Ywan Wang
Abstract:
This paper describes how the Keck Observatory Archive (KOA) is extending open source software components to develop new services. In August 2015, KOA deployed a program interface to discover public data from all instruments equipped with an imaging mode. The interface complies with version 2 of the Simple Imaging Access Protocol (SIAP), under development by the International Virtual Observatory Al…
▽ More
This paper describes how the Keck Observatory Archive (KOA) is extending open source software components to develop new services. In August 2015, KOA deployed a program interface to discover public data from all instruments equipped with an imaging mode. The interface complies with version 2 of the Simple Imaging Access Protocol (SIAP), under development by the International Virtual Observatory Alliance (IVOA), which defines a standard mechanism for discovering images through spatial queries. The heart of the KOA service is an R-tree-based, database-indexing mechanism prototyped by the Virtual Astronomical Observatory (VAO) and further developed by the Montage Image Mosaic project, designed to provide fast access to large imaging data sets as a first step in creating wide-area image mosaics. The KOA service uses the results of the spatial R-tree search to create an SQLite data database for further relational filtering. The service uses a JSON configuration file to describe the association between instrument parameters and the service query parameters, and to make it applicable beyond the Keck instruments.
The R-tree program was itself extended to support temporal (in addition to spatial) indexing, in response to requests from the planetary science community for a search engine to discover observations of Solar System objects. With this 3D-indexing scheme, the service performs very fast time and spatial matches between the target ephemerides, obtained from the JPL SPICE service. Our experiments indicate these matches can be more than 100 times faster than when separating temporal and spatial searches. Images of the tracks of the moving targets, overlaid with the image footprints, are computed with a new command-line visualization tool, mViewer, released with the Montage distribution. The service is currently in test and will be released in Fall 2016.
△ Less
Submitted 8 August, 2016;
originally announced August 2016.
-
Metadata and Data Management for the Keck Observatory Archive
Authors:
H. D. Tran,
J. Holt,
R. W. Goodrich,
J. A. Mader,
M. Swain,
A. C. Laity,
M. Kong,
C. R. Gelino,
G. B. Berriman
Abstract:
A collaboration between the W. M. Keck Observatory (WMKO) in Hawaii and the NASA Exoplanet Science Institute (NExScI) in California, the Keck Observatory Archive (KOA) was commissioned in 2004 to archive observing data from WMKO, which operates two classically scheduled 10 m ground-based telescopes. The observing data from Keck is not suitable for direct ingestion into the archive since the metada…
▽ More
A collaboration between the W. M. Keck Observatory (WMKO) in Hawaii and the NASA Exoplanet Science Institute (NExScI) in California, the Keck Observatory Archive (KOA) was commissioned in 2004 to archive observing data from WMKO, which operates two classically scheduled 10 m ground-based telescopes. The observing data from Keck is not suitable for direct ingestion into the archive since the metadata contained in the original FITS headers lack the information necessary for proper archiving. Coupled with different standards among instrument builders and the heterogeneous nature of the data inherent in classical observing, in which observers have complete control of the instruments and their observations, the data pose a number of technical challenges for KOA. We describe the methodologies and tools that we have developed to successfully address these difficulties, adding content to the FITS headers and "retrofitting" the metadata in order to support archiving Keck data, especially those obtained before the archive was designed. With the expertise gained from having successfully archived observations taken with all eight currently active instruments at WMKO, we have developed lessons learned from handling this complex array of heterogeneous metadata that help ensure a smooth ingestion of data not only for current but also future instruments, as well as a better experience for the archive user.
△ Less
Submitted 21 August, 2014;
originally announced August 2014.
-
The Design and Operation of The Keck Observatory Archive
Authors:
G. Bruce Berriman,
Christopher R. Gelino,
Robert W. Goodrich,
Jennifer Holt,
Mihseh Kong,
Anastasia C. Laity,
Jeffrey A. Mader,
Melanie Swain,
Hien D. Tran
Abstract:
The Infrared Processing and Analysis Center (IPAC) and the W. M. Keck Observatory (WMKO) operate an archive for the Keck Observatory. At the end of 2013, KOA completed the ingestion of data from all eight active observatory instruments. KOA will continue to ingest all newly obtained observations, at an anticipated volume of 4 TB per year. The data are transmitted electronically from WMKO to IPAC f…
▽ More
The Infrared Processing and Analysis Center (IPAC) and the W. M. Keck Observatory (WMKO) operate an archive for the Keck Observatory. At the end of 2013, KOA completed the ingestion of data from all eight active observatory instruments. KOA will continue to ingest all newly obtained observations, at an anticipated volume of 4 TB per year. The data are transmitted electronically from WMKO to IPAC for storage and curation. Access to data is governed by a data use policy, and approximately two-thirds of the data in the archive are public.
△ Less
Submitted 4 August, 2014;
originally announced August 2014.
-
Indecent Exposure in Seyfert 2 Galaxies: A Close Look
Authors:
Hien D. Tran,
James E. Lyke,
Jeff A. Mader
Abstract:
NGC 3147, NGC 4698 and 1ES 1927+654 are active galaxies that are classified as Seyfert 2s, based on the line ratios of strong narrow emission lines in their optical spectra. However, they exhibit rapid X-ray spectral variability and/or little indication of obscuration in X-ray spectral fitting, contrary to expectation from the active galactic nucleus (AGN) unification model. Using optical spectrop…
▽ More
NGC 3147, NGC 4698 and 1ES 1927+654 are active galaxies that are classified as Seyfert 2s, based on the line ratios of strong narrow emission lines in their optical spectra. However, they exhibit rapid X-ray spectral variability and/or little indication of obscuration in X-ray spectral fitting, contrary to expectation from the active galactic nucleus (AGN) unification model. Using optical spectropolarimetry with LRIS and near-infrared spectroscopy with NIRSPEC at the W. M. Keck Observatory, we conducted a deep search for hidden polarized broad H-alpha and direct broad Pa-beta or Br-gamma emission lines in these objects. We found no evidence for any broad emission lines from the active nucleus of these galaxies, suggesting that they are unobscured, completely "naked" AGNs that intrinsically lack broad-line regions.
△ Less
Submitted 17 December, 2010; v1 submitted 8 December, 2010;
originally announced December 2010.
-
Optical Spectroscopy of Type Ia Supernovae
Authors:
T. Matheson,
R. P. Kirshner,
P. Challis,
S. Jha,
P. M. Garnavich,
P. Berlind,
M. L. Calkins,
S. Blondin,
Z. Balog,
A. E. Bragg,
N. Caldwell,
K. Dendy Concannon,
E. E. Falco,
G. J. M. Graves,
J. P. Huchra,
J. Kuraszkiewicz,
J. A. Mader,
A. Mahdavi,
M. Phelps,
K. Rines,
I. Song,
B. J. Wilkes
Abstract:
We present 432 low-dispersion optical spectra of 32 Type Ia supernovae (SNe Ia) that also have well-calibrated light curves. The coverage ranges from 6 epochs to 36 epochs of spectroscopy. Most of the data were obtained with the 1.5m Tillinghast telescope at the F. L. Whipple Observatory with typical wavelength coverage of 3700-7400A and a resolution of ~7A. The earliest spectra are thirteen day…
▽ More
We present 432 low-dispersion optical spectra of 32 Type Ia supernovae (SNe Ia) that also have well-calibrated light curves. The coverage ranges from 6 epochs to 36 epochs of spectroscopy. Most of the data were obtained with the 1.5m Tillinghast telescope at the F. L. Whipple Observatory with typical wavelength coverage of 3700-7400A and a resolution of ~7A. The earliest spectra are thirteen days before B-band maximum; two-thirds of the SNe were observed before maximum brightness. Coverage for some SNe continues almost to the nebular phase. The consistency of the method of observation and the technique of reduction makes this an ideal data set for studying the spectroscopic diversity of SNe Ia.
△ Less
Submitted 12 March, 2008;
originally announced March 2008.
-
The Eclipsing Binary V1061 Cygni: Confronting Stellar Evolution Models for Active and Inactive Solar-Type Stars
Authors:
Guillermo Torres,
Claud H. Sandberg Lacy,
Laurence A. Marschall,
Holly A. Sheets,
Jeff A. Mader
Abstract:
(Abridged) We present spectroscopic and photometric observations of the eclipsing system V1061 Cyg (P = 2.35 days). We show that it is a hierarchical triple in which the third star is visible in the spectra. We combine the radial velocities for the three stars, times of eclipse, and intermediate astrometric data from the HIPPARCOS mission (abscissa residuals) to establish the elements of the out…
▽ More
(Abridged) We present spectroscopic and photometric observations of the eclipsing system V1061 Cyg (P = 2.35 days). We show that it is a hierarchical triple in which the third star is visible in the spectra. We combine the radial velocities for the three stars, times of eclipse, and intermediate astrometric data from the HIPPARCOS mission (abscissa residuals) to establish the elements of the outer orbit (P = 15.8 yr) and accurate values for the masses and radii (1-2% errors) and the effective temperatures of the binary components. Both stars are rotating rapidly and have their rotation synchronized with the orbital motion. There are signs of activity including strong X-ray emission and possibly spots. Current stellar evolution models agree well with the properties of the primary, but show a very large discrepancy in the radius of the secondary: the predicted values are about 10% smaller than observed (a 5-sigma effect). Also, the temperature is cooler than predicted by some 200 K. These discrepancies are quite remarkable given that the star is only 7% less massive than the Sun, the calibration point of all stellar models. We identify the chromospheric activity as the likely cause of the effect. Inactive stars agree very well with the models, while active ones such as V1061 Cyg Ab appear systematically too large and too cool. Theory provides an understanding of this in terms of the strong magnetic fields commonly associated with stellar activity, which tend to inhibit convective heat transport.
△ Less
Submitted 2 December, 2005;
originally announced December 2005.
-
The Team Keck Treasury Redshift Survey of the GOODS-North Field
Authors:
Gregory D. Wirth,
Christopher N. A. Willmer,
Paola Amico,
Frederic H. Chaffee,
Robert W. Goodrich,
Shui Kwok,
James E. Lyke,
Jeff A. Mader,
Hien D. Tran,
Amy J. Barger,
Lennox L. Cowie,
Peter Capak,
Alison L. Coil,
Michael C. Cooper,
Al Conrad,
Marc Davis,
S. M. Faber,
Esther M. Hu,
David C. Koo,
David Le Mignant,
Jeffrey A. Newman,
Antoinette Songaila
Abstract:
We report the results of an extensive imaging and spectroscopic survey in the GOODS-North field completed using DEIMOS on the Keck II telescope. Observations of 2018 targets in a magnitude-limited sample of 2911 objects to R=24.4 yield secure redshifts for a sample of 1440 galaxies and AGN plus 96 stars. In addition to redshifts and associated quality assessments, our catalog also includes photo…
▽ More
We report the results of an extensive imaging and spectroscopic survey in the GOODS-North field completed using DEIMOS on the Keck II telescope. Observations of 2018 targets in a magnitude-limited sample of 2911 objects to R=24.4 yield secure redshifts for a sample of 1440 galaxies and AGN plus 96 stars. In addition to redshifts and associated quality assessments, our catalog also includes photometric and astrometric measurements for all targets detected in our R-band imaging survey of the GOODS-North region. We investigate various sources of incompleteness and find the redshift catalog to be 53% complete at its limiting magnitude. The median redshift of z=0.65 is lower than in similar deep surveys because we did not select against low-redshift targets. Comparison with other redshift surveys in the same field, including a complementary Hawaii-led DEIMOS survey, establishes that our velocity uncertainties are as low as 40 km/s for red galaxies and that our redshift confidence assessments are accurate. The distributions of rest-frame magnitudes and colors among the sample agree well with model predictions out to and beyond z=1. We will release all survey data, including extracted 1-D and sky-subtracted 2-D spectra, thus providing a sizable and homogeneous database for the GOODS-North field which will enable studies of large scale structure, spectral indices, internal galaxy kinematics, and the predictive capabilities of photometric redshifts.
△ Less
Submitted 11 February, 2004; v1 submitted 18 January, 2004;
originally announced January 2004.
-
Optical photometry and X-ray monitoring of the "Cool Algol" BD+05 706: Determination of the physical properties
Authors:
Guillermo Torres,
Jeff A. Mader,
Laurence A. Marschall,
Ralph Neuhaeuser,
Alaine S. Duffy
Abstract:
We present new photometric observations in the BVRI bands of the double-lined eclipsing binary BD+05 706 conducted over three observing seasons, as well as new X-ray observations obtained with the ROSAT satellite covering a full orbital cycle (P = 18.9 days). A detailed light-curve analysis of the optical data shows the system to be semidetached, confirming indications from an earlier analysis b…
▽ More
We present new photometric observations in the BVRI bands of the double-lined eclipsing binary BD+05 706 conducted over three observing seasons, as well as new X-ray observations obtained with the ROSAT satellite covering a full orbital cycle (P = 18.9 days). A detailed light-curve analysis of the optical data shows the system to be semidetached, confirming indications from an earlier analysis by Torres et al. (1998), with the less massive and cooler star filling its Roche lobe. The system is a member of the rare class of cool Algol systems, which are different from the "classical" Algol systems in that the mass-gaining component is also a late-type star rather than a B- or A-type star. By combining the new photometry with a reanalysis of the spectroscopic observations reported by Torres et al. (1998) we derive accurate absolute masses for the components of M1 = 2.633 +/- 0.028 Msun and M2 = 0.5412 +/- 0.0093 Msun, radii of R1 = 7.55 +/- 0.20 Rsun and R2 = 11.02 +/- 0.21 Rsun, as well as effective temperatures of 5000 +/- 100 K and 4640 +/- 150 K for the primary and secondary, respectively. There are obvious signs of activity (spottedness) in the optical light curve of the binary. Our X-ray light curve clearly shows the primary eclipse but not the secondary eclipse, suggesting that the primary star is the dominant source of the activity in the system. The depth and duration of the eclipse allow us to infer some of the properties of the X-ray emitting region around that star.
△ Less
Submitted 6 March, 2003;
originally announced March 2003.
