-
A case study in adaptable and reusable infrastructure at the Keck Observatory Archive: VO interfaces, moving targets, and more
Authors:
G. Bruce Berriman,
Richard W. Cohen,
Andrew Colson,
Christopher R. Gelino,
John C. Good,
Mihseh Kong,
Anastasia C. Laity,
Jeffrey A. Mader,
Melanie A. Swain,
Hien D. Tran,
Shin-Ywan Wang
Abstract:
This paper describes how the Keck Observatory Archive (KOA) is extending open source software components to develop new services. In August 2015, KOA deployed a program interface to discover public data from all instruments equipped with an imaging mode. The interface complies with version 2 of the Simple Imaging Access Protocol (SIAP), under development by the International Virtual Observatory Al…
▽ More
This paper describes how the Keck Observatory Archive (KOA) is extending open source software components to develop new services. In August 2015, KOA deployed a program interface to discover public data from all instruments equipped with an imaging mode. The interface complies with version 2 of the Simple Imaging Access Protocol (SIAP), under development by the International Virtual Observatory Alliance (IVOA), which defines a standard mechanism for discovering images through spatial queries. The heart of the KOA service is an R-tree-based, database-indexing mechanism prototyped by the Virtual Astronomical Observatory (VAO) and further developed by the Montage Image Mosaic project, designed to provide fast access to large imaging data sets as a first step in creating wide-area image mosaics. The KOA service uses the results of the spatial R-tree search to create an SQLite data database for further relational filtering. The service uses a JSON configuration file to describe the association between instrument parameters and the service query parameters, and to make it applicable beyond the Keck instruments.
The R-tree program was itself extended to support temporal (in addition to spatial) indexing, in response to requests from the planetary science community for a search engine to discover observations of Solar System objects. With this 3D-indexing scheme, the service performs very fast time and spatial matches between the target ephemerides, obtained from the JPL SPICE service. Our experiments indicate these matches can be more than 100 times faster than when separating temporal and spatial searches. Images of the tracks of the moving targets, overlaid with the image footprints, are computed with a new command-line visualization tool, mViewer, released with the Montage distribution. The service is currently in test and will be released in Fall 2016.
△ Less
Submitted 8 August, 2016;
originally announced August 2016.
-
Metadata and Data Management for the Keck Observatory Archive
Authors:
H. D. Tran,
J. Holt,
R. W. Goodrich,
J. A. Mader,
M. Swain,
A. C. Laity,
M. Kong,
C. R. Gelino,
G. B. Berriman
Abstract:
A collaboration between the W. M. Keck Observatory (WMKO) in Hawaii and the NASA Exoplanet Science Institute (NExScI) in California, the Keck Observatory Archive (KOA) was commissioned in 2004 to archive observing data from WMKO, which operates two classically scheduled 10 m ground-based telescopes. The observing data from Keck is not suitable for direct ingestion into the archive since the metada…
▽ More
A collaboration between the W. M. Keck Observatory (WMKO) in Hawaii and the NASA Exoplanet Science Institute (NExScI) in California, the Keck Observatory Archive (KOA) was commissioned in 2004 to archive observing data from WMKO, which operates two classically scheduled 10 m ground-based telescopes. The observing data from Keck is not suitable for direct ingestion into the archive since the metadata contained in the original FITS headers lack the information necessary for proper archiving. Coupled with different standards among instrument builders and the heterogeneous nature of the data inherent in classical observing, in which observers have complete control of the instruments and their observations, the data pose a number of technical challenges for KOA. We describe the methodologies and tools that we have developed to successfully address these difficulties, adding content to the FITS headers and "retrofitting" the metadata in order to support archiving Keck data, especially those obtained before the archive was designed. With the expertise gained from having successfully archived observations taken with all eight currently active instruments at WMKO, we have developed lessons learned from handling this complex array of heterogeneous metadata that help ensure a smooth ingestion of data not only for current but also future instruments, as well as a better experience for the archive user.
△ Less
Submitted 21 August, 2014;
originally announced August 2014.
-
The Design and Operation of The Keck Observatory Archive
Authors:
G. Bruce Berriman,
Christopher R. Gelino,
Robert W. Goodrich,
Jennifer Holt,
Mihseh Kong,
Anastasia C. Laity,
Jeffrey A. Mader,
Melanie Swain,
Hien D. Tran
Abstract:
The Infrared Processing and Analysis Center (IPAC) and the W. M. Keck Observatory (WMKO) operate an archive for the Keck Observatory. At the end of 2013, KOA completed the ingestion of data from all eight active observatory instruments. KOA will continue to ingest all newly obtained observations, at an anticipated volume of 4 TB per year. The data are transmitted electronically from WMKO to IPAC f…
▽ More
The Infrared Processing and Analysis Center (IPAC) and the W. M. Keck Observatory (WMKO) operate an archive for the Keck Observatory. At the end of 2013, KOA completed the ingestion of data from all eight active observatory instruments. KOA will continue to ingest all newly obtained observations, at an anticipated volume of 4 TB per year. The data are transmitted electronically from WMKO to IPAC for storage and curation. Access to data is governed by a data use policy, and approximately two-thirds of the data in the archive are public.
△ Less
Submitted 4 August, 2014;
originally announced August 2014.
-
The NASA Exoplanet Archive: Data and Tools for Exoplanet Research
Authors:
R. L. Akeson,
X. Chen,
D. Ciardi,
M. Crane,
J. Good,
M. Harbut,
E. Jackson,
S. R. Kane,
A. C. Laity,
S. Leifer,
M. Lynn,
D. L. McElroy,
M. Papin,
P. Plavchan,
S. V. Ramirez,
R. Rey,
K. von Braun,
M. Wittman,
M. Abajian,
B. Ali,
C. Beichman,
A. Beekley,
G. B. Berriman,
S. Berukoff,
G. Bryden
, et al. (10 additional authors not shown)
Abstract:
We describe the contents and functionality of the NASA Exoplanet Archive, a database and tool set funded by NASA to support astronomers in the exoplanet community. The current content of the database includes interactive tables containing properties of all published exoplanets, Kepler planet candidates, threshold-crossing events, data validation reports and target stellar parameters, light curves…
▽ More
We describe the contents and functionality of the NASA Exoplanet Archive, a database and tool set funded by NASA to support astronomers in the exoplanet community. The current content of the database includes interactive tables containing properties of all published exoplanets, Kepler planet candidates, threshold-crossing events, data validation reports and target stellar parameters, light curves from the Kepler and CoRoT missions and from several ground-based surveys, and spectra and radial velocity measurements from the literature. Tools provided to work with these data include a transit ephemeris predictor, both for single planets and for observing locations, light curve viewing and normalization utilities, and a periodogram and phased light curve service. The archive can be accessed at http://exoplanetarchive.ipac.caltech.edu.
△ Less
Submitted 10 July, 2013;
originally announced July 2013.
-
Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking
Authors:
Joseph C. Jacob,
Daniel S. Katz,
G. Bruce Berriman,
John Good,
Anastasia C. Laity,
Ewa Deelman,
Carl Kesselman,
Gurmeet Singh,
Mei-Hui Su,
Thomas A. Prince,
Roy Williams
Abstract:
Montage is a portable software toolkit for constructing custom, science-grade mosaics by composing multiple astronomical images. The mosaics constructed by Montage preserve the astrometry (position) and photometry (intensity) of the sources in the input images. The mosaic to be constructed is specified by the user in terms of a set of parameters, including dataset and wavelength to be used, locati…
▽ More
Montage is a portable software toolkit for constructing custom, science-grade mosaics by composing multiple astronomical images. The mosaics constructed by Montage preserve the astrometry (position) and photometry (intensity) of the sources in the input images. The mosaic to be constructed is specified by the user in terms of a set of parameters, including dataset and wavelength to be used, location and size on the sky, coordinate system and projection, and spatial sampling rate. Many astronomical datasets are massive, and are stored in distributed archives that are, in most cases, remote with respect to the available computational resources. Montage can be run on both single- and multi-processor computers, including clusters and grids. Standard grid tools are used to run Montage in the case where the data or computers used to construct a mosaic are located remotely on the Internet. This paper describes the architecture, algorithms, and usage of Montage as both a software toolkit and as a grid portal. Timing results are provided to show how Montage performance scales with number of processors on a cluster computer. In addition, we compare the performance of two methods of running Montage in parallel on a grid.
△ Less
Submitted 24 May, 2010;
originally announced May 2010.
-
The LAEX and NASA portals for CoRoT public data
Authors:
E. Solano,
K. von Braun,
A. Velasco,
D. R. Ciardi,
R. Gutierrez,
D. L. McElroy,
M. Lopez,
M. Abajian,
M. Garcia,
B. Ali,
L. M. Sarro,
G. B. Berriman,
G. Bryden,
B. Chan,
J. Good,
S. R. Kane,
A. C. Laity,
C. Lau,
A. N. Payne,
P. Plavchan,
S. Ramirez,
M. Schmitz,
J. R. Stauffer,
P. L. Wyatt,
A. Zhang
Abstract:
* Aims. We describe here the main functionalities of the LAEX (Laboratorio de Astrofisica Estelar y Exoplanetas/Laboratory for Stellar Astrophysics and Exoplanets) and NASA portals for CoRoT Public Data. The CoRoT archive at LAEX was opened to the community in January 2009 and is managed in the framework of the Spanish Virtual Observatory. NStED (NASA Star and Exoplanet Database) serves as the C…
▽ More
* Aims. We describe here the main functionalities of the LAEX (Laboratorio de Astrofisica Estelar y Exoplanetas/Laboratory for Stellar Astrophysics and Exoplanets) and NASA portals for CoRoT Public Data. The CoRoT archive at LAEX was opened to the community in January 2009 and is managed in the framework of the Spanish Virtual Observatory. NStED (NASA Star and Exoplanet Database) serves as the CoRoT portal for the US astronomical community. NStED is a general purpose stellar and exoplanet archive with the aim of providing support for NASA planet finding and characterisation goals, and the planning and support of NASA and other space missions. CoRoT data at LAEX and NStED can be accessed at http://sdc.laeff.inta.es/corotfa/ and http://nsted.ipac.caltech.edu,respectively.
* Methods. Based on considerable experience with astronomical archives, the aforementioned archives are designed with the aim of delivering science-quality data in a simple and efficient way.
* Results. LAEX and NStED not only provide access to CoRoT Public Data but furthermore serve a variety of observed and calculated astrophysical data. In particular, NStED provides scientifically validated information on stellar and planetary data related to the search for and characterization of extrasolar planets, and LAEX makes any information from Virtual Observatory services available to the astronomical community.
△ Less
Submitted 20 July, 2009;
originally announced July 2009.
-
The NASA/IPAC/NExScI Star and Exoplanet Database
Authors:
G. B. Berriman,
B. Ali,
R. Baker,
K. von Braun,
N-M. Chiu,
D. R. Ciardi,
J. Good,
S. R. Kane,
M. Kong,
A. C. Laity,
D. L. McElroy,
S. Monkewitz,
A. N. Payne,
S. Ramirez,
M. Schmitz,
J. S. Stauffer,
P. L. Wyatt
Abstract:
The NASA/IPAC/NExScI Star and Exoplanet Database (NStED) is a general purpose stellar archive which supports NASA planet-finding and planet-characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high precision photometr…
▽ More
The NASA/IPAC/NExScI Star and Exoplanet Database (NStED) is a general purpose stellar archive which supports NASA planet-finding and planet-characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high precision photometric surveys for transiting exoplanets (NStED-ETSS). We present summaries of these components. The NStED stellar database currently serves published parameters for 140,000 stars. These parameters include coordinates, multiplicity, proper motion, parallax, spectral type, multiband photometry, radial velocity, metallicity, chromospheric and coronal activity index, rotation velocity/period, infrared excess. NStED-ETSS currently serves data from the TrES survey of the Kepler field as well as dedicated photometric surveys of four stellar clusters. NStED-ETSS aims to serve both the surveys and the broader astronomical community by archiving these data and making them available in a homogeneous format.
△ Less
Submitted 13 March, 2009;
originally announced March 2009.
-
The NStED Stellar and Exoplanet Hosting Star Service
Authors:
S. Ramirez,
B. Ali,
R. Baker,
G. B. Berriman,
K. von Braun,
N-M. Chiu,
D. R. Ciardi,
J. Good,
S. R. Kane,
A. C. Laity,
D. L. McElroy,
S. Monkewitz,
A. N. Payne,
M. Schmitz,
J. R. Stauffer,
P. L. Wyatt,
A. Zhang
Abstract:
The NASA Star and Exoplanet Database (NStED) is a general purpose stellar archive with the aim of providing support for NASA's planet finding and characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of (currently) 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high p…
▽ More
The NASA Star and Exoplanet Database (NStED) is a general purpose stellar archive with the aim of providing support for NASA's planet finding and characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of (currently) 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high precision photometric surveys for transiting exoplanets. We present a summary of the NStED stellar database, functionality, tools, and user interface. NStED currently serves the following kinds of data for 140,000 stars (where available): coordinates, multiplicity, proper motion, parallax, spectral type, multiband photometry, radial velocity, metallicity, chromospheric and coronal activity index, and rotation velocity/period. Furthermore, the following derived quantities are given wherever possible: distance, effective temperature, mass, radius, luminosity, space motions, and physical/angular dimensions of habitable zone. Queries to NStED can be made using constraints on any combination of the above parameters. In addition, NStED provides tools to derive specific inferred quantities for the stars in the database, cross-referenced with available extra-solar planetary data for those host stars. NStED can be accessed at http://nsted.ipac.caltech.edu
△ Less
Submitted 27 June, 2008;
originally announced June 2008.
-
The NStED Exoplanet Transit Survey Service
Authors:
K. von Braun,
M. Abajian,
B. Ali,
R. Baker,
G. B. Berriman,
N-M. Chiu,
D. R. Ciardi,
J. Good,
S. R. Kane,
A. C. Laity,
D. L. McElroy,
S. Monkewitz,
A. N. Payne,
S. Ramirez,
M. Schmitz,
J. R. Stauffer,
P. L. Wyatt,
A. Zhang
Abstract:
The NASA Star and Exoplanet Database (NStED) is a general purpose stellar archive with the aim of providing support for NASA's planet finding and characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of (currently) 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high-p…
▽ More
The NASA Star and Exoplanet Database (NStED) is a general purpose stellar archive with the aim of providing support for NASA's planet finding and characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of (currently) 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high-precision photometric surveys for transiting exoplanets. We present a summary of the latter component: the NStED Exoplanet Transit Survey Service (NStED-ETSS), along with its content, functionality, tools, and user interface. NStED-ETSS currently serves data from the TrES Survey of the Kepler Field as well as dedicated photometric surveys of four stellar clusters. <CA>NStED-ETSS aims to serve both the surveys and the broader astronomical community by archiving these data and making them available in a homogeneous format. Examples of usability of ETSS include investigation of any time-variable phenomena in data sets not studied by the original survey team, application of different techniques or algorithms for planet transit detections, combination of data from different surveys for given objects, statistical studies, etc. NStED-ETSS can be accessed at \tt{http://nsted.ipac.caltech.edu}
△ Less
Submitted 24 June, 2008;
originally announced June 2008.
-
The Automated Palomar 60-Inch Telescope
Authors:
S. Bradley Cenko,
Derek B. Fox,
Dae-Sik Moon,
Fiona A. Harrison,
S. R. Kulkarni,
John R. Henning,
C. Dani Guzman,
Marco Bonati,
Roger M. Smith,
Robert P. Thicksten,
Michael W. Doyle,
Hal L. Petrie,
Avishay Gal-Yam,
Alicia M. Soderberg,
Nathaniel L. Anagnostou,
Anastasia C. Laity
Abstract:
We have converted the Palomar 60-inch telescope (P60) from a classical night assistant-operated telescope to a fully robotic facility. The automated system, which has been operational since September 2004, is designed for moderately fast (t <~ 3 minutes) and sustained (R <~ 23 mag) observations of gamma-ray burst afterglows and other transient events. Routine queue-scheduled observations can be…
▽ More
We have converted the Palomar 60-inch telescope (P60) from a classical night assistant-operated telescope to a fully robotic facility. The automated system, which has been operational since September 2004, is designed for moderately fast (t <~ 3 minutes) and sustained (R <~ 23 mag) observations of gamma-ray burst afterglows and other transient events. Routine queue-scheduled observations can be interrupted in response to electronic notification of transient events. An automated pipeline reduces data in real-time, which is then stored on a searchable web-based archive for ease of distribution. We describe here the design requirements, hardware and software upgrades, and lessons learned from roboticization. We present an overview of the current system performance as well as plans for future upgrades.
△ Less
Submitted 15 August, 2006;
originally announced August 2006.
