-
Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time
Authors:
Fabio Hernandez,
George Beckett,
Peter Clark,
Matt Doidge,
Tim Jenness,
Edward Karavakis,
Quentin Le Boulc'h,
Peter Love,
Gabriele Mainetti,
Timothy Noble,
Brandon White,
Wei Yang
Abstract:
The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory's ten-year science mission scheduled to begin in 2025. Rubin's 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in th…
▽ More
The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory's ten-year science mission scheduled to begin in 2025. Rubin's 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in the wavelength range 320-1050 nm covering the entire observable sky every 4 nights using a 3.2 gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties.
In this article we present an overview of the system currently being constructed to perform data distribution as well as the annual campaigns which reprocess the entire image dataset collected since the beginning of the survey. These processing campaigns will utilize computing and storage resources provided by three Rubin data facilities (one in the US and two in Europe). Each year a Data Release will be produced and disseminated to science collaborations for use in studies comprising four main science pillars: probing dark matter and dark energy, taking inventory of solar system objects, exploring the transient optical sky and mapping the Milky Way.
Also presented is the method by which we leverage some of the common tools and best practices used for management of large-scale distributed data processing projects in the high energy physics and astronomy communities. We also demonstrate how these tools and practices are utilized within the Rubin project in order to overcome the specific challenges faced by the Observatory.
△ Less
Submitted 23 November, 2023;
originally announced November 2023.
-
Effects of Fe deficiency and Co substitution in polycrystalline and single crystals of Fe$_{3}$GeTe$_{2}$
Authors:
D. A. Mayoh,
G. D. A. Wood,
S. J. R. Holt,
G. Beckett,
E. J. L. Dekker,
M. R. Lees,
G. Balakrishnan
Abstract:
Fe$_{3}$GeTe$_{2}$ is a two-dimensional van der Waals material with a ferromagnetic ground state and a maximum transition temperature $T_{\mathrm{c}}\sim225$ K. However, when Fe$_{3}$GeTe$_{2}$ is synthesized lower values of $T_{\mathrm{c}}$ are often reported. This is attributed to a deficiency in the Fe at the 2c site in the crystal structure. Here we investigate the effect of Fe deficiency and…
▽ More
Fe$_{3}$GeTe$_{2}$ is a two-dimensional van der Waals material with a ferromagnetic ground state and a maximum transition temperature $T_{\mathrm{c}}\sim225$ K. However, when Fe$_{3}$GeTe$_{2}$ is synthesized lower values of $T_{\mathrm{c}}$ are often reported. This is attributed to a deficiency in the Fe at the 2c site in the crystal structure. Here we investigate the effect of Fe deficiency and the substitution of Co for Fe on the magnetic properties of this system. We have synthesized both polycrystalline material and single crystals by chemical vapor transport and the flux method, with the largest crystals obtained using the flux method. Cobalt substitution at the Fe site is found to significantly reduce the magnetic transition temperature. Crystals of Fe$_{3}$GeTe$_{2}$ grown by chemical vapor transport with $\sim 8\%$ excess Fe in the starting materials display an optimum Fe content and magnetic transition temperature.
△ Less
Submitted 7 February, 2022; v1 submitted 17 November, 2021;
originally announced November 2021.
-
DESC DC2 Data Release Note
Authors:
LSST Dark Energy Science Collaboration,
Bela Abolfathi,
Robert Armstrong,
Humna Awan,
Yadu N. Babuji,
Franz Erik Bauer,
George Beckett,
Rahul Biswas,
Joanne R. Bogart,
Dominique Boutigny,
Kyle Chard,
James Chiang,
Johann Cohen-Tanugi,
Andrew J. Connolly,
Scott F. Daniel,
Seth W. Digel,
Alex Drlica-Wagner,
Richard Dubois,
Eric Gawiser,
Thomas Glanzman,
Salman Habib,
Andrew P. Hearin,
Katrin Heitmann,
Fabio Hernandez,
Renée Hložek
, et al. (32 additional authors not shown)
Abstract:
In preparation for cosmological analyses of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the LSST Dark Energy Science Collaboration (LSST DESC) has created a 300 deg$^2$ simulated survey as part of an effort called Data Challenge 2 (DC2). The DC2 simulated sky survey, in six optical bands with observations following a reference LSST observing cadence, was processed with th…
▽ More
In preparation for cosmological analyses of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the LSST Dark Energy Science Collaboration (LSST DESC) has created a 300 deg$^2$ simulated survey as part of an effort called Data Challenge 2 (DC2). The DC2 simulated sky survey, in six optical bands with observations following a reference LSST observing cadence, was processed with the LSST Science Pipelines (19.0.0). In this Note, we describe the public data release of the resulting object catalogs for the coadded images of five years of simulated observations along with associated truth catalogs. We include a brief description of the major features of the available data sets. To enable convenient access to the data products, we have developed a web portal connected to Globus data services. We describe how to access the data and provide example Jupyter Notebooks in Python to aid first interactions with the data. We welcome feedback and questions about the data release via a GitHub repository.
△ Less
Submitted 13 June, 2022; v1 submitted 12 January, 2021;
originally announced January 2021.
-
The LSST DESC DC2 Simulated Sky Survey
Authors:
LSST Dark Energy Science Collaboration,
Bela Abolfathi,
David Alonso,
Robert Armstrong,
Éric Aubourg,
Humna Awan,
Yadu N. Babuji,
Franz Erik Bauer,
Rachel Bean,
George Beckett,
Rahul Biswas,
Joanne R. Bogart,
Dominique Boutigny,
Kyle Chard,
James Chiang,
Chuck F. Claver,
Johann Cohen-Tanugi,
Céline Combet,
Andrew J. Connolly,
Scott F. Daniel,
Seth W. Digel,
Alex Drlica-Wagner,
Richard Dubois,
Emmanuel Gangler,
Eric Gawiser
, et al. (55 additional authors not shown)
Abstract:
We describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses…
▽ More
We describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses this interconnectivity in a way that has not been attempted before. This effort encompasses a full end-to-end approach: starting from a large N-body simulation, through setting up LSST-like observations including realistic cadences, through image simulations, and finally processing with Rubin's LSST Science Pipelines. This last step ensures that we generate data products resembling those to be delivered by the Rubin Observatory as closely as is currently possible. The simulated DC2 sky survey covers six optical bands in a wide-fast-deep (WFD) area of approximately 300 deg^2 as well as a deep drilling field (DDF) of approximately 1 deg^2. We simulate 5 years of the planned 10-year survey. The DC2 sky survey has multiple purposes. First, the LSST DESC working groups can use the dataset to develop a range of DESC analysis pipelines to prepare for the advent of actual data. Second, it serves as a realistic testbed for the image processing software under development for LSST by the Rubin Observatory. In particular, simulated data provide a controlled way to investigate certain image-level systematic effects. Finally, the DC2 sky survey enables the exploration of new scientific ideas in both static and time-domain cosmology.
△ Less
Submitted 26 January, 2021; v1 submitted 12 October, 2020;
originally announced October 2020.
-
Building the International Lattice Data Grid
Authors:
G. Beckett,
B. Joo,
C. M. Maynard,
D. Pleiter,
O. Tatebe,
T. Yoshie
Abstract:
We present the International Lattice Data Grid (ILDG), a loosely federated grid of grids for sharing data from Lattice Quantum Chromodynamics (LQCD) simulations. The ILDG comprises of metadata, file format and web-service standards, which can be used to wrap regional data-grid interfaces, allowing seamless access to catalogues and data in a diverse set of collaborating regional grids. We discuss…
▽ More
We present the International Lattice Data Grid (ILDG), a loosely federated grid of grids for sharing data from Lattice Quantum Chromodynamics (LQCD) simulations. The ILDG comprises of metadata, file format and web-service standards, which can be used to wrap regional data-grid interfaces, allowing seamless access to catalogues and data in a diverse set of collaborating regional grids. We discuss the technological underpinnings of the ILDG, primarily the metadata and the middleware, and offer a critique of its various aspects with the hindsight of the design work and the first full year of production.
△ Less
Submitted 9 October, 2009;
originally announced October 2009.
-
Towards an interoperable International Lattice Datagrid
Authors:
G. Beckett,
P. Coddington,
N. Ishii,
B. Joo,
D. Melkumyan,
R. Ostrowski,
D. Pleiter,
M. Sato,
J. Simone,
C. Watson,
S. Zhang
Abstract:
The International Lattice Datagrid (ILDG) is a federation of several regional grids. Since most of these grids have reached production level, an increasing number of lattice scientists start to benefit from this new research infrastructure. The ILDG Middleware Working Group has the task of specifying the ILDG middleware such that interoperability among the different grids is achieved. In this pa…
▽ More
The International Lattice Datagrid (ILDG) is a federation of several regional grids. Since most of these grids have reached production level, an increasing number of lattice scientists start to benefit from this new research infrastructure. The ILDG Middleware Working Group has the task of specifying the ILDG middleware such that interoperability among the different grids is achieved. In this paper we will present the architecture of the ILDG middleware and describe what has actually been achieved in recent years. Particular focus is given to interoperability and security issues. We will conclude with a short overview on issues which we plan to address in the near future.
△ Less
Submitted 29 November, 2007;
originally announced November 2007.
-
Optical and Near-Infrared Observations of the Peculiar Type Ia Supernova 1999ac
Authors:
Mark M. Phillips,
Kevin Krisciunas,
Nicholas B. Suntzeff,
R. G. Abraham,
M. G. Beckett,
M. Bonati,
P. Candia,
T. M. Corwin,
D. L. Depoy,
J. Espinoza,
A. E. Firth,
W. L. Freedman,
G. Galaz,
L. Germany,
D. Gonzalez,
M. Hamuy,
N. C. Hastings,
A. L. Hungerford,
V. D. Ivanov,
E. Labbe,
R. O. Marzke,
P. J. McCarthy,
R. G. McMahon,
R. McMillan,
C. Muena
, et al. (7 additional authors not shown)
Abstract:
We present 39 nights of optical photometry, 34 nights of infrared photometry, and 4 nights of optical spectroscopy of the Type Ia SN 1999ac. This supernova was discovered two weeks before maximum light, and observations were begun shortly thereafter. At early times its spectra resembled the unusual SN 1999aa and were characterized by very high velocities in the Ca II H and K lines, but very low…
▽ More
We present 39 nights of optical photometry, 34 nights of infrared photometry, and 4 nights of optical spectroscopy of the Type Ia SN 1999ac. This supernova was discovered two weeks before maximum light, and observations were begun shortly thereafter. At early times its spectra resembled the unusual SN 1999aa and were characterized by very high velocities in the Ca II H and K lines, but very low velocities in the Si II 6355 A line. The optical photometry showed a slow rise to peak brightness but, quite peculiarly, was followed by a more rapid decline from maximum. Thus, the B- and V-band light curves cannot be characterized by a single stretch factor. We argue that the best measure of the nature of this object is not the decline rate parameter Delta m_15 (B). The B-V colors were unusual from 30 to 90 days after maximum light in that they evolved to bluer values at a much slower rate than normal Type Ia supernovae. The spectra and bolometric light curve indicate that this event was similar to the spectroscopically peculiar slow decliner SN 1999aa.
△ Less
Submitted 30 January, 2006;
originally announced January 2006.
-
The Las Campanas IR Survey. II. Photometric redshifts, comparison with models and clustering evolution
Authors:
A. E. Firth,
R. S. Somerville,
R. G. McMahon,
O. Lahav,
R. S. Ellis,
C. N. Sabbey,
P. J. McCarthy,
H. -W. Chen,
R. O. Marzke,
J. Wilson,
R. G. Abraham,
M. G. Beckett,
R. G. Carlberg,
J. R. Lewis,
C. D. Mackay,
D. C. Murphy,
A. E. Oemler,
S. E. Persson
Abstract:
The LCIR Survey, using the Cambridge IR Survey Instrument (CIRSI), reaches H \~ 20-21 over ~1 deg^2. We present results for 744 arcmin^2 in which public UBVRI data exist. We compare optical-IR colours with predictions of a semi-analytic hierarchical model (SAM) and find reasonable agreement. We also determine photometric redshifts, finding a median z of z_m ~ 0.55. We compare N(z) of different s…
▽ More
The LCIR Survey, using the Cambridge IR Survey Instrument (CIRSI), reaches H \~ 20-21 over ~1 deg^2. We present results for 744 arcmin^2 in which public UBVRI data exist. We compare optical-IR colours with predictions of a semi-analytic hierarchical model (SAM) and find reasonable agreement. We also determine photometric redshifts, finding a median z of z_m ~ 0.55. We compare N(z) of different spectral types with models, showing that the observations are inconsistent with simple PLE models while the SAM provides a reasonable fit to the total N(z) but underestimates the number of z ~ 1 red spectral types. We also present N(z) for samples of red objects (EROs). We find that EROs with R - H > 4 and H < 20.5 have z_m ~ 1; redder EROs have higher z_m. For 19 < H < 20, EROs with R - H > 4 comprise ~18% of the observed galaxy population while in the SAM they contribute only ~4%. We also determine the angular correlation function w(theta) for magnitude, colour, spectral type and photo-z selected samples and use the estimated N(z) to derive the spatial clustering xi(r). Parametrizing xi(r) by xi(r_c,z)=(r_c/r_*(z))^(-1.8) (r_c comoving), we find that r_*(z) increases by ~1.5-2 times from z = 0 to z ~ 1.2. We interpret this as a selection effect - the galaxies selected at z ~ 1.2 are intrinsically very luminous. When galaxies are selected by absolute magnitude we find no evidence for evolution in r_* over this z range. Extrapolated to z = 0, we find r_*(0) ~ 6.5 h^-1Mpc for red galaxies and r_*(0) ~ 2-4 h^-1Mpc for blue galaxies. We also find that while the angular clustering amplitude of EROs with R - H > 4 or I - H > 3 is up to four times that of the whole galaxy population, the spatial clustering length r_*(z=1) is ~7.5-10.5 h^-1Mpc which is only a factor of ~1.7 times r_* for non-EROs lying in a similar z and luminosity range.
△ Less
Submitted 28 March, 2002; v1 submitted 10 August, 2001;
originally announced August 2001.
-
The Las Campanas Infrared Survey. III. The H-band Imaging Survey and the Near-Infrared and Optical Photometric Catalogs
Authors:
Hsiao-Wen Chen,
P. J. McCarthy,
R. O. Marzke,
J. Wilson,
R. G. Carlberg,
A. E. Firth,
S. E. Persson,
C. N. Sabbey,
J. R. Lewis,
R. G. McMahon,
O. Lahav,
R. S. Ellis,
P. Martini,
R. G. Abraham,
A. Oemler,
D. C. Murphy,
R. S. Somerville,
M. G. Beckett,
C. D. Mackay
Abstract:
(Abridged) The Las Campanas Infrared Survey, based on broad-band optical and near-infrared photometry, is designed to robustly identify a statistically significant and representative sample of evolved galaxies at redshifts z>1. We have completed an H-band imaging survey over 1.1 square degrees of sky in six separate fields. The average 5 sigma detection limit in a four arcsecond diameter apertur…
▽ More
(Abridged) The Las Campanas Infrared Survey, based on broad-band optical and near-infrared photometry, is designed to robustly identify a statistically significant and representative sample of evolved galaxies at redshifts z>1. We have completed an H-band imaging survey over 1.1 square degrees of sky in six separate fields. The average 5 sigma detection limit in a four arcsecond diameter aperture is H ~ 20. Here we describe the design of the survey, the observation strategies, data reduction techniques, and object identification procedures. We present sample near-infrared and optical photometric catalogs for objects identified in two survey fields. We perform object detection in all bandpasses and identify ~ 54,000 galaxies over 1,408 square arcminutes of sky in the two fields. Of these galaxies, ~ 14,000 are detected in the H-band and ~ 2,000 have the colors of evolved galaxies, I - H >3, at z > 1. We find that (1) the differential number counts N(m) for the H-band detected objects has a slope of 0.44 at H < 19 and 0.27 for H > 19. In addition, we find that (2) the differential number counts for the H detected red objects has a slope of 0.85 at H < 20 and 0.32 at H > 20, with a mean surface density ~ 3,000 degree^{-2} mag^{-1} at H=20. Finally, we find that (3) galaxies with red optical to near-IR colors (I-H > 3) constitute ~ 20% of the H detected galaxies at H ~ 21, but only 2% at H = 19. We show that red galaxies are strongly clustered, which results in a strong field to field variation in their surface density. Comparisons of observations and predictions based on various formation scenarios indicate that these red galaxies are consistent with mildly evolving early-type galaxies at z ~ 1, although with a significant amount of on-going star formation as indicated by the large scatter in their V-I colors.
△ Less
Submitted 8 December, 2001; v1 submitted 10 August, 2001;
originally announced August 2001.
-
The Las Campanas IR Survey: Early Type Galaxy Progenitors Beyond Redshift One
Authors:
P. J. McCarthy,
R. G. Carlberg,
H. -W. Chen,
R. O. Marzke,
A. E. Firth,
R. S. Ellis,
S. E. Persson,
R. G. McMahon,
O. Lahav,
J. Wilson,
P. Martini,
R. G. Abraham,
C. N. Sabbey,
A. Oemler,
D. C. Murphy,
R. S. Somerville,
M. G. Beckett,
J. R. Lewis,
C. D. MacKay
Abstract:
(Abridged) We have identified a population of faint red galaxies from a 0.62 square degree region of the Las Campanas Infrared Survey whose properties are consistent with their being the progenitors of early-type galaxies. The optical and IR colors, number-magnitude relation and angular clustering together indicate modest evolution and increased star formation rates among the early-type field po…
▽ More
(Abridged) We have identified a population of faint red galaxies from a 0.62 square degree region of the Las Campanas Infrared Survey whose properties are consistent with their being the progenitors of early-type galaxies. The optical and IR colors, number-magnitude relation and angular clustering together indicate modest evolution and increased star formation rates among the early-type field population at redshifts between one and two. The counts of red galaxies with $H$ magnitudes between 17 and 20 rise with a slope that is much steeper than that of the total H sample. The surface density of red galaxies drops from roughly 3000 per square degree at H = 20.5, I-H > 3 to ~ 20 per square degree at H = 20, I-H > 5. The V-I colors are approximately 1.5 magnitudes bluer on average than a pure old population and span a range of more than three magnitudes. The colors, and photometric redshifts derived from them, indicate that the red galaxies have redshift distributions adequately described by Gaussians with sigma_z ~ 0.2$ centered near redshift one, with the exception that galaxies having $V-I<1.6$ and $I-H>3$ are primarily in the 1.5 < z < 2 range. We find co-moving correlation lengths of 9-10 Mpc at z ~ 1, comparable to, or larger than, those found for early-type galaxies at lower redshifts. A simple photometric evolution model reproduces the counts of the red galaxies, with only a ~ 30% decline in the underlying space density of early-type galaxies at z ~ 1.2. We suggest on the basis of the colors, counts, and clustering that these red galaxies are the bulk of the progenitors of present day early-type galaxies.
△ Less
Submitted 9 August, 2001;
originally announced August 2001.
-
Infrared observations of gravitational lensing in Abell 2219 with CIRSI
Authors:
Meghan E. Gray,
Richard S. Ellis,
Alexandre Refregier,
Jocelyn Bezecourt,
Richard G. McMahon,
Martin G. Beckett,
Craig D. Mackay,
Michael D. Hoenig
Abstract:
We present the first detection of a gravitational depletion signal at near-infrared wavelengths, based on deep panoramic images of the cluster Abell 2219 (z=0.22) taken with the Cambridge Infrared Survey Instrument (CIRSI) at the prime focus of the 4.2m William Herschel Telescope. Infrared studies of gravitational depletion offer a number of advantages over similar techniques applied at optical…
▽ More
We present the first detection of a gravitational depletion signal at near-infrared wavelengths, based on deep panoramic images of the cluster Abell 2219 (z=0.22) taken with the Cambridge Infrared Survey Instrument (CIRSI) at the prime focus of the 4.2m William Herschel Telescope. Infrared studies of gravitational depletion offer a number of advantages over similar techniques applied at optical wavelengths, and can provide reliable total masses for intermediate redshift clusters. Using the maximum likelihood technique developed by Schneider, King & Erben (1999), we detect the gravitational depletion at the 3 sigma confidence level. By modeling the mass distribution as a singular isothermal sphere and ignoring uncertainty in the unlensed number counts, we find an Einstein radius of 13.7 +3.9/-4.2 arcsec (66% confidence limit). This corresponds to a projected velocity dispersion of approximately 800 km/s, in agreement with constraints from strongly-lensed features. For a Navarro, Frenk and White mass model, the radial dependence observed indicates a best-fitting halo scale length of 125/h kpc}. We investigate the uncertainties arising from the observed fluctuations in the unlensed number counts, and show that clustering is the dominant source of error. We extend the maximum likelihood method to include the effect of incompleteness, and discuss the prospects of further systematic studies of lensing in the near-infrared band.
△ Less
Submitted 21 June, 2000; v1 submitted 12 April, 2000;
originally announced April 2000.
