-
ATAT: Astronomical Transformer for time series And Tabular data
Authors:
G. Cabrera-Vives,
D. Moreno-Cartagena,
N. Astorga,
I. Reyes-Jainaga,
F. Förster,
P. Huijse,
J. Arredondo,
A. M. Muñoz Arancibia,
A. Bayo,
M. Catelan,
P. A. Estévez,
P. Sánchez-Sáez,
A. Álvarez,
P. Castellanos,
P. Gallardo,
A. Moya,
D. Rodriguez-Mancini
Abstract:
The advent of next-generation survey instruments, such as the Vera C. Rubin Observatory and its Legacy Survey of Space and Time (LSST), is opening a window for new research in time-domain astronomy. The Extended LSST Astronomical Time-Series Classification Challenge (ELAsTiCC) was created to test the capacity of brokers to deal with a simulated LSST stream. We describe ATAT, the Astronomical Trans…
▽ More
The advent of next-generation survey instruments, such as the Vera C. Rubin Observatory and its Legacy Survey of Space and Time (LSST), is opening a window for new research in time-domain astronomy. The Extended LSST Astronomical Time-Series Classification Challenge (ELAsTiCC) was created to test the capacity of brokers to deal with a simulated LSST stream. We describe ATAT, the Astronomical Transformer for time series And Tabular data, a classification model conceived by the ALeRCE alert broker to classify light-curves from next-generation alert streams. ATAT was tested in production during the first round of the ELAsTiCC campaigns. ATAT consists of two Transformer models that encode light curves and features using novel time modulation and quantile feature tokenizer mechanisms, respectively. ATAT was trained on different combinations of light curves, metadata, and features calculated over the light curves. We compare ATAT against the current ALeRCE classifier, a Balanced Hierarchical Random Forest (BHRF) trained on human-engineered features derived from light curves and metadata. When trained on light curves and metadata, ATAT achieves a macro F1-score of 82.9 +- 0.4 in 20 classes, outperforming the BHRF model trained on 429 features, which achieves a macro F1-score of 79.4 +- 0.1. The use of Transformer multimodal architectures, combining light curves and tabular data, opens new possibilities for classifying alerts from a new generation of large etendue telescopes, such as the Vera C. Rubin Observatory, in real-world brokering scenarios.
△ Less
Submitted 16 May, 2024; v1 submitted 5 May, 2024;
originally announced May 2024.
-
Persistent and occasional: searching for the variable population of the ZTF/4MOST sky using ZTF data release 11
Authors:
P. Sánchez-Sáez,
J. Arredondo,
A. Bayo,
P. Arévalo,
F. E. Bauer,
G. Cabrera-Vives,
M. Catelan,
P. Coppi,
P. A. Estévez,
F. Förster,
L. Hernández-García,
P. Huijse,
R. Kurtev,
P. Lira,
A. M. Muñoz Arancibia,
G. Pignata
Abstract:
We present a variability, color and morphology based classifier, designed to identify transients, persistently variable, and non-variable sources, from the Zwicky Transient Facility (ZTF) Data Release 11 (DR11) light curves of extended and point sources. The main motivation to develop this model was to identify active galactic nuclei (AGN) at different redshift ranges to be observed by the 4MOST C…
▽ More
We present a variability, color and morphology based classifier, designed to identify transients, persistently variable, and non-variable sources, from the Zwicky Transient Facility (ZTF) Data Release 11 (DR11) light curves of extended and point sources. The main motivation to develop this model was to identify active galactic nuclei (AGN) at different redshift ranges to be observed by the 4MOST ChANGES project. Still, it serves as a more general time-domain astronomy study. The model uses nine colors computed from CatWISE and PS1, a morphology score from PS1, and 61 single-band variability features computed from the ZTF DR11 g and r light curves. We trained two versions of the model, one for each ZTF band. We used a hierarchical local classifier per parent node approach, where each node was composed of a balanced random forest model. We adopted a 17-class taxonomy, including non-variable stars and galaxies, three transient classes, five classes of stochastic variables, and seven classes of periodic variables. The macro averaged precision, recall and F1-score are 0.61, 0.75, and 0.62 for the g-band model, and 0.60, 0.74, and 0.61, for the r-band model. When grouping the four AGN classes into one single class, its precision, recall, and F1-score are 1.00, 0.95, and 0.97, respectively, for both the g and r bands. We applied the model to all the sources in the ZTF/4MOST overlapping sky, avoiding ZTF fields covering the Galactic bulge, including 86,576,577 light curves in the g-band and 140,409,824 in the r-band. Only 0.73\% of the g-band light curves and 2.62\% of the r-band light curves were classified as stochastic, periodic, or transient with high probability ($P_{init}\geq0.9$). We found that, in general, more reliable results are obtained when using the g-band model. Using the latter, we identified 384,242 AGN candidates, 287,156 of which have $P_{init}\geq0.9$.
△ Less
Submitted 17 April, 2023;
originally announced April 2023.
-
Informative regularization for a multi-layer perceptron RR Lyrae classifier under data shift
Authors:
Francisco Pérez-Galarce,
Karim Pichara,
Pablo Huijse,
Márcio Catelan,
Domingo Mery
Abstract:
In recent decades, machine learning has provided valuable models and algorithms for processing and extracting knowledge from time-series surveys. Different classifiers have been proposed and performed to an excellent standard. Nevertheless, few papers have tackled the data shift problem in labeled training sets, which occurs when there is a mismatch between the data distribution in the training se…
▽ More
In recent decades, machine learning has provided valuable models and algorithms for processing and extracting knowledge from time-series surveys. Different classifiers have been proposed and performed to an excellent standard. Nevertheless, few papers have tackled the data shift problem in labeled training sets, which occurs when there is a mismatch between the data distribution in the training set and the testing set. This drawback can damage the prediction performance in unseen data. Consequently, we propose a scalable and easily adaptable approach based on an informative regularization and an ad-hoc training procedure to mitigate the shift problem during the training of a multi-layer perceptron for RR Lyrae classification. We collect ranges for characteristic features to construct a symbolic representation of prior knowledge, which was used to model the informative regularizer component. Simultaneously, we design a two-step back-propagation algorithm to integrate this knowledge into the neural network, whereby one step is applied in each epoch to minimize classification error, while another is applied to ensure regularization. Our algorithm defines a subset of parameters (a mask) for each loss function. This approach handles the forgetting effect, which stems from a trade-off between these loss functions (learning from data versus learning expert knowledge) during training. Experiments were conducted using recently proposed shifted benchmark sets for RR Lyrae stars, outperforming baseline models by up to 3\% through a more reliable classifier. Our method provides a new path to incorporate knowledge from characteristic features into artificial neural networks to manage the underlying data shift problem.
△ Less
Submitted 11 March, 2023;
originally announced March 2023.
-
DELIGHT: Deep Learning Identification of Galaxy Hosts of Transients using Multi-resolution Images
Authors:
Francisco Förster,
Alejandra M. Muñoz Arancibia,
Ignacio Reyes,
Alexander Gagliano,
Dylan Britt,
Sara Cuellar-Carrillo,
Felipe Figueroa-Tapia,
Ava Polzin,
Yara Yousef,
Javier Arredondo,
Diego Rodríguez-Mancini,
Javier Correa-Orellana,
Amelia Bayo,
Franz E. Bauer,
Márcio Catelan,
Guillermo Cabrera-Vives,
Raya Dastidar,
Pablo A. Estévez,
Giuliano Pignata,
Lorena Hernandez-Garcia,
Pablo Huijse,
Esteban Reyes,
Paula Sánchez-Sáez,
Mauricio Ramirez,
Daniela Grandón
, et al. (3 additional authors not shown)
Abstract:
We present DELIGHT, or Deep Learning Identification of Galaxy Hosts of Transients, a new algorithm designed to automatically and in real-time identify the host galaxies of extragalactic transients. The proposed algorithm receives as input compact, multi-resolution images centered at the position of a transient candidate and outputs two-dimensional offset vectors that connect the transient with the…
▽ More
We present DELIGHT, or Deep Learning Identification of Galaxy Hosts of Transients, a new algorithm designed to automatically and in real-time identify the host galaxies of extragalactic transients. The proposed algorithm receives as input compact, multi-resolution images centered at the position of a transient candidate and outputs two-dimensional offset vectors that connect the transient with the center of its predicted host. The multi-resolution input consists of a set of images with the same number of pixels, but with progressively larger pixel sizes and fields of view. A sample of \nSample galaxies visually identified by the ALeRCE broker team was used to train a convolutional neural network regression model. We show that this method is able to correctly identify both relatively large ($10\arcsec < r < 60\arcsec$) and small ($r \le 10\arcsec$) apparent size host galaxies using much less information (32 kB) than with a large, single-resolution image (920 kB). The proposed method has fewer catastrophic errors in recovering the position and is more complete and has less contamination ($< 0.86\%$) recovering the cross-matched redshift than other state-of-the-art methods. The more efficient representation provided by multi-resolution input images could allow for the identification of transient host galaxies in real-time, if adopted in alert streams from new generation of large etendue telescopes such as the Vera C. Rubin Observatory.
△ Less
Submitted 8 August, 2022;
originally announced August 2022.
-
Informative Bayesian model selection for RR Lyrae star classifiers
Authors:
F. Pérez-Galarce,
K. Pichara,
P. Huijse,
M. Catelan,
D. Mery
Abstract:
Machine learning has achieved an important role in the automatic classification of variable stars, and several classifiers have been proposed over the last decade. These classifiers have achieved impressive performance in several astronomical catalogues. However, some scientific articles have also shown that the training data therein contain multiple sources of bias. Hence, the performance of thos…
▽ More
Machine learning has achieved an important role in the automatic classification of variable stars, and several classifiers have been proposed over the last decade. These classifiers have achieved impressive performance in several astronomical catalogues. However, some scientific articles have also shown that the training data therein contain multiple sources of bias. Hence, the performance of those classifiers on objects not belonging to the training data is uncertain, potentially resulting in the selection of incorrect models. Besides, it gives rise to the deployment of misleading classifiers. An example of the latter is the creation of open-source labelled catalogues with biased predictions. In this paper, we develop a method based on an informative marginal likelihood to evaluate variable star classifiers. We collect deterministic rules that are based on physical descriptors of RR Lyrae stars, and then, to mitigate the biases, we introduce those rules into the marginal likelihood estimation. We perform experiments with a set of Bayesian Logistic Regressions, which are trained to classify RR Lyraes, and we found that our method outperforms traditional non-informative cross-validation strategies, even when penalized models are assessed. Our methodology provides a more rigorous alternative to assess machine learning models using astronomical knowledge. From this approach, applications to other classes of variable stars and algorithmic improvements can be developed.
△ Less
Submitted 24 May, 2021;
originally announced May 2021.
-
Alert Classification for the ALeRCE Broker System: The Light Curve Classifier
Authors:
P. Sánchez-Sáez,
I. Reyes,
C. Valenzuela,
F. Förster,
S. Eyheramendy,
F. Elorrieta,
F. E. Bauer,
G. Cabrera-Vives,
P. A. Estévez,
M. Catelan,
G. Pignata,
P. Huijse,
D. De Cicco,
P. Arévalo,
R. Carrasco-Davis,
J. Abril,
R. Kurtev,
J. Borissova,
J. Arredondo,
E. Castillo-Navarrete,
D. Rodriguez,
D. Ruz-Mieres,
A. Moya,
L. Sabatini-Gacitúa,
C. Sepúlveda-Cobo
, et al. (1 additional authors not shown)
Abstract:
We present the first version of the ALeRCE (Automatic Learning for the Rapid Classification of Events) broker light curve classifier. ALeRCE is currently processing the Zwicky Transient Facility (ZTF) alert stream, in preparation for the Vera C. Rubin Observatory. The ALeRCE light curve classifier uses variability features computed from the ZTF alert stream, and colors obtained from AllWISE and ZT…
▽ More
We present the first version of the ALeRCE (Automatic Learning for the Rapid Classification of Events) broker light curve classifier. ALeRCE is currently processing the Zwicky Transient Facility (ZTF) alert stream, in preparation for the Vera C. Rubin Observatory. The ALeRCE light curve classifier uses variability features computed from the ZTF alert stream, and colors obtained from AllWISE and ZTF photometry. We apply a Balanced Random Forest algorithm with a two-level scheme, where the top level classifies each source as periodic, stochastic, or transient, and the bottom level further resolves each of these hierarchical classes, amongst 15 total classes. This classifier corresponds to the first attempt to classify multiple classes of stochastic variables (including core- and host-dominated active galactic nuclei, blazars, young stellar objects, and cataclysmic variables) in addition to different classes of periodic and transient sources, using real data. We created a labeled set using various public catalogs (such as the Catalina Surveys and {\em Gaia} DR2 variable stars catalogs, and the Million Quasars catalog), and we classify all objects with $\geq6$ $g$-band or $\geq6$ $r$-band detections in ZTF (868,371 sources as of 2020/06/09), providing updated classifications for sources with new alerts every day. For the top level we obtain macro-averaged precision and recall scores of 0.96 and 0.99, respectively, and for the bottom level we obtain macro-averaged precision and recall scores of 0.57 and 0.76, respectively. Updated classifications from the light curve classifier can be found at the \href{http://alerce.online}{ALeRCE Explorer website}.
△ Less
Submitted 19 November, 2020; v1 submitted 7 August, 2020;
originally announced August 2020.
-
The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker
Authors:
F. Förster,
G. Cabrera-Vives,
E. Castillo-Navarrete,
P. A. Estévez,
P. Sánchez-Sáez,
J. Arredondo,
F. E. Bauer,
R. Carrasco-Davis,
M. Catelan,
F. Elorrieta,
S. Eyheramendy,
P. Huijse,
G. Pignata,
E. Reyes,
I. Reyes,
D. Rodríguez-Mancini,
D. Ruz-Mieres,
C. Valenzuela,
I. Alvarez-Maldonado,
N. Astorga,
J. Borissova,
A. Clocchiatti,
D. De Cicco,
C. Donoso-Oliva,
M. J. Graham
, et al. (15 additional authors not shown)
Abstract:
We introduce the Automatic Learning for the Rapid Classification of Events (ALeRCE) broker, an astronomical alert broker designed to provide a rapid and self--consistent classification of large etendue telescope alert streams, such as that provided by the Zwicky Transient Facility (ZTF) and, in the future, the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). ALeRCE is a Chilean--l…
▽ More
We introduce the Automatic Learning for the Rapid Classification of Events (ALeRCE) broker, an astronomical alert broker designed to provide a rapid and self--consistent classification of large etendue telescope alert streams, such as that provided by the Zwicky Transient Facility (ZTF) and, in the future, the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). ALeRCE is a Chilean--led broker run by an interdisciplinary team of astronomers and engineers, working to become intermediaries between survey and follow--up facilities. ALeRCE uses a pipeline which includes the real--time ingestion, aggregation, cross--matching, machine learning (ML) classification, and visualization of the ZTF alert stream. We use two classifiers: a stamp--based classifier, designed for rapid classification, and a light--curve--based classifier, which uses the multi--band flux evolution to achieve a more refined classification. We describe in detail our pipeline, data products, tools and services, which are made public for the community (see \url{https://alerce.science}). Since we began operating our real--time ML classification of the ZTF alert stream in early 2019, we have grown a large community of active users around the globe. We describe our results to date, including the real--time processing of $9.7\times10^7$ alerts, the stamp classification of $1.9\times10^7$ objects, the light curve classification of $8.5\times10^5$ objects, the report of 3088 supernova candidates, and different experiments using LSST-like alert streams. Finally, we discuss the challenges ahead to go from a single-stream of alerts such as ZTF to a multi--stream ecosystem dominated by LSST.
△ Less
Submitted 7 August, 2020;
originally announced August 2020.
-
Asteroids' Size Distribution and Colors from HiTS
Authors:
J. Peña,
C. Fuentes,
F. Förster,
J. Martínez-Palomera,
G. Cabrera-Vives,
J. C. Maureira,
P. Huijse,
P. A. Estévez,
L. Galbany,
S. González-Gaitán,
Th. de Jaeger
Abstract:
We report the observations of solar system objects during the 2015 campaign of the High cadence Transient Survey (HiTS). We found 5740 bodies (mostly Main Belt asteroids), 1203 of which were detected in different nights and in $g'$ and $r'$. Objects were linked in the barycenter system and their orbital parameters were computed assuming Keplerian motion. We identified 6 near Earth objects, 1738 Ma…
▽ More
We report the observations of solar system objects during the 2015 campaign of the High cadence Transient Survey (HiTS). We found 5740 bodies (mostly Main Belt asteroids), 1203 of which were detected in different nights and in $g'$ and $r'$. Objects were linked in the barycenter system and their orbital parameters were computed assuming Keplerian motion. We identified 6 near Earth objects, 1738 Main Belt asteroids and 4 Trans-Neptunian objects. We did not find a $g'-r'$ color-size correlation for $14<H_{g'}<18$ ($1<D<10$ km) asteroids. We show asteroids' colors are disturbed by HiTS' 1.6 hour cadence and estimate that observations should be separated by at most 14 minutes to avoid confusion in future wide-field surveys like LSST. The size distribution for the Main Belt objects can be characterized as a simple power law with slope $\sim0.9$, steeper than in any other survey, while data from HiTS 2014's campaign is consistent with previous ones (slopes $\sim0.68$ at the bright end and $\sim0.34$ at the faint end). This difference is likely due to the ecliptic distribution of the Main Belt since 2015's campaign surveyed farther from the ecliptic than did 2014's and most previous surveys.
△ Less
Submitted 13 March, 2020; v1 submitted 11 March, 2020;
originally announced March 2020.
-
An Information Theory Approach on Deciding Spectroscopic Follow Ups
Authors:
Javiera Astudillo,
Pavlos Protopapas,
Karim Pichara,
Pablo Huijse
Abstract:
Classification and characterization of variable phenomena and transient phenomena are critical for astrophysics and cosmology. These objects are commonly studied using photometric time series or spectroscopic data. Given that many ongoing and future surveys are in time-domain and given that adding spectra provide further insights but requires more observational resources, it would be valuable to k…
▽ More
Classification and characterization of variable phenomena and transient phenomena are critical for astrophysics and cosmology. These objects are commonly studied using photometric time series or spectroscopic data. Given that many ongoing and future surveys are in time-domain and given that adding spectra provide further insights but requires more observational resources, it would be valuable to know which objects should we prioritize to have spectrum in addition to time series. We propose a methodology in a probabilistic setting that determines a-priory which objects are worth taking spectrum to obtain better insights, where we focus 'insight' as the type of the object (classification). Objects for which we query its spectrum are reclassified using their full spectrum information. We first train two classifiers, one that uses photometric data and another that uses photometric and spectroscopic data together. Then for each photometric object we estimate the probability of each possible spectrum outcome. We combine these models in various probabilistic frameworks (strategies) which are used to guide the selection of follow up observations. The best strategy depends on the intended use, whether it is getting more confidence or accuracy. For a given number of candidate objects (127, equal to 5% of the dataset) for taking spectra, we improve 37% class prediction accuracy as opposed to 20% of a non-naive (non-random) best base-line strategy. Our approach provides a general framework for follow-up strategies and can be extended beyond classification and to include other forms of follow-ups beyond spectroscopy.
△ Less
Submitted 6 November, 2019;
originally announced November 2019.
-
The delay of shock breakout due to circumstellar material seen in most Type II Supernovae
Authors:
F. Förster,
T. J. Moriya,
J. C. Maureira,
J. P. Anderson,
S. Blinnikov,
F. Bufano,
G. Cabrera-Vives,
A. Clocchiatti,
Th. de Jaeger,
P. A. Estévez,
L. Galbany,
S. González-Gaitán,
G. Gräfener,
M. Hamuy,
E. Hsiao,
P. Huentelemu,
P. Huijse,
H. Kuncarayakti,
J. Martínez-Palomera,
G. Medina,
F. Olivares E.,
G. Pignata,
A. Razza,
I. Reyes,
J. San Martín
, et al. (13 additional authors not shown)
Abstract:
Type II supernovae (SNe) originate from the explosion of hydrogen-rich supergiant massive stars. Their first electromagnetic signature is the shock breakout, a short-lived phenomenon which can last from hours to days depending on the density at shock emergence. We present 26 rising optical light curves of SN II candidates discovered shortly after explosion by the High cadence Transient Survey (HiT…
▽ More
Type II supernovae (SNe) originate from the explosion of hydrogen-rich supergiant massive stars. Their first electromagnetic signature is the shock breakout, a short-lived phenomenon which can last from hours to days depending on the density at shock emergence. We present 26 rising optical light curves of SN II candidates discovered shortly after explosion by the High cadence Transient Survey (HiTS) and derive physical parameters based on hydrodynamical models using a Bayesian approach. We observe a steep rise of a few days in 24 out of 26 SN II candidates, indicating the systematic detection of shock breakouts in a dense circumstellar matter consistent with a mass loss rate $\dot{M} > 10^{-4} M_\odot yr^{-1}$ or a dense atmosphere. This implies that the characteristic hour timescale signature of stellar envelope SBOs may be rare in nature and could be delayed into longer-lived circumstellar material shock breakouts in most Type II SNe.
△ Less
Submitted 17 September, 2018;
originally announced September 2018.
-
The High Cadence Transient Survey (HITS): Compilation and characterization of light-curve catalogs
Authors:
Jorge Martínez-Palomera,
Francisco Förster,
Pavlos Protopapas,
Juan Carlos Maureira,
Paulina Lira,
Guillermo Cabrera-Vives,
Pablo Huijse,
Lluis Galbany,
Thomas de Jaeger,
Santiago González-Gaitán,
Gustavo Medina,
Giuliano Pignata,
Jaime San Martín,
Mario Hamuy,
Ricardo R. Muñoz
Abstract:
The High Cadence Transient Survey (HiTS) aims to discover and study transient objects with characteristic timescales between hours and days, such as pulsating, eclipsing and exploding stars. This survey represents a unique laboratory to explore large etendue observations from cadences of about 0.1 days and to test new computational tools for the analysis of large data. This work follows a fully \t…
▽ More
The High Cadence Transient Survey (HiTS) aims to discover and study transient objects with characteristic timescales between hours and days, such as pulsating, eclipsing and exploding stars. This survey represents a unique laboratory to explore large etendue observations from cadences of about 0.1 days and to test new computational tools for the analysis of large data. This work follows a fully \textit{Data Science} approach: from the raw data to the analysis and classification of variable sources. We compile a catalog of ${\sim}15$ million object detections and a catalog of ${\sim}2.5$ million light-curves classified by variability. The typical depth of the survey is $24.2$, $24.3$, $24.1$ and $23.8$ in $u$, $g$, $r$ and $i$ bands, respectively. We classified all point-like non-moving sources by first extracting features from their light-curves and then applying a Random Forest classifier. For the classification, we used a training set constructed using a combination of cross-matched catalogs, visual inspection, transfer/active learning and data augmentation. The classification model consists of several Random Forest classifiers organized in a hierarchical scheme. The classifier accuracy estimated on a test set is approximately $97\%$. In the unlabeled data, $3\,485$ sources were classified as variables, of which $1\,321$ were classified as periodic. Among the periodic classes we discovered with high confidence, 1 $δ$-scutti, 39 eclipsing binaries, 48 rotational variables and 90 RR-Lyrae and for the non-periodic classes we discovered 1 cataclysmic variables, 630 QSO, and 1 supernova candidates. The first data release can be accessed in the project archive of HiTS.
△ Less
Submitted 7 September, 2018; v1 submitted 3 September, 2018;
originally announced September 2018.
-
Enhanced Rotational Invariant Convolutional Neural Network for Supernovae Detection
Authors:
Esteban Reyes,
Pablo A. Estévez,
Ignacio Reyes,
Guillermo Cabrera-Vives,
Pablo Huijse,
Rodrigo Carrasco-Davis,
Francisco Förster
Abstract:
In this paper, we propose an enhanced CNN model for detecting supernovae (SNe). This is done by applying a new method for obtaining rotational invariance that exploits cyclic symmetry. In addition, we use a visualization approach, the layer-wise relevance propagation (LRP) method, which allows finding the relevant pixels in each image that contribute to discriminate between SN candidates and artif…
▽ More
In this paper, we propose an enhanced CNN model for detecting supernovae (SNe). This is done by applying a new method for obtaining rotational invariance that exploits cyclic symmetry. In addition, we use a visualization approach, the layer-wise relevance propagation (LRP) method, which allows finding the relevant pixels in each image that contribute to discriminate between SN candidates and artifacts. We introduce a measure to assess quantitatively the effect of the rotational invariant methods on the LRP relevance heatmaps. This allows comparing the proposed method, CAP, with the original Deep-HiTS model. The results show that the enhanced method presents an augmented capacity for achieving rotational invariance with respect to the original model. An ensemble of CAP models obtained the best results so far on the HiTS dataset, reaching an average accuracy of 99.53%. The improvement over Deep-HiTS is significant both statistically and in practice.
△ Less
Submitted 10 August, 2018;
originally announced August 2018.
-
The VVV Survey RR Lyrae Population in the Galactic Centre Region
Authors:
Rodrigo Contreras Ramos,
Dante Minniti,
Felipe Gran,
Manuela Zoccali,
Javier Alonso-García,
Pablo Huijse,
María Gabriela Navarro,
Álvaro Rojas-Arriagada,
Elena Valenti
Abstract:
Deep near-IR images from the VVV Survey were used to search for RR Lyrae type ab (RRab) stars within 100' from the Galactic Centre (GC). A sample of 960 RRab stars were discovered. We use the reddening-corrected magnitudes in order to isolate RRab belonging to the GC. The mean period for our RRab sample is $P=0.5446$ days, yielding a mean metallicity of $[Fe/H] = -1.30$ dex and a median distance f…
▽ More
Deep near-IR images from the VVV Survey were used to search for RR Lyrae type ab (RRab) stars within 100' from the Galactic Centre (GC). A sample of 960 RRab stars were discovered. We use the reddening-corrected magnitudes in order to isolate RRab belonging to the GC. The mean period for our RRab sample is $P=0.5446$ days, yielding a mean metallicity of $[Fe/H] = -1.30$ dex and a median distance from the Sun of $D=8.05$. We measure the RRab surface density using the less reddened region sampled here, finding $1000$ RRab/sq deg at a projected Galactocentric distance $R_G=1.6$ deg. This implies a large total mass ($M>10^9 M_\odot$) for the old and metal-poor population contained inside $R_G$. We measure accurate relative proper motions, from which we derive tangential velocity dispersions of $σV_l = 125.0$ and $σV_b = 124.1$ km/s along the Galactic longitude and latitude coordinates, respectively. The fact that these quantities are similar indicate that the bulk rotation of the RRab population is negligible, and implies that this population is supported by velocity dispersion. There are two main conclusions of this study. First, the population as a whole is no different from the outer bulge RRab, predominantly a metal-poor component that is shifted respect the Oosterhoff type I population defined by the globular clusters in the halo. Second, the RRab sample, as representative of the old and metal-poor stellar population in the region, have high velocity dispersions and zero rotation, suggesting a formation via dissipational collapse.
△ Less
Submitted 11 July, 2018;
originally announced July 2018.
-
Deep Learning for Image Sequence Classification of Astronomical Events
Authors:
Rodrigo Carrasco-Davis,
Guillermo Cabrera-Vives,
Francisco Förster,
Pablo A. Estévez,
Pablo Huijse,
Pavlos Protopapas,
Ignacio Reyes,
Jorge Martínez-Palomera,
Cristóbal Donoso
Abstract:
We propose a new sequential classification model for astronomical objects based on a recurrent convolutional neural network (RCNN) which uses sequences of images as inputs. This approach avoids the computation of light curves or difference images. This is the first time that sequences of images are used directly for the classification of variable objects in astronomy. The second contribution of th…
▽ More
We propose a new sequential classification model for astronomical objects based on a recurrent convolutional neural network (RCNN) which uses sequences of images as inputs. This approach avoids the computation of light curves or difference images. This is the first time that sequences of images are used directly for the classification of variable objects in astronomy. The second contribution of this work is the image simulation process. We generate synthetic image sequences that take into account the instrumental and observing conditions, obtaining a realistic, set of movies for each astronomical object. The simulated dataset is used to train our RCNN classifier. This approach allows us to generate datasets to train and test our RCNN model for different astronomical surveys and telescopes. We aim at building a simulated dataset whose distribution is close enough to the real dataset, so that a fine tuning could match the distributions between real and simulated dataset. To test the RCNN classifier trained with the synthetic dataset, we used real-world data from the High cadence Transient Survey (HiTS) obtaining an average recall of 85%, improved to 94% after performing fine tuning with 10 real samples per class. We compare the results of our model with those of a light curve random forest classifier. The proposed RCNN with fine tuning has a similar performance on the HiTS dataset compared to the light curve classifier, trained on an augmented training set with 10 real samples per class. The RCNN approach presents several advantages in an alert stream classification scenario, such as a reduction of the data pre-processing, faster online evaluation and easier performance improvement using a few real data samples. These results encourage us to use this method for alert brokers systems that will process alert streams generated by new telescopes such as the Large Synoptic Survey Telescope.
△ Less
Submitted 7 November, 2018; v1 submitted 10 July, 2018;
originally announced July 2018.
-
Asteroids in the High cadence Transient Survey
Authors:
J. Peña,
C. Fuentes,
F. Förster,
J. C. Maureira,
J. San Martín,
J. Littín,
P. Huijse,
G. Cabrera-Vives,
P. A. Estévez,
L. Galbany,
S. González-Gaitán,
J. Martínez,
Th. de Jaeger,
M. Hamuy
Abstract:
We report on the serendipitous observations of Solar System objects imaged during the High cadence Transient Survey (HiTS) 2014 observation campaign. Data from this high cadence, wide field survey was originally analyzed for finding variable static sources using Machine Learning to select the most-likely candidates. In this work we search for moving transients consistent with Solar System objects…
▽ More
We report on the serendipitous observations of Solar System objects imaged during the High cadence Transient Survey (HiTS) 2014 observation campaign. Data from this high cadence, wide field survey was originally analyzed for finding variable static sources using Machine Learning to select the most-likely candidates. In this work we search for moving transients consistent with Solar System objects and derive their orbital parameters.
We use a simple, custom detection algorithm to link trajectories and assume Keplerian motion to derive the asteroid's orbital parameters. We use known asteroids from the Minor Planet Center (MPC) database to assess the detection efficiency of the survey and our search algorithm. Trajectories have an average of nine detections spread over 2 days, and our fit yields typical errors of $σ_a\sim 0.07 ~{\rm AU}$, $σ_{\rm e} \sim 0.07 $ and $σ_i\sim 0.^{\circ}5~ {\rm deg}$ in semi-major axis, eccentricity, and inclination respectively for known asteroids in our sample. We extract 7,700 orbits from our trajectories, identifying 19 near Earth objects, 6,687 asteroids, 14 Centaurs, and 15 trans-Neptunian objects. This highlights the complementarity of supernova wide field surveys for Solar System research and the significance of machine learning to clean data of false detections. It is a good example of the data--driven science that LSST will deliver.
△ Less
Submitted 8 June, 2018;
originally announced June 2018.
-
Proper motions in the VVV Survey: Results for more than 15 million stars across NGC 6544
Authors:
R. Contreras Ramos,
M. Zoccali,
F. Rojas,
A. Rojas-Arriagada,
M. Gárate,
P. Huijse,
F. Gran,
M. Soto,
A. A. R. Valcarce,
P. A. Estévez,
D. Minniti
Abstract:
Context: In the last six years, the VVV survey mapped 562 sq. deg. across the bulge and southern disk of the Galaxy. However, a detailed study of these regions, which includes $\sim 36$ globular clusters (GCs) and thousands of open clusters is by no means an easy challenge. High differential reddening and severe crowding along the line of sight makes highly hamper to reliably distinguish stars bel…
▽ More
Context: In the last six years, the VVV survey mapped 562 sq. deg. across the bulge and southern disk of the Galaxy. However, a detailed study of these regions, which includes $\sim 36$ globular clusters (GCs) and thousands of open clusters is by no means an easy challenge. High differential reddening and severe crowding along the line of sight makes highly hamper to reliably distinguish stars belonging to different populations and/or systems. Aims: The aim of this study is to separate stars that likely belong to the Galactic GC NGC 6544 from its surrounding field by means of proper motion (PM) techniques. Methods: This work was based upon a new astrometric reduction method optimized for images of the VVV survey. Results: Photometry over the six years baseline of the survey allowed us to obtain a mean precision of $\sim0.51$ mas/yr, in each PM coordinate, for stars with Ks < 15 mag. In the area studied here, cluster stars separate very well from field stars, down to the main sequence turnoff and below, allowing us to derive for the first time the absolute PM of NGC 6544. Isochrone fitting on the clean and differential reddening corrected cluster color magnitude diagram yields an age of $\sim$ 11-13 Gyr, and metallicity [Fe/H] = -1.5 dex, in agreement with previous studies restricted to the cluster core. We were able to derive the cluster orbit assuming an axisymmetric model of the Galaxy and conclude that NGC 6544 is likely a halo GC. We have not detected tidal tail signatures associated to the cluster, but a remarkable elongation in the galactic center direction has been found. The precision achieved in the PM determination also allows us to separate bulge stars from foreground disk stars, enabling the kinematical selection of bona fide bulge stars across the whole survey area. Our results show that VVV data is perfectly suitable for this kind of analysis.
△ Less
Submitted 22 September, 2017;
originally announced September 2017.
-
Robust period estimation using mutual information for multi-band light curves in the synoptic survey era
Authors:
Pablo Huijse,
Pablo A. Estevez,
Francisco Forster,
Scott F. Daniel,
Andrew J. Connolly,
Pavlos Protopapas,
Rodrigo Carrasco,
Jose C. Principe
Abstract:
The Large Synoptic Survey Telescope (LSST) will produce an unprecedented amount of light curves using six optical bands. Robust and efficient methods that can aggregate data from multidimensional sparsely-sampled time series are needed. In this paper we present a new method for light curve period estimation based on the quadratic mutual information (QMI). The proposed method does not assume a part…
▽ More
The Large Synoptic Survey Telescope (LSST) will produce an unprecedented amount of light curves using six optical bands. Robust and efficient methods that can aggregate data from multidimensional sparsely-sampled time series are needed. In this paper we present a new method for light curve period estimation based on the quadratic mutual information (QMI). The proposed method does not assume a particular model for the light curve nor its underlying probability density and it is robust to non-Gaussian noise and outliers. By combining the QMI from several bands the true period can be estimated even when no single-band QMI yields the period. Period recovery performance as a function of average magnitude and sample size is measured using 30,000 synthetic multi-band light curves of RR Lyrae and Cepheid variables generated by the LSST Operations and Catalog simulators. The results show that aggregating information from several bands is highly beneficial in LSST sparsely-sampled time series, obtaining an absolute increase in period recovery rate up to 50%. We also show that the QMI is more robust to noise and light curve length (sample size) than the multiband generalizations of the Lomb Scargle and Analysis of Variance periodograms, recovering the true period in 10-30% more cases than its competitors. A python package containing efficient Cython implementations of the QMI and other methods is provided.
△ Less
Submitted 11 September, 2017;
originally announced September 2017.
-
The High Cadence Transient Survey (HiTS) - I. Survey design and supernova shock breakout constraints
Authors:
Francisco Förster,
Juan C. Maureira,
Jaime San Martín,
Mario Hamuy,
Jorge Martínez,
Pablo Huijse,
Guillermo Cabrera,
Lluís Galbany,
Thomas de Jaeger,
Santiago González-Gaitán,
Joseph P. Anderson,
Hanindyo Kuncarayakti,
Giuliano Pignata,
Filomena Bufano,
Jorge Littín,
Felipe Olivares,
Gustavo Medina,
R. Chris Smith,
A. Katherina Vivas,
Pablo A. Estévez,
Ricardo Muñoz,
Eduardo Vera
Abstract:
We present the first results of the High cadence Transient Survey (HiTS), a survey whose objective is to detect and follow up optical transients with characteristic timescales from hours to days, especially the earliest hours of supernova (SN) explosions. HiTS uses the Dark Energy Camera (DECam) and a custom made pipeline for image subtraction, candidate filtering and candidate visualization, whic…
▽ More
We present the first results of the High cadence Transient Survey (HiTS), a survey whose objective is to detect and follow up optical transients with characteristic timescales from hours to days, especially the earliest hours of supernova (SN) explosions. HiTS uses the Dark Energy Camera (DECam) and a custom made pipeline for image subtraction, candidate filtering and candidate visualization, which runs in real-time to be able to react rapidly to the new transients. We discuss the survey design, the technical challenges associated with the real-time analysis of these large volumes of data and our first results. In our 2013, 2014 and 2015 campaigns we have detected more than 120 young SN candidates, but we did not find a clear signature from the short-lived SN shock breakouts (SBOs) originating after the core collapse of red supergiant stars, which was the initial science aim of this survey. Using the empirical distribution of limiting-magnitudes from our observational campaigns we measured the expected recovery fraction of randomly injected SN light curves which included SBO optical peaks produced with models from Tominaga et al. (2011) and Nakar & Sari (2010). From this analysis we cannot rule out the models from Tominaga et al. (2011) under any reasonable distributions of progenitor masses, but we can marginally rule out the brighter and longer-lived SBO models from Nakar & Sari (2010) under our best-guess distribution of progenitor masses. Finally, we highlight the implications of this work for future massive datasets produced by astronomical observatories such as LSST.
△ Less
Submitted 12 September, 2016;
originally announced September 2016.
-
Computational Intelligence Challenges and Applications on Large-Scale Astronomical Time Series Databases
Authors:
Pablo Huijse,
Pablo A. Estevez,
Pavlos Protopapas,
Jose C. Principe,
Pablo Zegers
Abstract:
Time-domain astronomy (TDA) is facing a paradigm shift caused by the exponential growth of the sample size, data complexity and data generation rates of new astronomical sky surveys. For example, the Large Synoptic Survey Telescope (LSST), which will begin operations in northern Chile in 2022, will generate a nearly 150 Petabyte imaging dataset of the southern hemisphere sky. The LSST will stream…
▽ More
Time-domain astronomy (TDA) is facing a paradigm shift caused by the exponential growth of the sample size, data complexity and data generation rates of new astronomical sky surveys. For example, the Large Synoptic Survey Telescope (LSST), which will begin operations in northern Chile in 2022, will generate a nearly 150 Petabyte imaging dataset of the southern hemisphere sky. The LSST will stream data at rates of 2 Terabytes per hour, effectively capturing an unprecedented movie of the sky. The LSST is expected not only to improve our understanding of time-varying astrophysical objects, but also to reveal a plethora of yet unknown faint and fast-varying phenomena. To cope with a change of paradigm to data-driven astronomy, the fields of astroinformatics and astrostatistics have been created recently. The new data-oriented paradigms for astronomy combine statistics, data mining, knowledge discovery, machine learning and computational intelligence, in order to provide the automated and robust methods needed for the rapid detection and classification of known astrophysical objects as well as the unsupervised characterization of novel phenomena. In this article we present an overview of machine learning and computational intelligence applications to TDA. Future big data challenges and new lines of research in TDA, focusing on the LSST, are identified and discussed from the viewpoint of computational intelligence/machine learning. Interdisciplinary collaboration will be required to cope with the challenges posed by the deluge of astronomical data coming from the LSST.
△ Less
Submitted 25 September, 2015;
originally announced September 2015.
-
A Novel, Fully Automated Pipeline for Period Estimation in the EROS 2 Data Set
Authors:
Pavlos Protopapas,
Pablo Huijse,
Pablo A. Estevez,
Pablo Zegers,
Jose C. Principe
Abstract:
We present a new method to discriminate periodic from non-periodic irregularly sampled lightcurves. We introduce a periodic kernel and maximize a similarity measure derived from information theory to estimate the periods and a discriminator factor. We tested the method on a dataset containing 100,000 synthetic periodic and non-periodic lightcurves with various periods, amplitudes and shapes genera…
▽ More
We present a new method to discriminate periodic from non-periodic irregularly sampled lightcurves. We introduce a periodic kernel and maximize a similarity measure derived from information theory to estimate the periods and a discriminator factor. We tested the method on a dataset containing 100,000 synthetic periodic and non-periodic lightcurves with various periods, amplitudes and shapes generated using a multivariate generative model. We correctly identified periodic and non-periodic lightcurves with a completeness of 90% and a precision of 95%, for lightcurves with a signal-to-noise ratio (SNR) larger than 0.5. We characterize the efficiency and reliability of the model using these synthetic lightcurves and applied the method on the EROS-2 dataset. A crucial consideration is the speed at which the method can be executed. Using hierarchical search and some simplification on the parameter search we were able to analyze 32.8 million lightcurves in 18 hours on a cluster of GPGPUs. Using the sensitivity analysis on the synthetic dataset, we infer that 0.42% in the LMC and 0.61% in the SMC of the sources show periodic behavior. The training set, the catalogs and source code are all available in http://timemachine.iic.harvard.edu.
△ Less
Submitted 4 December, 2014;
originally announced December 2014.
-
An Information Theoretic Algorithm for Finding Periodicities in Stellar Light Curves
Authors:
Pablo Huijse,
Pablo A. Estevez,
Pavlos Protopapas,
Pablo Zegers,
Jose C. Principe
Abstract:
We propose a new information theoretic metric for finding periodicities in stellar light curves. Light curves are astronomical time series of brightness over time, and are characterized as being noisy and unevenly sampled. The proposed metric combines correntropy (generalized correlation) with a periodic kernel to measure similarity among samples separated by a given period. The new metric provide…
▽ More
We propose a new information theoretic metric for finding periodicities in stellar light curves. Light curves are astronomical time series of brightness over time, and are characterized as being noisy and unevenly sampled. The proposed metric combines correntropy (generalized correlation) with a periodic kernel to measure similarity among samples separated by a given period. The new metric provides a periodogram, called Correntropy Kernelized Periodogram (CKP), whose peaks are associated with the fundamental frequencies present in the data. The CKP does not require any resampling, slotting or folding scheme as it is computed directly from the available samples. CKP is the main part of a fully-automated pipeline for periodic light curve discrimination to be used in astronomical survey databases. We show that the CKP method outperformed the slotted correntropy, and conventional methods used in astronomy for periodicity discrimination and period estimation tasks, using a set of light curves drawn from the MACHO survey. The proposed metric achieved 97.2% of true positives with 0% of false positives at the confidence level of 99% for the periodicity discrimination task; and 88% of hits with 11.6% of multiples and 0.4% of misses in the period estimation task.
△ Less
Submitted 11 December, 2012;
originally announced December 2012.
-
Period Estimation in Astronomical Time Series Using Slotted Correntropy
Authors:
Pablo Huijse,
Pablo A. Estévez,
Pablo Zegers,
José Príncipe,
Pavlos Protopapas
Abstract:
In this letter, we propose a method for period estimation in light curves from periodic variable stars using correntropy. Light curves are astronomical time series of stellar brightness over time, and are characterized as being noisy and unevenly sampled. We propose to use slotted time lags in order to estimate correntropy directly from irregularly sampled time series. A new information theoretic…
▽ More
In this letter, we propose a method for period estimation in light curves from periodic variable stars using correntropy. Light curves are astronomical time series of stellar brightness over time, and are characterized as being noisy and unevenly sampled. We propose to use slotted time lags in order to estimate correntropy directly from irregularly sampled time series. A new information theoretic metric is proposed for discriminating among the peaks of the correntropy spectral density. The slotted correntropy method outperformed slotted correlation, string length, VarTools (Lomb-Scargle periodogram and Analysis of Variance), and SigSpec applications on a set of light curves drawn from the MACHO survey.
△ Less
Submitted 13 December, 2011;
originally announced December 2011.
