-
A Framework for Designing and Evaluating Solar Flare Forecasting Systems
Authors:
T. Cinto,
A. L. S. Gradvohl,
G. P. Coelho,
A. E. A. da Silva
Abstract:
Disturbances in space weather can negatively affect several fields, including aviation and aerospace, satellites, oil and gas industries, and electrical systems, leading to economic and commercial losses. Solar flares are the most significant events that can affect the Earth's atmosphere, thus leading researchers to drive efforts on their forecasting. The related literature is comprehensive and ho…
▽ More
Disturbances in space weather can negatively affect several fields, including aviation and aerospace, satellites, oil and gas industries, and electrical systems, leading to economic and commercial losses. Solar flares are the most significant events that can affect the Earth's atmosphere, thus leading researchers to drive efforts on their forecasting. The related literature is comprehensive and holds several systems proposed for flare forecasting. However, most techniques are tailor-made and designed for specific purposes, not allowing researchers to customize them in case of changes in data input or in the prediction algorithm. This paper proposes a framework to design, train, and evaluate flare prediction systems which present promising results. Our proposed framework involves model and feature selection, randomized hyper-parameters optimization, data resampling, and evaluation under operational settings. Compared to baseline predictions, our framework generated some proof-of-concept models with positive recalls between 0.70 and 0.75 for forecasting $\geq M$ class flares up to 96 hours ahead while keeping the area under the ROC curve score at high levels.
△ Less
Submitted 5 May, 2020;
originally announced May 2020.
-
Solar Flares Forecasting Using Time Series and Extreme Gradient Boosting Ensembles
Authors:
T. Cinto,
A. L. S. Gradvohl,
G. P. Coelho,
A. E. A. da Silva
Abstract:
Space weather events may cause damage to several fields, including aviation, satellites, oil and gas industries, and electrical systems, leading to economic and commercial losses. Solar flares are one of the most significant events, and refer to sudden radiation releases that can affect the Earth's atmosphere within a few hours or minutes. Therefore, it is worth designing high-performance systems…
▽ More
Space weather events may cause damage to several fields, including aviation, satellites, oil and gas industries, and electrical systems, leading to economic and commercial losses. Solar flares are one of the most significant events, and refer to sudden radiation releases that can affect the Earth's atmosphere within a few hours or minutes. Therefore, it is worth designing high-performance systems for forecasting such events. Although in the literature there are many approaches for flare forecasting, there is still a lack of consensus concerning the techniques used for designing these systems. Seeking to establish some standardization while designing flare predictors, in this study we propose a novel methodology for designing such predictors, further validated with extreme gradient boosting tree classifiers and time series. This methodology relies on the following well-defined machine learning based pipeline: (i) univariate feature selection; (ii) randomized hyper-parameter optimization; (iii) imbalanced data treatment; (iv) adjustment of cut-off point of classifiers; and (v) evaluation under operational settings. To verify our methodology effectiveness, we designed and evaluated three proof-of-concept models for forecasting $\geq C$ class flares up to 72 hours ahead. Compared to baseline models, those models were able to significantly increase their scores of true skill statistics (TSS) under operational forecasting scenarios by 0.37 (predicting flares in the next 24 hours), 0.13 (predicting flares within 24-48 hours), and 0.36 (predicting flares within 48-72 hours). Besides increasing TSS, the methodology also led to significant increases in the area under the ROC curve, corroborating that we improved the positive and negative recalls of classifiers while decreasing the number of false alarms.
△ Less
Submitted 5 May, 2020; v1 submitted 28 April, 2020;
originally announced April 2020.
-
Astro2020 APC White Paper: Elevating the Role of Software as a Product of the Research Enterprise
Authors:
Arfon M. Smith,
Dara Norman,
Kelle Cruz,
Vandana Desai,
Eric Bellm,
Britt Lundgren,
Frossie Economou,
Brian D. Nord,
Chad Schafer,
Gautham Narayan,
Joseph Harrington,
Erik Tollerud,
Brigitta Sipőcz,
Timothy Pickering,
Molly S. Peeples,
Bruce Berriman,
Peter Teuben,
David Rodriguez,
Andre Gradvohl,
Lior Shamir,
Alice Allen,
Joel R. Brownstein,
Adam Ginsburg,
Manodeep Sinha,
Cameron Hummels
, et al. (20 additional authors not shown)
Abstract:
Software is a critical part of modern research, and yet there are insufficient mechanisms in the scholarly ecosystem to acknowledge, cite, and measure the impact of research software. The majority of academic fields rely on a one-dimensional credit model whereby academic articles (and their associated citations) are the dominant factor in the success of a researcher's career. In the petabyte era o…
▽ More
Software is a critical part of modern research, and yet there are insufficient mechanisms in the scholarly ecosystem to acknowledge, cite, and measure the impact of research software. The majority of academic fields rely on a one-dimensional credit model whereby academic articles (and their associated citations) are the dominant factor in the success of a researcher's career. In the petabyte era of astronomical science, citing software and measuring its impact enables academia to retain and reward researchers that make significant software contributions. These highly skilled researchers must be retained to maximize the scientific return from petabyte-scale datasets. Evolving beyond the one-dimensional credit model requires overcoming several key challenges, including the current scholarly ecosystem and scientific culture issues. This white paper will present these challenges and suggest practical solutions for elevating the role of software as a product of the research enterprise.
△ Less
Submitted 14 July, 2019;
originally announced July 2019.
