-
AI-FLARES: Artificial Intelligence for the Analysis of Solar Flares Data
Authors:
Michele Piana,
Federico Benvenuto,
Anna Maria Massone,
Cristina Campi,
Sabrina Guastavino,
Francesco Marchetti,
Paolo Massa,
Emma Perracchione,
Anna Volpara
Abstract:
AI-FLARES (Artificial Intelligence for the Analysis of Solar Flares Data) is a research project funded by the Agenzia Spaziale Italiana and by the Istituto Nazionale di Astrofisica within the framework of the ``Attività di Studio per la Comunità Scientifica Nazionale Sole, Sistema Solare ed Esopianeti'' program. The topic addressed by this project was the development and use of computational metho…
▽ More
AI-FLARES (Artificial Intelligence for the Analysis of Solar Flares Data) is a research project funded by the Agenzia Spaziale Italiana and by the Istituto Nazionale di Astrofisica within the framework of the ``Attività di Studio per la Comunità Scientifica Nazionale Sole, Sistema Solare ed Esopianeti'' program. The topic addressed by this project was the development and use of computational methods for the analysis of remote sensing space data associated to solar flare emission. This paper overviews the main results obtained by the project, with specific focus on solar flare forecasting, reconstruction of morphologies of the flaring sources, and interpretation of acceleration mechanisms triggered by solar flares.
△ Less
Submitted 2 January, 2024;
originally announced January 2024.
-
CAESAR: Space Weather archive prototype for ASPIS
Authors:
Marco Molinaro,
Valerio Formato,
Carmelo Magnafico,
Federico Benvenuto,
Alessandro Perfetti,
Rossana De Marco,
Cristina Campi,
Andrea Tacchino,
Valeria di Felice,
Ermanno Pietropaolo,
Giancarlo de Gasperis,
Luca di Fino,
Gregoire Francisco,
Igor Bertello,
Anna Milillo,
Giuseppe Sindoni,
Christina Plainaki,
Marco Giardino,
Gianluca Polenta,
Dario Del Moro,
Monica Laurenza
Abstract:
The project CAESAR (Comprehensive spAce wEather Studies for the ASPIS prototype Realization) is aimed to tackle all the relevant aspects of Space Weather (SWE) and realize the prototype of the scientific data centre for Space Weather of the Italian Space Agency (ASI) called ASPIS (ASI SPace Weather InfraStructure). This contribution is meant to bring attention upon the first steps in the developme…
▽ More
The project CAESAR (Comprehensive spAce wEather Studies for the ASPIS prototype Realization) is aimed to tackle all the relevant aspects of Space Weather (SWE) and realize the prototype of the scientific data centre for Space Weather of the Italian Space Agency (ASI) called ASPIS (ASI SPace Weather InfraStructure). This contribution is meant to bring attention upon the first steps in the development of the CAESAR prototype for ASPIS and will focus on the activities of the Node 2000 of CAESAR, the set of Work Packages dedicated to the technical design and implementation of the CAESAR ASPIS archive prototype. The product specifications of the intended resources that will form the archive, functional and system requirements gathered as first steps to seed the design of the prototype infrastructure, and evaluation of existing frameworks, tools and standards, will be presented as well as the status of the project in its initial stage.
△ Less
Submitted 25 October, 2023;
originally announced October 2023.
-
Physics-driven machine learning for the prediction of coronal mass ejections' travel times
Authors:
Sabrina Guastavino,
Valentina Candiani,
Alessandro Bemporad,
Francesco Marchetti,
Federico Benvenuto,
Anna Maria Massone,
Roberto Susino,
Daniele Telloni,
Silvano Fineschi,
Michele Piana
Abstract:
Coronal Mass Ejections (CMEs) correspond to dramatic expulsions of plasma and magnetic field from the solar corona into the heliosphere. CMEs are scientifically relevant because they are involved in the physical mechanisms characterizing the active Sun. However, more recently CMEs have attracted attention for their impact on space weather, as they are correlated to geomagnetic storms and may induc…
▽ More
Coronal Mass Ejections (CMEs) correspond to dramatic expulsions of plasma and magnetic field from the solar corona into the heliosphere. CMEs are scientifically relevant because they are involved in the physical mechanisms characterizing the active Sun. However, more recently CMEs have attracted attention for their impact on space weather, as they are correlated to geomagnetic storms and may induce the generation of Solar Energetic Particles streams. In this space weather framework, the present paper introduces a physics-driven artificial intelligence (AI) approach to the prediction of CMEs travel time, in which the deterministic drag-based model is exploited to improve the training phase of a cascade of two neural networks fed with both remote sensing and in-situ data. This study shows that the use of physical information in the AI architecture significantly improves both the accuracy and the robustness of the travel time prediction.
△ Less
Submitted 17 May, 2023;
originally announced May 2023.
-
STIX imaging I -- Concept
Authors:
Paolo Massa,
Gordon. J. Hurford,
Anna Volpara,
Matej Kuhar,
Andrea Francesco Battaglia,
Hualin Xiao,
Diego Casadei,
Emma Perracchione,
Sara Garbarino,
Sabrina Guastavino,
Hannah Collier,
Ewan C. M. Dickson,
Daniel F. Ryan,
Shane A. Maloney,
Frederic Schuller,
Alexander Warmuth,
Anna Maria Massone,
Federico Benvenuto,
Michele Piana,
Säm Krucker
Abstract:
Aims. To provide a schematic mathematical description of the imaging concept of the Spectrometer/Telescope for Imaging X-rays (STIX) on board Solar Orbiter. The derived model is the fundamental starting point for both the interpretation of STIX data and the description of the data calibration process. Methods. We describe the STIX indirect imaging technique which is based on spatial modulation of…
▽ More
Aims. To provide a schematic mathematical description of the imaging concept of the Spectrometer/Telescope for Imaging X-rays (STIX) on board Solar Orbiter. The derived model is the fundamental starting point for both the interpretation of STIX data and the description of the data calibration process. Methods. We describe the STIX indirect imaging technique which is based on spatial modulation of the X-ray photon flux by means of tungsten grids. We show that each of 30 STIX imaging sub-collimators measures a complex Fourier component of the flaring X-ray source corresponding to a specific angular frequency. We also provide details about the count distribution model, which describes the relationship between the photon flux and the measured pixel counts. Results. We define the image reconstruction problem for STIX from both visibilities and photon counts. We provide an overview of the algorithms implemented for the solution of the imaging problem, and a comparison of the results obtained with these different methods in the case of the SOL2022-03-31T18 flaring event.
△ Less
Submitted 4 March, 2023;
originally announced March 2023.
-
Operational solar flare forecasting via video-based deep learning
Authors:
Sabrina Guastavino,
Francesco Marchetti,
Federico Benvenuto,
Cristina Campi,
Michele Piana
Abstract:
Operational flare forecasting aims at providing predictions that can be used to make decisions, typically at a daily scale, about the space weather impacts of flare occurrence. This study shows that video-based deep learning can be used for operational purposes when the training and validation sets used for the network optimization are generated while accounting for the periodicity of the solar cy…
▽ More
Operational flare forecasting aims at providing predictions that can be used to make decisions, typically at a daily scale, about the space weather impacts of flare occurrence. This study shows that video-based deep learning can be used for operational purposes when the training and validation sets used for the network optimization are generated while accounting for the periodicity of the solar cycle. Specifically, the paper describes an algorithm that can be applied to build up sets of active regions that are balanced according to the flare class rates associated to a specific cycle phase. These sets are used to train and validate a Long-term Recurrent Convolutional Network made of a combination of a convolutional neural network and a Long-Short Memory network. The reliability of this approach is assessed in the case of two prediction windows containing the solar storm of March 2015 and September 2017, respectively.
△ Less
Submitted 12 September, 2022;
originally announced September 2022.
-
Forward-fitting STIX visibilities
Authors:
Anna Volpara,
Paolo Massa,
Emma Perracchione,
Andrea Francesco Battaglia,
Sara Garbarino,
Federico Benvenuto,
Anna Maria Massone,
Sam Krucker,
Michele Piana
Abstract:
Aima. To determine to what extent the problem of forward fitting visibilities measured by the Spectrometer/Telescope Imaging X-rays (STIX) on-board Solar Orbiter is more challenging with respect to the same problem in the case of previous hard X-ray solar imaging missions; to identify an effective optimization scheme for parametric imaging for STIX. Methods. This paper introduces a Particle Swarm…
▽ More
Aima. To determine to what extent the problem of forward fitting visibilities measured by the Spectrometer/Telescope Imaging X-rays (STIX) on-board Solar Orbiter is more challenging with respect to the same problem in the case of previous hard X-ray solar imaging missions; to identify an effective optimization scheme for parametric imaging for STIX. Methods. This paper introduces a Particle Swarm Optimization (PSO) algorithm for forward fitting STIX visibilities and compares its effectiveness with respect to the standard simplex-based optimization algorithm used so far for the analysis of visibilities measured by the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI). This comparison is made by considering experimental visibilities measured by both RHESSI and STIX, and synthetic visibilities generated by accounting for the STIX signal formation model. Results. We found out that the parametric imaging approach based on PSO is as reliable as the one based on the simplex method in the case of RHESSI visibilities. However, PSO is significantly more robust when applied to STIX simulated and experimental visibilities. Conclusions. Standard deterministic optimization is not effective enough for forward-fitting the few visibilities sampled by STIX in the angular frequency plane. Therefore a more sofisticated optimization scheme must be introduced for parametric imaging in the case of the Solar Orbiter X-ray telescope. The forward-fitting routine based on PSO we introduced in this paper proved to be significantly robust and reliable, and could be considered as an effective candidate tool for parametric imaging in the STIX context.
△ Less
Submitted 29 April, 2022;
originally announced April 2022.
-
First hard X-ray imaging results by Solar Orbiter STIX
Authors:
Paolo Massa,
Andrea F. Battaglia,
Anna Volpara,
Hannah Collier,
Gordon J. Hurford,
Matej Kuhar,
Emma Perracchione,
Sara Garbarino,
Anna Maria Massone,
Federico Benvenuto,
Frederic Schuller,
Alexander Warmuth,
Ewan C. M. Dickson,
Hualin Xiao,
Shane A. Maloney,
Daniel F. Ryan,
Michele Piana,
Säm Krucker
Abstract:
Context. The Spectrometer/Telescope for Imaging X-rays (STIX) is one of 6 remote sensing instruments on-board Solar Orbiter. It provides hard X-ray imaging spectroscopy of solar flares by sampling the Fourier transform of the incoming flux. Aims. To show that the visibility amplitude and phase calibration of 24 out of 30 STIX sub-collimators is well advanced and that a set of imaging methods is ab…
▽ More
Context. The Spectrometer/Telescope for Imaging X-rays (STIX) is one of 6 remote sensing instruments on-board Solar Orbiter. It provides hard X-ray imaging spectroscopy of solar flares by sampling the Fourier transform of the incoming flux. Aims. To show that the visibility amplitude and phase calibration of 24 out of 30 STIX sub-collimators is well advanced and that a set of imaging methods is able to provide the first hard X-ray images of the flaring Sun from Solar Orbiter. Methods. We applied four visibility-based image reconstruction methods and a count-based one to calibrated STIX observations. The resulting reconstructions are compared to those provided by an optimization algorithm used for fitting the amplitudes of STIX visibilities. Results. When applied to six flares with GOES class between C4 and M4 which occurred in May 2021, the five imaging methods produce results morphologically consistent with the ones provided by the Atmospheric Imaging Assembly on-board the Solar Dynamic Observatory (SDO/AIA) in UV wavelengths. The $χ^2$ values and the parameters of the reconstructed sources are comparable between methods, thus confirming their robustness. Conclusions. This paper shows that the current calibration of the main part of STIX sub-collimators has reached a satisfactory level for scientific data exploitation, and that the imaging algorithms already available in the STIX data analysis software provide reliable and robust reconstructions of the morphology of solar flares.
△ Less
Submitted 18 February, 2022;
originally announced February 2022.
-
Implementation paradigm for supervised flare forecasting studies: a deep learning application with video data
Authors:
Sabrina Guastavino,
Francesco Marchetti,
Federico Benvenuto,
Cristina Campi,
Michele Piana
Abstract:
Solar flare forecasting can be realized by means of the analysis of magnetic data through artificial intelligence techniques. The aim is to predict whether a magnetic active region (AR) will originate solar flares above a certain class within a certain amount of time. A crucial issue is concerned with the way the adopted machine learning method is implemented, since forecasting results strongly de…
▽ More
Solar flare forecasting can be realized by means of the analysis of magnetic data through artificial intelligence techniques. The aim is to predict whether a magnetic active region (AR) will originate solar flares above a certain class within a certain amount of time. A crucial issue is concerned with the way the adopted machine learning method is implemented, since forecasting results strongly depend on the criterion with which training, validation, and test sets are populated. In this paper we propose a general paradigm to generate these sets in such a way that they are independent from each other and internally well-balanced in terms of AR flaring effectiveness. This set generation process provides a ground for comparison for the performance assessment of machine learning algorithms. Finally, we use this implementation paradigm in the case of a deep neural network, which takes as input videos of magnetograms recorded by the Helioseismic and Magnetic Imager on-board the Solar Dynamics Observatory (SDO/HMI). To our knowledge, this is the first time that the solar flare forecasting problem is addressed by means of a deep neural network for video classification, which does not require any a priori extraction of features from the HMI magnetograms.
△ Less
Submitted 24 October, 2021;
originally announced October 2021.
-
Imaging from STIX visibility amplitudes
Authors:
Paolo Massa,
Emma Perracchione,
Sara Garbarino,
Andrea F Battaglia,
Federico Benvenuto,
Michele Piana,
Gordon Hurford,
Sam Krucker
Abstract:
Aims: To provide the first demonstration of STIX Fourier-transform X-ray imaging using semi-calibrated (amplitude-only) visibility data acquired during the Solar Orbiter's cruise phase. Methods: We use a parametric imaging approach by which STIX visibility amplitudes are fitted by means of two non-linear optimization methods: a fast meta-heuristic technique inspired by social behavior, and a Bayes…
▽ More
Aims: To provide the first demonstration of STIX Fourier-transform X-ray imaging using semi-calibrated (amplitude-only) visibility data acquired during the Solar Orbiter's cruise phase. Methods: We use a parametric imaging approach by which STIX visibility amplitudes are fitted by means of two non-linear optimization methods: a fast meta-heuristic technique inspired by social behavior, and a Bayesian Monte Carlo sampling method, which, although slower, provides better quantification of uncertainties. Results: When applied to a set of solar flare visibility amplitudes recorded by STIX on November 18, 2020 the two parametric methods provide very coherent results. The analysis also demonstrates the ability of STIX to reconstruct high time resolution information and, from a spectral viewpoint, shows the reliability of a double-source scenario consistent with a thermal versus nonthermal interpretation. Conclusions: In this preliminary analysis of STIX imaging based only on visibility amplitudes, we formulate the imaging problem as a non-linear parametric issue we addressed by means of two high-performance optimization techniques that both showed the ability to sample the parametric space in an effective fashion, thus avoiding local minima.
△ Less
Submitted 10 August, 2021;
originally announced August 2021.
-
STIX X-ray microflare observations during the Solar Orbiter commissioning phase
Authors:
Andrea Francesco Battaglia,
Jonas Saqri,
Paolo Massa,
Emma Perracchione,
Ewan C. M. Dickson,
Hualin Xiao,
Astrid M. Veronig,
Alexander Warmuth,
Marina Battaglia,
Gordon J. Hurford,
Aline Meuris,
Olivier Limousin,
László Etesi,
Shane A. Maloney,
Richard A. Schwartz,
Matej Kuhar,
Frederic Schuller,
Valliappan Senthamizh Pavai,
Sophie Musset,
Daniel F. Ryan,
Lucia Kleint,
Michele Piana,
Anna Maria Massone,
Federico Benvenuto,
Janusz Sylwester
, et al. (12 additional authors not shown)
Abstract:
The Spectrometer/Telescope for Imaging X-rays (STIX) is the HXR instrument onboard Solar Orbiter designed to observe solar flares over a broad range of flare sizes, between 4-150 keV. We report the first STIX observations of microflares recorded during the instrument commissioning phase in order to investigate the STIX performance at its detection limit. This first result paper focuses on the temp…
▽ More
The Spectrometer/Telescope for Imaging X-rays (STIX) is the HXR instrument onboard Solar Orbiter designed to observe solar flares over a broad range of flare sizes, between 4-150 keV. We report the first STIX observations of microflares recorded during the instrument commissioning phase in order to investigate the STIX performance at its detection limit. This first result paper focuses on the temporal and spectral evolution of STIX microflares occuring in the AR12765 in June 2020, and compares the STIX measurements with GOES/XRS, SDO/AIA, and Hinode/XRT. For the observed microflares of the GOES A and B class, the STIX peak time at lowest energies is located in the impulsive phase of the flares, well before the GOES peak time. Such a behavior can either be explained by the higher sensitivity of STIX to higher temperatures compared to GOES, or due to the existence of a nonthermal component reaching down to low energies. The interpretation is inconclusive due to limited counting statistics for all but the largest flare in our sample. For this largest flare, the low-energy peak time is clearly due to thermal emission, and the nonthermal component seen at higher energies occurs even earlier. This suggests that the classic thermal explanation might also be favored for the majority of the smaller flares. In combination with EUV and SXR observations, STIX corroborates earlier findings that an isothermal assumption is of limited validity. Future diagnostic efforts should focus on multi-wavelength studies to derive differential emission measure distributions over a wide range of temperatures to accurately describe the energetics of solar flares. Commissioning observations confirm that STIX is working as designed. As a rule of thumb, STIX detects flares as small as the GOES A class. For flares above the GOES B class, detailed spectral and imaging analyses can be performed.
△ Less
Submitted 8 July, 2021; v1 submitted 18 June, 2021;
originally announced June 2021.
-
The Flare Likelihood and Region Eruption Forecasting (FLARECAST) Project: Flare forecasting in the big data & machine learning era
Authors:
M. K. Georgoulis,
D. S. Bloomfield,
M. Piana,
A. M. Massone,
M. Soldati,
P. T. Gallagher,
E. Pariat,
N. Vilmer,
E. Buchlin,
F. Baudin,
A. Csillaghy,
H. Sathiapal,
D. R. Jackson,
P. Alingery,
F. Benvenuto,
C. Campi,
K. Florios,
C. Gontikakis,
C. Guennou,
J. A. Guerra,
I. Kontogiannis,
V. Latorre,
S. A. Murray,
S. -H. Park,
S. von Stachelski
, et al. (3 additional authors not shown)
Abstract:
The EU funded the FLARECAST project, that ran from Jan 2015 until Feb 2018. FLARECAST had a R2O focus, and introduced several innovations into the discipline of solar flare forecasting. FLARECAST innovations were: first, the treatment of hundreds of physical properties viewed as promising flare predictors on equal footing, extending multiple previous works; second, the use of fourteen (14) differe…
▽ More
The EU funded the FLARECAST project, that ran from Jan 2015 until Feb 2018. FLARECAST had a R2O focus, and introduced several innovations into the discipline of solar flare forecasting. FLARECAST innovations were: first, the treatment of hundreds of physical properties viewed as promising flare predictors on equal footing, extending multiple previous works; second, the use of fourteen (14) different ML techniques, also on equal footing, to optimize the immense Big Data parameter space created by these many predictors; third, the establishment of a robust, three-pronged communication effort oriented toward policy makers, space-weather stakeholders and the wider public. FLARECAST pledged to make all its data, codes and infrastructure openly available worldwide. The combined use of 170+ properties (a total of 209 predictors are now available) in multiple ML algorithms, some of which were designed exclusively for the project, gave rise to changing sets of best-performing predictors for the forecasting of different flaring levels. At the same time, FLARECAST reaffirmed the importance of rigorous training and testing practices to avoid overly optimistic pre-operational prediction performance. In addition, the project has (a) tested new and revisited physically intuitive flare predictors and (b) provided meaningful clues toward the transition from flares to eruptive flares, namely, events associated with coronal mass ejections (CMEs). These leads, along with the FLARECAST data, algorithms and infrastructure, could help facilitate integrated space-weather forecasting efforts that take steps to avoid effort duplication. In spite of being one of the most intensive and systematic flare forecasting efforts to-date, FLARECAST has not managed to convincingly lift the barrier of stochasticity in solar flare occurrence and forecasting: solar flare prediction thus remains inherently probabilistic.
△ Less
Submitted 12 May, 2021;
originally announced May 2021.
-
Flare Forecasting Algorithms Based on High-Gradient Polarity Inversion Lines in Active Regions
Authors:
Domenico Cicogna,
Francesco Berrilli,
Daniele Calchetti,
Dario Del Moro,
Luca Giovannelli,
Federico Benvenuto,
Cristina Campi,
Sabrina Guastavino,
Michele Piana
Abstract:
Solar flares emanate from solar active regions hosting complex and strong bipolar magnetic fluxes. Estimating the probability of an active region to flare and defining reliable precursors of intense flares is an extremely challenging task in the space weather field. In this work, we focus on two metrics as flare precursors, the unsigned flux R, tested on MDI/SOHO data and one of the most used para…
▽ More
Solar flares emanate from solar active regions hosting complex and strong bipolar magnetic fluxes. Estimating the probability of an active region to flare and defining reliable precursors of intense flares is an extremely challenging task in the space weather field. In this work, we focus on two metrics as flare precursors, the unsigned flux R, tested on MDI/SOHO data and one of the most used parameters for flare forecasting applications, and a novel topological parameter D representing the complexity of a solar active region. More in detail, we propose an algorithm for the computation of the R value which exploits the higher spatial resolution of HMI maps. This algorithm leads to a differently computed R value, whose functionality is tested on a set of cycle 24th solar flares. Furthermore, we introduce a topological parameter based on the automatic recognition of magnetic polarity-inversion lines in identified active regions, and able to evaluate its magnetic topological complexity. We use both a heuristic approach and a supervised machine learning method to validate the effectiveness of these two descriptors to predict the occurrence of X- or M- class flares in a given solar active region during the following 24 hours period. Our feature ranking analysis shows that both parameters play a significant role in prediction performances. Moreover, the analysis demonstrates that the new topological parameter D is the only one, among 173 overall predictors, which is always present for all test subsets and is systematically ranked within the top-ten positions in all tests concerning the computation of the weighs with which each predictor impacts the flare forecasting.
△ Less
Submitted 3 May, 2021;
originally announced May 2021.
-
Machine learning as a flaring storm warning machine: Was a warning machine for the September 2017 solar flaring storm possible?
Authors:
Federico Benvenuto,
Cristina Campi,
Anna Maria Massone,
Michele Piana
Abstract:
Machine learning is nowadays the methodology of choice for flare forecasting and supervised techniques, in both their traditional and deep versions, are becoming the most frequently used ones for prediction in this area of space weather. Yet, machine learning has not been able so far to realize an operating warning system for flaring storms and the scientific literature of the last decade suggests…
▽ More
Machine learning is nowadays the methodology of choice for flare forecasting and supervised techniques, in both their traditional and deep versions, are becoming the most frequently used ones for prediction in this area of space weather. Yet, machine learning has not been able so far to realize an operating warning system for flaring storms and the scientific literature of the last decade suggests that its performances in the prediction of intense solar flares are not optimal.
The main difficulties related to forecasting solar flaring storms are probably two. First, most methods are conceived to provide probabilistic predictions and not to send binary yes/no indications on the consecutive occurrence of flares along an extended time range. Second, flaring storms are typically characterized by the explosion of high energy events, which are seldom recorded in the databases of space missions; as a consequence, supervised methods are trained on very imbalanced historical sets, which makes them particularly ineffective for the forecasting of intense flares.
Yet, in this study we show that supervised machine learning could be utilized in a way to send timely warnings about the most violent and most unexpected flaring event of the last decade, and even to predict with some accuracy the energy budget daily released by magnetic reconnection during the whole time course of the storm. Further, we show that the combination of sparsity-enhancing machine learning and feature ranking could allow the identification of the prominent role that energy played as an Active Region property in the forecasting process.
△ Less
Submitted 5 July, 2020;
originally announced July 2020.
-
MEM_GE: a new maximum entropy method for image reconstruction from solar X-ray visibilities
Authors:
Paolo Massa,
Richard Schwartz,
A Kim Tolbert,
Anna Maria Massone,
Brian R Dennis,
Michele Piana,
Federico Benvenuto
Abstract:
Maximum Entropy is an image reconstruction method conceived to image a sparsely occupied field of view and therefore particularly appropriate to achieve super-resolution effects. Although widely used in image deconvolution, this method has been formulated in radio astronomy for the analysis of observations in the spatial frequency domain, and an Interactive Data Language (IDL) code has been implem…
▽ More
Maximum Entropy is an image reconstruction method conceived to image a sparsely occupied field of view and therefore particularly appropriate to achieve super-resolution effects. Although widely used in image deconvolution, this method has been formulated in radio astronomy for the analysis of observations in the spatial frequency domain, and an Interactive Data Language (IDL) code has been implemented for image reconstruction from solar X-ray Fourier data. However, this code relies on a non-convex formulation of the constrained optimization problem addressed by the Maximum Entropy approach and this sometimes results in unreliable reconstructions characterized by unphysical shrinking effects.
This paper introduces a new approach to Maximum Entropy based on the constrained minimization of a convex functional. In the case of observations recorded by the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI), the resulting code provides the same super-resolution effects of the previous algorithm, while working properly also when that code produces unphysical reconstructions. Results are also provided of testing the algorithm with synthetic data simulating observations of the Spectrometer/Telescope for Imaging X-rays (STIX) in Solar Orbiter. The new code is available in the {\em{HESSI}} folder of the Solar SoftWare (SSW)tree.
△ Less
Submitted 18 February, 2020;
originally announced February 2020.
-
Feature ranking of active region source properties in solar flare forecasting and the uncompromised stochasticity of flare occurrence
Authors:
Cristina Campi,
Federico Benvenuto,
Anna Maria Massone,
D Shaun Bloomfield,
Manolis K Georgoulis,
Michele Piana
Abstract:
Solar flares originate from magnetically active regions but not all solar active regions give rise to a flare. Therefore, the challenge of solar flare prediction benefits by an intelligent computational analysis of physics-based properties extracted from active region observables, most commonly line-of-sight or vector magnetograms of the active-region photosphere. For the purpose of flare forecast…
▽ More
Solar flares originate from magnetically active regions but not all solar active regions give rise to a flare. Therefore, the challenge of solar flare prediction benefits by an intelligent computational analysis of physics-based properties extracted from active region observables, most commonly line-of-sight or vector magnetograms of the active-region photosphere. For the purpose of flare forecasting, this study utilizes an unprecedented 171 flare-predictive active region properties, mainly inferred by the Helioseismic and Magnetic Imager onboard the Solar Dynamics Observatory (SDO/HMI) in the course of the European Union Horizon 2020 FLARECAST project. Using two different supervised machine learning methods that allow feature ranking as a function of predictive capability, we show that: i) an objective training and testing process is paramount for the performance of every supervised machine learning method; ii) most properties include overlapping information and are therefore highly redundant for flare prediction; iii) solar flare prediction is still - and will likely remain - a predominantly probabilistic challenge.
△ Less
Submitted 19 August, 2019; v1 submitted 28 June, 2019;
originally announced June 2019.
-
Desaturating EUV observations of solar flaring storms
Authors:
Sabrina Guastavino,
Michele Piana,
Anna Maria Massone,
Richard Schwartz,
Federico Benvenuto
Abstract:
Image saturation has been an issue for several instruments in solar astronomy, mainly at EUV wavelengths. However, with the launch of the Atmospheric Imaging Assembly (AIA) as part of the payload of the Solar Dynamic Observatory (SDO) image saturation has become a big data issue, involving around 10^$ frames of the impressive dataset this beautiful telescope has been providing every year since Feb…
▽ More
Image saturation has been an issue for several instruments in solar astronomy, mainly at EUV wavelengths. However, with the launch of the Atmospheric Imaging Assembly (AIA) as part of the payload of the Solar Dynamic Observatory (SDO) image saturation has become a big data issue, involving around 10^$ frames of the impressive dataset this beautiful telescope has been providing every year since February 2010. This paper introduces a novel desaturation method, which is able to recover the signal in the saturated region of any AIA image by exploiting no other information but the one contained in the image itself. This peculiar methodological property, jointly with the unprecedented statistical reliability of the desaturated images, could make this algorithm the perfect tool for the realization of a reconstruction pipeline for AIA data, able to work properly even in the case of long-lasting, very energetic flaring events.
△ Less
Submitted 8 April, 2019;
originally announced April 2019.
-
A count-based imaging model for the Spectrometer/Telescope for Imaging X-rays (STIX) in Solar Orbiter
Authors:
Paolo Massa,
Michele Piana,
Anna Maria Massone,
Federico Benvenuto
Abstract:
The Spectrometer/Telescope for Imaging X-rays (STIX) will look at solar flares across the hard X-ray window provided by the Solar Orbiter cluster. Similarly to the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI), STIX is a visibility-based imaging instrument, which will ask for Fourier-based image reconstruction methods. However, in this paper we show that, as for RHESSI, also for ST…
▽ More
The Spectrometer/Telescope for Imaging X-rays (STIX) will look at solar flares across the hard X-ray window provided by the Solar Orbiter cluster. Similarly to the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI), STIX is a visibility-based imaging instrument, which will ask for Fourier-based image reconstruction methods. However, in this paper we show that, as for RHESSI, also for STIX count-based imaging is possible. Specifically, here we introduce and illustrate a mathematical model that mimics the STIX data formation process as a projection from the incoming photon flux into a vector made of 120 count components. Then we test the reliability of Expectation Maximization for image reconstruction in the case of several simulated configurations typical of flare morphology.
△ Less
Submitted 20 February, 2019;
originally announced February 2019.
-
Flare forecasting and feature ranking using SDO/HMI data
Authors:
Michele Piana,
Cristina Campi,
Federico Benvenuto,
Sabrina Guastavano,
Anna Maria Massone
Abstract:
We describe here the application of a machine learning method for flare forecasting using vectors of properties extracted from images provided by the Helioseismic and Magnetic Imager in the Solar Dynamics Observatory (SDO/HMI). We also discuss how the method can be used to quantitatively assess the impact of such properties on the prediction process.
We describe here the application of a machine learning method for flare forecasting using vectors of properties extracted from images provided by the Helioseismic and Magnetic Imager in the Solar Dynamics Observatory (SDO/HMI). We also discuss how the method can be used to quantitatively assess the impact of such properties on the prediction process.
△ Less
Submitted 18 December, 2018;
originally announced December 2018.
-
FLARECAST: an I4.0 technology for space weather using satellite data
Authors:
Michele Piana,
Anna Maria Massone,
Federico Benvenuto,
Cristina Campi
Abstract:
'Flare Likelihood and Region Eruption Forecasting (FLARECAST)' is a Horizon 2020 project, which realized a technological platform for machine learning algorithms, with the objective of providing the space weather community with a prediction service for solar flares. This paper describes the FLARECAST service and shows how the methods implemented in the platform allow both flare prediction and a qu…
▽ More
'Flare Likelihood and Region Eruption Forecasting (FLARECAST)' is a Horizon 2020 project, which realized a technological platform for machine learning algorithms, with the objective of providing the space weather community with a prediction service for solar flares. This paper describes the FLARECAST service and shows how the methods implemented in the platform allow both flare prediction and a quantitative assessment of how the information contained in the space data utilized in the analysis may impact the forecasting process.
△ Less
Submitted 22 June, 2018;
originally announced June 2018.
-
Forecasting Solar Flares Using Magnetogram-based Predictors and Machine Learning
Authors:
Kostas Florios,
Ioannis Kontogiannis,
Sung-Hong Park,
Jordan A. Guerra,
Federico Benvenuto,
D. Shaun Bloomfield,
Manolis K. Georgoulis
Abstract:
We propose a forecasting approach for solar flares based on data from Solar Cycle 24, taken by the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO) mission. In particular, we use the Space-weather HMI Active Region Patches (SHARP) product that facilitates cut-out magnetograms of solar active regions (AR) in the Sun in near-real-time (NRT), taken over a five-year…
▽ More
We propose a forecasting approach for solar flares based on data from Solar Cycle 24, taken by the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO) mission. In particular, we use the Space-weather HMI Active Region Patches (SHARP) product that facilitates cut-out magnetograms of solar active regions (AR) in the Sun in near-real-time (NRT), taken over a five-year interval (2012 - 2016). Our approach utilizes a set of thirteen predictors, which are not included in the SHARP metadata, extracted from line-of-sight and vector photospheric magnetograms. We exploit several Machine Learning (ML) and Conventional Statistics techniques to predict flares of peak magnitude >M1 and >C1, within a 24 h forecast window. The ML methods used are multi-layer perceptrons (MLP), support vector machines (SVM) and random forests (RF). We conclude that random forests could be the prediction technique of choice for our sample, with the second best method being multi-layer perceptrons, subject to an entropy objective function. A Monte Carlo simulation showed that the best performing method gives accuracy ACC=0.93(0.00), true skill statistic TSS=0.74(0.02) and Heidke skill score HSS=0.49(0.01) for >M1 flare prediction with probability threshold 15% and ACC=0.84(0.00), TSS=0.60(0.01) and HSS=0.59(0.01) for >C1 flare prediction with probability threshold 35%.
△ Less
Submitted 17 January, 2018;
originally announced January 2018.
-
A hybrid supervised/unsupervised machine learning approach to solar flare prediction
Authors:
Federico Benvenuto,
Michele Piana,
Cristina Campi,
Anna Maria Massone
Abstract:
We introduce a hybrid approach to solar flare prediction, whereby a supervised regularization method is used to realize feature importance and an unsupervised clustering method is used to realize the binary flare/no-flare decision. The approach is validated against NOAA SWPC data.
We introduce a hybrid approach to solar flare prediction, whereby a supervised regularization method is used to realize feature importance and an unsupervised clustering method is used to realize the binary flare/no-flare decision. The approach is validated against NOAA SWPC data.
△ Less
Submitted 21 June, 2017;
originally announced June 2017.
-
Inverse diffraction for the Atmospheric Imaging Assembly in the Solar Dynamics Observatory
Authors:
Gabriele Torre,
Richard A Schwartz,
Federico Benvenuto,
Anna Maria Massone,
Michele Piana
Abstract:
The Atmospheric Imaging Assembly in the Solar Dynamics Observatory provides full Sun images every 1 seconds in each of 7 Extreme Ultraviolet passbands. However, for a significant amount of these images, saturation affects their most intense core, preventing scientists from a full exploitation of their physical meaning. In this paper we describe a mathematical and automatic procedure for the recove…
▽ More
The Atmospheric Imaging Assembly in the Solar Dynamics Observatory provides full Sun images every 1 seconds in each of 7 Extreme Ultraviolet passbands. However, for a significant amount of these images, saturation affects their most intense core, preventing scientists from a full exploitation of their physical meaning. In this paper we describe a mathematical and automatic procedure for the recovery of information in the primary saturation region based on a correlation/inversion analysis of the diffraction pattern associated to the telescope observations. Further, we suggest an interpolation-based method for determining the image background that allows the recovery of information also in the region of secondary saturation (blooming).
△ Less
Submitted 30 January, 2015;
originally announced January 2015.
-
Expectation Maximization for Hard X-ray Count Modulation Profiles
Authors:
Federico Benvenuto,
Richard Schwartz,
Michele Piana,
Anna Maria Massone
Abstract:
This paper is concerned with the image reconstruction problem when the measured data are solar hard X-ray modulation profiles obtained from the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI)} instrument. Our goal is to demonstrate that a statistical iterative method classically applied to the image deconvolution problem is very effective when utilized for the analysis of count modul…
▽ More
This paper is concerned with the image reconstruction problem when the measured data are solar hard X-ray modulation profiles obtained from the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI)} instrument. Our goal is to demonstrate that a statistical iterative method classically applied to the image deconvolution problem is very effective when utilized for the analysis of count modulation profiles in solar hard X-ray imaging based on Rotating Modulation Collimators. The algorithm described in this paper solves the maximum likelihood problem iteratively and encoding a positivity constraint into the iterative optimization scheme. The result is therefore a classical Expectation Maximization method this time applied not to an image deconvolution problem but to image reconstruction from count modulation profiles. The technical reason that makes our implementation particularly effective in this application is the use of a very reliable stopping rule which is able to regularize the solution providing, at the same time, a very satisfactory Cash-statistic (C-statistic). The method is applied to both reproduce synthetic flaring configurations and reconstruct images from experimental data corresponding to three real events. In this second case, the performance of Expectation Maximization, when compared to Pixon image reconstruction, shows a comparable accuracy and a notably reduced computational burden; when compared to CLEAN, shows a better fidelity with respect to the measurements with a comparable computational effectiveness. If optimally stopped, Expectation Maximization represents a very reliable method for image reconstruction in the RHESSI context when count modulation profiles are used as input data.
△ Less
Submitted 20 February, 2013;
originally announced February 2013.
-
Regularization of constrained maximum likelihood iterative algorithms by means of statistical stopping rule
Authors:
Federico Benvenuto,
Michele Piana
Abstract:
In this paper we propose a new statistical stopping rule for constrained maximum likelihood iterative algorithms applied to ill-posed inverse problems. To this aim we extend the definition of Tikhonov regularization in a statistical framework and prove that the application of the proposed stopping rule to the Iterative Space Reconstruction Algorithm (ISRA) in the Gaussian case and Expectation Maxi…
▽ More
In this paper we propose a new statistical stopping rule for constrained maximum likelihood iterative algorithms applied to ill-posed inverse problems. To this aim we extend the definition of Tikhonov regularization in a statistical framework and prove that the application of the proposed stopping rule to the Iterative Space Reconstruction Algorithm (ISRA) in the Gaussian case and Expectation Maximization (EM) in the Poisson case leads to well defined regularization methods according to the given definition. We also prove that, if an inverse problem is genuinely ill-posed in the sense of Tikhonov, the same definition is not satisfied when ISRA and EM are optimized by classical stopping rule like Morozov's discrepancy principle, Pearson's test and Poisson discrepancy principle. The stopping rule is illustrated in the case of image reconstruction from data recorded by the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI). First, by using a simulated image consisting of structures analogous to those of a real solar flare we validate the fidelity and accuracy with which the proposed stopping rule recovers the input image. Second, the robustness of the method is compared with the other classical stopping rules and its advantages are shown in the case of real data recorded by RHESSI during two different flaring events.
△ Less
Submitted 13 December, 2012;
originally announced December 2012.
-
Determination of the Acceleration Region Size in a Loop-structured Solar Flare
Authors:
Jingnan Guo,
A. Gordon Emslie,
Eduard P. Kontar,
Federico Benvenuto,
Anna Maria Massone,
Michele Piana
Abstract:
In order to study the acceleration and propagation of bremsstrahlung-producing electrons in solar flares, we analyze the evolution of the flare loop size with respect to energy at a variety of times. A GOES M3.7 loop-structured flare starting around 23:55 on 2002 April 14 is studied in detail using \textit{Ramaty High Energy Solar Spectroscopic Imager} (\textit{RHESSI}) observations. We construct…
▽ More
In order to study the acceleration and propagation of bremsstrahlung-producing electrons in solar flares, we analyze the evolution of the flare loop size with respect to energy at a variety of times. A GOES M3.7 loop-structured flare starting around 23:55 on 2002 April 14 is studied in detail using \textit{Ramaty High Energy Solar Spectroscopic Imager} (\textit{RHESSI}) observations. We construct photon and mean-electron-flux maps in 2-keV energy bins by processing observationally-deduced photon and electron visibilities, respectively, through several image-processing methods: a visibility-based forward-fit (FWD) algorithm, a maximum entropy (MEM) procedure and the uv-smooth (UVS) approach. We estimate the sizes of elongated flares (i.e., the length and width of flaring loops) by calculating the second normalized moments of the intensity in any given map. Employing a collisional model with an extended acceleration region, we fit the loop lengths as a function of energy in both the photon and electron domains. The resulting fitting parameters allow us to estimate the extent of the acceleration region which is between $\sim 13 \rm{arcsec}$ and $\sim 19 \rm{arcsec}$. Both forward-fit and uv-smooth algorithms provide substantially similar results with a systematically better fit in the electron domain.The consistency of the estimates from these methods provides strong support that the model can reliably determine geometric parameters of the acceleration region. The acceleration region is estimated to be a substantial fraction ($\sim 1/2$) of the loop extent, indicating that this dense flaring loop incorporates both acceleration and transport of electrons, with concurrent thick-target bremsstrahlung emission.
△ Less
Submitted 3 June, 2012;
originally announced June 2012.
