-
A catalogue of observed geo-effective CME/ICME characteristics
Authors:
R. Mugatwala,
S. Chierichini,
G. Francisco,
G. Napoletano,
R. Foldes,
L. Giovannelli,
G. De Gasperis,
E. Camporeale,
R. Erdélyi,
D. Del Moro
Abstract:
One of the goals of Space Weather studies is to achieve a better understanding of impulsive phenomena, such as Coronal Mass Ejections (CMEs), in order to improve our ability to forecast them and mitigate the risk to our technologically driven society. The essential part of achieving this goal is to assess the performance of forecasting models. To this end, the quality and availability of suitable…
▽ More
One of the goals of Space Weather studies is to achieve a better understanding of impulsive phenomena, such as Coronal Mass Ejections (CMEs), in order to improve our ability to forecast them and mitigate the risk to our technologically driven society. The essential part of achieving this goal is to assess the performance of forecasting models. To this end, the quality and availability of suitable data are of paramount importance. In this work, we have merged already publicly available data of CMEs from both in-situ and remote instrumentation in order to build a database of CME properties. To evaluate the accuracy of such a database and confirm the relationship between in-situ and remote observations, we have employed the drag-based model (DBM) due to its simplicity and inexpensive cost of computational resources. In this study, we have also explored the parameter space for the drag parameter and solar wind speed using a Monte Carlo approach to evaluate how well the DBM determines the propagation of CMEs for the events in the dataset. The dataset of geoeffective CMEs constructed as a result of this work provides validation of the initial hypothesis about DBM, and solar wind speed and also yields further insight into CME features like arrival time, arrival speed, lift-off time, etc. Using a data-driven approach, this procedure allows us to present a homogeneous, reliable, and robust dataset for the investigation of CME propagation. On the other hand, possible CME events are identified where DBM approximation is not valid due to model limitations and higher uncertainties in the input parameters, those events require more thorough investigation.
△ Less
Submitted 22 November, 2023;
originally announced November 2023.
-
Heliophysics Discovery Tools for the 21st Century: Data Science and Machine Learning Structures and Recommendations for 2020-2050
Authors:
R. M. McGranaghan,
B. Thompson,
E. Camporeale,
J. Bortnik,
M. Bobra,
G. Lapenta,
S. Wing,
B. Poduval,
S. Lotz,
S. Murray,
M. Kirk,
T. Y. Chen,
H. M. Bain,
P. Riley,
B. Tremblay,
M. Cheung,
V. Delouille
Abstract:
Three main points: 1. Data Science (DS) will be increasingly important to heliophysics; 2. Methods of heliophysics science discovery will continually evolve, requiring the use of learning technologies [e.g., machine learning (ML)] that are applied rigorously and that are capable of supporting discovery; and 3. To grow with the pace of data, technology, and workforce changes, heliophysics requires…
▽ More
Three main points: 1. Data Science (DS) will be increasingly important to heliophysics; 2. Methods of heliophysics science discovery will continually evolve, requiring the use of learning technologies [e.g., machine learning (ML)] that are applied rigorously and that are capable of supporting discovery; and 3. To grow with the pace of data, technology, and workforce changes, heliophysics requires a new approach to the representation of knowledge.
△ Less
Submitted 26 December, 2022;
originally announced December 2022.
-
Probabilistic prediction of Dst storms one-day-ahead using Full-Disk SoHO Images
Authors:
A. Hu,
C. Shneider,
A. Tiwari,
E. Camporeale
Abstract:
We present a new model for the probability that the Disturbance storm time (Dst) index exceeds -100 nT, with a lead time between 1 and 3 days. $Dst$ provides essential information about the strength of the ring current around the Earth caused by the protons and electrons from the solar wind, and it is routinely used as a proxy for geomagnetic storms. The model is developed using an ensemble of Con…
▽ More
We present a new model for the probability that the Disturbance storm time (Dst) index exceeds -100 nT, with a lead time between 1 and 3 days. $Dst$ provides essential information about the strength of the ring current around the Earth caused by the protons and electrons from the solar wind, and it is routinely used as a proxy for geomagnetic storms. The model is developed using an ensemble of Convolutional Neural Networks (CNNs) that are trained using SoHO images (MDI, EIT and LASCO). The relationship between the SoHO images and the solar wind has been investigated by many researchers, but these studies have not explicitly considered using SoHO images to predict the $Dst$ index.
This work presents a novel methodology to train the individual models and to learn the optimal ensemble weights iteratively, by using a customized class-balanced mean square error (CB-MSE) loss function tied to a least-squares (LS) based ensemble.
The proposed model can predict the probability that Dst<-100 nT 24 hours ahead with a True Skill Statistic (TSS) of 0.62 and Matthews Correlation Coefficient (MCC) of 0.37. The weighted TSS and MCC from Guastavino et al. (2021) is 0.68 and 0.47, respectively. An additional validation during non-Earth-directed CME periods is also conducted which yields a good TSS and MCC score.
△ Less
Submitted 29 March, 2022; v1 submitted 21 March, 2022;
originally announced March 2022.
-
Parameter Distributions for the Drag-Based Modeling of CME Propagation
Authors:
Gianluca Napoletano,
Raffaello Foldes,
Enrico Camporeale,
Giancarlo de Gasperis,
Luca Giovannelli,
Evangelos Paouris,
Ermanno Pietropaolo,
Jannis Teunissen,
Ajay Kumar Tiwari,
Dario Del Moro
Abstract:
In recent years, ensemble modeling has been widely employed in space weather to estimate uncertainties in forecasts. We here focus on the ensemble modeling of CME arrival times and arrival velocities using a drag-based model, which is well-suited for this purpose due to its simplicity and low computational cost. Although ensemble techniques have previously been applied to the drag-based model, it…
▽ More
In recent years, ensemble modeling has been widely employed in space weather to estimate uncertainties in forecasts. We here focus on the ensemble modeling of CME arrival times and arrival velocities using a drag-based model, which is well-suited for this purpose due to its simplicity and low computational cost. Although ensemble techniques have previously been applied to the drag-based model, it is still not clear how to best determine distributions for its input parameters, namely the drag parameter and the solar wind speed. The aim of this work is to evaluate statistical distributions for these model parameters starting from a list of past CME-ICME events. We employ LASCO coronagraph observations to measure initial CME position and speed, and in situ data to associate them with an arrival date and arrival speed. For each event we ran a statistical procedure to invert the model equations, producing parameters distributions as output. Our results indicate that the distributions employed in previous works were appropriately selected, even though they were based on restricted samples and heuristic considerations. On the other hand, possible refinements to the current method are also identified, such as the dependence of the drag parameter distribution on the CME being accelerated or decelerated by the solar wind, which deserve further investigation.
△ Less
Submitted 28 January, 2022;
originally announced January 2022.
-
A Machine-Learning-Ready Dataset Prepared from the Solar and Heliospheric Observatory Mission
Authors:
Carl Shneider,
Andong Hu,
Ajay K. Tiwari,
Monica G. Bobra,
Karl Battams,
Jannis Teunissen,
Enrico Camporeale
Abstract:
We present a Python tool to generate a standard dataset from solar images that allows for user-defined selection criteria and a range of pre-processing steps. Our Python tool works with all image products from both the Solar and Heliospheric Observatory (SoHO) and Solar Dynamics Observatory (SDO) missions. We discuss a dataset produced from the SoHO mission's multi-spectral images which is free of…
▽ More
We present a Python tool to generate a standard dataset from solar images that allows for user-defined selection criteria and a range of pre-processing steps. Our Python tool works with all image products from both the Solar and Heliospheric Observatory (SoHO) and Solar Dynamics Observatory (SDO) missions. We discuss a dataset produced from the SoHO mission's multi-spectral images which is free of missing or corrupt data as well as planetary transits in coronagraph images, and is temporally synced making it ready for input to a machine learning system. Machine-learning-ready images are a valuable resource for the community because they can be used, for example, for forecasting space weather parameters. We illustrate the use of this data with a 3-5 day-ahead forecast of the north-south component of the interplanetary magnetic field (IMF) observed at Lagrange point one (L1). For this use case, we apply a deep convolutional neural network (CNN) to a subset of the full SoHO dataset and compare with baseline results from a Gaussian Naive Bayes classifier.
△ Less
Submitted 4 August, 2021;
originally announced August 2021.
-
Identifying magnetic reconnection in 2D Hybrid Vlasov Maxwell simulations with Convolutional Neural Networks
Authors:
A. Hu,
M. Sisti,
F. Finelli,
F. Califano,
J. Dargent,
M. Faganello,
E. Camporeale,
J. Teunissen
Abstract:
Magnetic reconnection is a fundamental process that quickly releases magnetic energy stored in a plasma.Identifying, from simulation outputs, where reconnection is taking place is non-trivial and, in general, has to be performed by human experts. Hence, it would be valuable if such an identification process could be automated. Here, we demonstrate that a machine learning algorithm can help to iden…
▽ More
Magnetic reconnection is a fundamental process that quickly releases magnetic energy stored in a plasma.Identifying, from simulation outputs, where reconnection is taking place is non-trivial and, in general, has to be performed by human experts. Hence, it would be valuable if such an identification process could be automated. Here, we demonstrate that a machine learning algorithm can help to identify reconnection in 2D simulations of collisionless plasma turbulence. Using a Hybrid Vlasov Maxwell (HVM) model, a data set containing over 2000 potential reconnection events was generated and subsequently labeled by human experts. We test and compare two machine learning approaches with different configurations on this data set. The best results are obtained with a convolutional neural network (CNN) combined with an 'image cropping' step that zooms in on potential reconnection sites. With this method, more than 70% of reconnection events can be identified correctly. The importance of different physical variables is evaluated by studying how they affect the accuracy of predictions. Finally, we also discuss various possible causes for wrong predictions from the proposed model.
△ Less
Submitted 21 August, 2020;
originally announced August 2020.
-
Machine Learning in Heliophysics and Space Weather Forecasting: A White Paper of Findings and Recommendations
Authors:
Gelu Nita,
Manolis Georgoulis,
Irina Kitiashvili,
Viacheslav Sadykov,
Enrico Camporeale,
Alexander Kosovichev,
Haimin Wang,
Vincent Oria,
Jason Wang,
Rafal Angryk,
Berkay Aydin,
Azim Ahmadzadeh,
Xiaoli Bai,
Timothy Bastian,
Soukaina Filali Boubrahimi,
Bin Chen,
Alisdair Davey,
Sheldon Fereira,
Gregory Fleishman,
Dale Gary,
Andrew Gerrard,
Gregory Hellbourg,
Katherine Herbert,
Jack Ireland,
Egor Illarionov
, et al. (16 additional authors not shown)
Abstract:
The authors of this white paper met on 16-17 January 2020 at the New Jersey Institute of Technology, Newark, NJ, for a 2-day workshop that brought together a group of heliophysicists, data providers, expert modelers, and computer/data scientists. Their objective was to discuss critical developments and prospects of the application of machine and/or deep learning techniques for data analysis, model…
▽ More
The authors of this white paper met on 16-17 January 2020 at the New Jersey Institute of Technology, Newark, NJ, for a 2-day workshop that brought together a group of heliophysicists, data providers, expert modelers, and computer/data scientists. Their objective was to discuss critical developments and prospects of the application of machine and/or deep learning techniques for data analysis, modeling and forecasting in Heliophysics, and to shape a strategy for further developments in the field. The workshop combined a set of plenary sessions featuring invited introductory talks interleaved with a set of open discussion sessions. The outcome of the discussion is encapsulated in this white paper that also features a top-level list of recommendations agreed by participants.
△ Less
Submitted 22 June, 2020;
originally announced June 2020.
-
ViDA: a Vlasov-DArwin solver for plasma physics at electron scales
Authors:
Oreste Pezzi,
Giulia Cozzani,
Francesco Califano,
Francesco Valentini,
Massimiliano Guarrasi,
Enrico Camporeale,
Gianfranco Brunetti,
Alessandro Retinò,
Pierluigi Veltri
Abstract:
We present a Vlasov-DArwin numerical code (ViDA) specifically designed to address plasma physics problems, where small-scale high accuracy is requested even during the non linear regime to guarantee a clean description of the plasma dynamics at fine spatial scales. The algorithm provides a low-noise description of proton and electron kinetic dynamics, by splitting in time the multi-advection Vlaso…
▽ More
We present a Vlasov-DArwin numerical code (ViDA) specifically designed to address plasma physics problems, where small-scale high accuracy is requested even during the non linear regime to guarantee a clean description of the plasma dynamics at fine spatial scales. The algorithm provides a low-noise description of proton and electron kinetic dynamics, by splitting in time the multi-advection Vlasov equation in phase space. Maxwell equations for the electric and magnetic fields are reorganized according to Darwin approximation to remove light waves. Several numerical tests show that ViDA successfully reproduces the propagation of linear and nonlinear waves and captures the physics of magnetic reconnection. We also discuss preliminary tests of the parallelization algorithm efficiency, performed at CINECA on the Marconi-KNL cluster. ViDA will allow to run Eulerian simulations of a non-relativistic fully-kinetic collisionless plasma and it is expected to provide relevant insights on important problems of plasma astrophysics such as, for instance, the development of the turbulent cascade at electron scales and the structure and dynamics of electron-scale magnetic reconnection, such as the electron diffusion region.
△ Less
Submitted 24 October, 2019; v1 submitted 8 May, 2019;
originally announced May 2019.
-
Electron temperature anisotropy in an expanding plasma: Particle-in-Cell simulations
Authors:
Enrico Camporeale,
David Burgess
Abstract:
We perform fully-kinetic particle-in-cell simulations of an hot plasma that expands radially in a cylindrical geometry. The aim of the paper is to study the consequent development of the electron temperature anisotropy in an expanding plasma flow as found in a collisionless stellar wind. Kinetic plasma theory and simulations have shown that the electron temperature anisotropy is controlled by fl…
▽ More
We perform fully-kinetic particle-in-cell simulations of an hot plasma that expands radially in a cylindrical geometry. The aim of the paper is to study the consequent development of the electron temperature anisotropy in an expanding plasma flow as found in a collisionless stellar wind. Kinetic plasma theory and simulations have shown that the electron temperature anisotropy is controlled by fluctuations driven by electromagnetic kinetic instabilities. In this study the temperature anisotropy is driven self-consistently by the expansion. While the expansion favors an increase of parallel anisotropy ($T_\parallel>T_\perp$), the onset of the firehose instability will tend to decrease it. We show the results for a supersonic, subsonic, and static expansion flows, and suggest possible applications of the results for the solar wind and other stellar winds.
△ Less
Submitted 11 February, 2010;
originally announced February 2010.