Abstract
We generate reconstructions of signed open solar flux (OSF) for the past 154 years using observations of geomagnetic activity. Previous reconstructions have been limited to annual resolution, but this is here increased by a factor of more than 13 by using averages over Carrington rotation (CR) intervals. We use two indices of geomagnetic activity, the homogeneous aa index, aaH, and the IDV(1d) index; a combination of the two is fitted to OSF estimates from near-Earth interplanetary satellite data. For 1995 – 2022, these are corrected for excess flux (i.e. orthogardenhose flux and switchbacks) using strahl electrons. For 1970 – 2022, we also use the absolute values of the radial component of the near-Earth interplanetary magnetic field \({\langle }|{\langle }B_{r}{\rangle }_{\tau }|{\rangle }_{CR}\), where the excess flux is allowed for by adopting the optimum averaging interval \({\tau }\) of 20 h. However, in the interval 1970 – 1995, data gaps in the interplanetary data are a serious problem. The errors that these missing data cause in CR averages of OSF are evaluated by synthetically masking data for CRs that have a full complement, using the same number and time series of data gaps as for the CR in question. Given the potential for missing data to generate large errors, we use the near-continuous 1995 – 2022 data to derive the best-fit combination of the geomagnetic data and employ the 1970 – 1995 data for testing in which we can readily allow for the errors caused by data gaps. Errors caused by inaccuracies in the geomagnetic data are shown to be considerably smaller than the uncertainties due to the polynomial fitting. It is shown that the new reconstructions are consistent with the previous annual estimates and that there is considerable variability in the OSF values from one CR to the next; in particular, in high-activity solar cycles, there can be individual CRs in which the OSF exceeds that for adjacent CRs by a factor as large as two.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
1.1 Periodicities Caused by Solar Rotation
Sunspots around the solar equator have a sidereal rotation period (with respect to the fixed stars) of about 24.47 days, which gives an average synodic rotation period (as seen from Earth) of near 26.25 days, whereas for sunspots at heliographic latitude \({\Lambda}_{H} = {\pm}45^{\circ}\), the synodic period is roughly 28.9 days (Ruždjak et al., 2017; Permata and Herdiwijaya, 2019). The rotation periods of the solar corona are harder to measure accurately but also show differential rotation, but to a lesser degree than the photosphere (Mancuso et al., 2020; Morgan, 2011). In the lower corona, at heliocentric distances \(r\) of \(1.7R_{\odot}\) (where \(R_{\odot} = 6.96{\times}10^{8}\) m is the mean radius of the photosphere), the synodic period is about 27.3 days at \({\Lambda}_{H} = 0^{\circ}\) and peaks at about 27.7 days at \({\pm}25^{\circ}\) before declining again at greater \({\Lambda}_{H}\) (Mancuso et al., 2020). In the higher corona, at \(r=4R_{\odot}\), differential rotation is reduced compared to the lower corona, but variability and measurement uncertainty are high (Morgan, 2011).
The Carrington rotation (CR) system is based on assigning a sidereal rotation period of 25.38 days, which is the rotation period for sunspots near \({\Lambda}_{H} = {\pm}26^{\circ}\) and of the equatorial corona at \(|{\Lambda}_{H}|\) below about \(13^{\circ}\). The corresponding synodic period of a CR varies slightly during the year because of the changing speed of the Earth in its orbit, but averages 27.2753 days (654.6072 h). There is a subtle effect discussed in Section A.3 of the Appendix to the present article, which investigates the different periodicities introduced into parameters in near-Earth interplanetary space and into geomagnetic activity measures by the rotation of the Earth. The periodicity in interplanetary parameters related to the magnetic field sector structure, or to the longitudinal equatorial coronal hole distribution, are shown to be extremely close to (but very slightly shorter than) the synodic CR interval. However, it is shown that the Universal Time variation in solar wind-magnetosphere coupling (generated by the eccentric nature of Earth’s main dipole magnetic field and the rotation of the Earth) makes the peak periodicity of the geomagnetic data a whole number of days. This explains why Bartels, and subsequent geophysicists, have found 27-day intervals most useful for the study of geomagnetic activity whereas Carrington, and subsequent solar physicists, have found 27.2753-day intervals most useful to study solar effects. We here want to average out any longitudinal structure in the coronal and heliospheric magnetic fields and so need to average over integer numbers of whole CR intervals.
1.2 Open Solar Flux
The open solar flux (OSF) is the magnetic flux that threads the “coronal source surface” near the top of the corona, often taken to be a heliocentric sphere at \(r = 2.5\mathrm{R}_{\odot}\) (Arge and Pizzo, 2000), and so the OSF is the flux that leaves the corona and enters the heliosphere. The OSF is often thought of as largely originating in coronal holes (e.g. Mackay and Yeates, 2012; Priest, 2014), which can be seen as regions of relatively low EUV and X-ray emission (Zirker, 1977; Cranmer, 2009). However, computation of the OSF from the integrated magnetic flux threading coronal holes detected this way (Lowder et al., 2014; Lowder, Qiu, and Leamon, 2017) leads to OSF estimates that are smaller than those derived from other methods by a factor close to 2 (Linker et al., 2017; Wallace et al., 2019), probably because of open flux embedded in the streamer belt that is not detected as dark in the EUV or X-ray emissions. Those other methods have included: potential field source surface (PFSS) modelling of coronal fields from photospheric field measurements (Altschuler and Newkirk, 1969; Schatten, Wilcox, and Ness, 1969; Wang and Sheeley, 1992); developments of the PFSS modelling such as current sheet source surface (CSSS) modelling (Koskela, Virtanen, and Mursula, 2019); non-potential modelling using magnetic flux transport and magneto-frictional simulations, which can also allow for currents below the coronal source surface (Yeates et al., 2010); MHD simulations based on photospheric field observations (Riley, Linker, and Mikić, 2001; Riley et al., 2011); interplanetary and geomagnetic observations (discussed below); and, at sunspot minimum (when polar coronal holes dominate), polar faculae and streamer belt width (Muñoz-Jaramillo et al., 2012; Lockwood et al., 2022b).
The OSF was first quantified from geomagnetic activity observations by Lockwood, Stamper, and Wild (1999) in a reconstruction of annual means that extended back to 1868. Subsequently, improvements have been made both to the historic geomagnetic data and to the reconstruction method (including allowance for the excess flux: see below) (Lockwood, 2003, 2013; Rouillard, Lockwood, and Finch, 2007; Lockwood and Owens, 2011, 2014; Lockwood, Rouillard, and Finch, 2009; Lockwood et al., 2014b; Lockwood, Owens, and Barnard, 2014; Lockwood et al., 2017a, 2022a). These improvements included expansion of the reconstructions to other interplanetary parameters such as the near-Earth solar wind speed, \(V_{\normalfont{\mathrm{sw}}}\), the near-Earth heliospheric magnetic field (the interplanetary magnetic field, IMF, \(B\)), the latitudinal width of the streamer belt (Lockwood and Owens, 2014; Owens, Lockwood, and Riley, 2017), and the solar wind power input to the magnetosphere (Lockwood et al., 2017b). Other geomagnetic data were also employed to extend reconstructions back in time to 1844. However, all this work has used annual means to average out a variety of annual effects and to reduce observation and polynomial fitting noise. The present paper increases the time resolution by generating reconstructions of Carrington rotation resolution.
A key fact that allows these reconstructions is that the plasma \(\beta\) is low close to the Sun. Hence the tangential plasma pressure is much smaller than the tangential magnetic pressure, \(B_{r}^{2}/(2{\mu}_{o})\), where \(B_{r}\) is the radial field. This means slight deviations from the radial flow of the solar wind plasma (and its frozen-in heliospheric magnetic field) in the innermost heliosphere equalise the tangential pressure and hence give \(|B_{r}|\) that is close to being independent of heliographic latitude (Suess and Smith, 1996; Suess et al., 1996, 1998). The plasma \(\beta\) increases with increasing radial distance, but this near-constant \(|B_{r}|\) is “frozen-in” and carried out into the heliosphere. This was confirmed to be the case by the perihelion fast-latitude passes by the Ulysses spacecraft (Smith and Balogh, 1995; Smith et al., 2001, 2003; Lockwood et al., 2004; Lockwood and Owens, 2009). This means that we can compute the total signed (of “towards” or “away” polarity) heliospheric magnetic flux threading a spherical surface at heliocentric distance of an astronomical unit \(r = R_{AU}\) from the formula
where the averaging interval is a whole number of Carrington rotations, which would average out any longitudinal structure, and \(B_{r}\) is a high time-resolution measurement of the radial component of the IMF. Note the factor 2. This arises because \(F_{AU}\) is here defined as the signed flux: this factor would be 4 for the unsigned flux (i.e. of either polarity). To compute the (signed) flux threading the solar source surface at the top of the solar corona, we need to subtract from \(F_{AU}\) the “excess” signed flux \({\Delta}F\) (Lockwood, Owens, and Rouillard, 2009a,b; Lockwood and Owens, 2013; Owens et al., 2017):
This excess flux \({\Delta}F\) arises because a magnetic flux tube the threads the solar source surface at \(r=2.5R_{\odot}\) and then the spherical surface at \(r=R_{AU}\) can bend back toward the Sun and thread the surface at \(r=R_{AU}\) again, before bending back again to thread that surface for a third time. Hence such a flux tube of magnetic flux \(f_{T}\) contributes a total of \(3f_{T}\) to the unsigned flux at \(r=R_{AU}\), but only \(f_{T}\) to the unsigned flux at the source surface. Hence it contributes \(2f_{T}\) to the unsigned excess flux and \(f_{T}\) to the signed excess flux \({\Delta}F\). There are two main causes of this excess flux. The first is orthogardenhose heliospheric field where the large-scale structure in the heliosphere (for example, distortions to the Parker spiral configuration caused by draping of the field around coronal mass ejections (CMEs)) bends through of order 45∘ – 135∘ to re-thread the surface at \(r= R_{AU}\) as orthogardenhose flux before threading it a third time to reach \(r > R_{AU}\) (Lockwood, Owens, and Macneil, 2019). Secondly, there is what Lockwood, Owens, and Rouillard (2009b) termed “folded flux” and Owens, Crooker, and Lockwood (2013) termed “inverted flux”, and which since the advent of Parker Solar Probe observations is often called “switchbacks” (Bale et al., 2019; Jagarlamudi et al., 2023); in those the flux tube is bent back towards the Sun through of order 180∘. Before the Parker Solar Probe mission, such structures were seen in data from several spacecraft, such as International Sun-Earth Explorer-3 (ISEE-3) (Kahler, Crooker, and Gosling, 1996), Ulysses (Neugebauer et al., 1995; Balogh et al., 1999), Advance Composition Explorer (ACE) and Wind (Borovsky, 2016) and Helios (Horbury, Matteini, and Stansby, 2018; Macneil et al., 2020, 2021). Using data from the Helios spacecraft, Macneil et al. (2020) showed that switchbacks were absent in the innermost heliosphere and increased in occurrence with increasing heliocentric distance, and so were generated in the heliosphere. Inverted flux can be generated by magnetic reconnection, in the corona or the heliosphere, or from other Alfvén wave sources.
In taking the modulus of the radial field \(|B_{r}|\), we need to consider the effect of the averaging timescale of the data before the modulus is taken. This is because if this timescale is long, then we will average over switchbacks, or even orthogardenhose flux, and flux of opposing polarity will cancel. This can be useful in removing excess flux, because switchbacks and orthogardenhose flux are usually found in the heliosphere and are not a factor at the source surface and hence do not contribute to the coronal source flux (i.e. to the OSF). However, if the averaging timescale is long, then we will also average opposing polarity flux of the sector structure, which does map back to the source surface, and so this would lead to an underestimation of the source flux. Misunderstanding of the issue of the effect of averaging timescale led to the excess flux being labelled an “artefact” of taking the modulus of the field. Instead, Smith (2011) proposed that the field should be averaged over intervals of towards and away magnetic field sectors at the satellite. However, as pointed out by Lockwood and Owens (2013), the results of this depend critically on the choice of what constitutes a genuine sector boundary (i.e. a polarity reversal that maps back to the coronal source surface) and what is a switchback, or other, structure that originates in the heliosphere. Lockwood and Owens (2013) also pointed out that excess flux is a real physical phenomenon caused by switchbacks and orthogardenhose flux and not an artefact of the mathematical operation of taking the absolute value of a parameter.
Because the degree of field folding will increase with heliocentric distance (partly because the Parker spiral gardenhose angle increases with \(r\)), the excess flux also get larger farther way from the Sun. The survey of data from a great many heliospheric craft number by Owens et al. (2008) showed this to be the case, and the variation with radial distance \(r\) observed was shown to be quantitatively consistent with expectations for excess flux by Lockwood, Owens, and Rouillard (2009b). The results of Owens et al. (2008) also showed that the latitudinal invariance of \(|B_{r}|\) did not depend on \(r\), and Lockwood and Owens (2009) used this survey to compute the uncertainties in quantifying \(F_{AU}\) from a single point measurement at \(r=R_{AU}\).
There are several ways in which we can account for the excess flux, \({\Delta}F\), and so use near-Earth heliospheric data to compute the OSF. Lockwood, Owens, and Rouillard (2009b) use the variation in the observed solar wind speed with frozen-in IMF and a kinetic (ballistic) model to make an estimate of \({\Delta}F\). This was based on observations that near-radial IMF resulted from the kinematic effect on frozen-in field in rarefaction regions where the solar wind velocity decayed (Jones, Balogh, and Forsyth, 1998; Riley and Gosling, 2007). Lockwood, Owens, and Rouillard (2009b) termed this method the “kinematic correction”. A more rigorous approach was developed by Owens et al. (2017) and employed by Frost et al. (2022). This method uses observations of strahl electrons to determine the magnetic connectivity of the observation point to the solar corona and so quantify the total inverted (folded) flux seen during a CR in switchbacks and orthogardenhose field regions. This gives the most accurate set of \({\Delta}F\) estimates to use in Equation 2. The main disadvantage of this method is that there is relatively limited availability of data with the required strahl observations. In addition, thus far, the method has only been applied to data from spacecraft in halo orbits around the L1 Lagrange point, for which the occurrence of folded flux is only detected close to the ecliptic plane; hence, flux that is folded in heliographic latitude and so folded out of the ecliptic is missed, but it is assumed that this is balanced by flux that was initially not in the ecliptic plane but is folded into it. Thirdly, we can use the averaging timescale \({\tau}\) applied before the modulus of the radial field is taken to give \(|{\langle}B_{r}{\rangle}_{\tau}|\). If we could chose an ideal value of \({\tau}\), then this would cancel the folded flux but not cancel flux around the crossings of the heliospheric current sheet (HCS) that separate the sectors. If we achieve that, then we eliminate the \({\Delta}F\) term, and the equation for OSF becomes
This is the most easily-implemented method, but it is also somewhat unsatisfactory. This is because, although there is always a value of \({\tau}\) that gives the correct \([F_{s}]_{IMF}\), this would almost certainly involve some incorrect cancellation of flux around HCS crossings but compensate for that by not fully cancelling all the folded flux that should be cancelled. Hence the required value of \({\tau}\) may vary.
Nevertheless, by comparison with the results from the strahl method, Frost et al. (2022) show that the averaging method accurately eliminates \({\Delta}F\) for a value of \({\tau}\) of 20 h for all CRs between 1995 and 2020. This is discussed further in Section 2 and in Section A.2 of the Appendix.
1.3 Structure of the Present Article
The present article uses CR means of geomagnetic activity data to reconstruct the OSF back to 1868 at CR resolution. This is done using the aaH (Lockwood et al., 2018a,b) and IDV(1d) (Lockwood et al., 2013) geomagnetic indices, the derivation of which is discussed in Section 3. We employ a multiple regression with satellite observations of the OSF. The methods for making these OSF estimates from interplanetary observations were outlined in Section 1.2. The most satisfactory method is using strahl electrons with radial IMF observations, but these are available only after 1995. Sunspot numbers \(R\) show that solar activity has been relatively quiet since 1995; the largest CR mean of \(R\) in that interval is \({\langle}R{\rangle}_{CR}\) = 234.8, compared to the largest value since measurements began of 360.5 (in January 1958). Hence, it is useful to try to use radial IMF data from earlier intervals (the largest CR mean after 1970 is \({\langle}R{\rangle}_{CR}\) = 283.7, during the interval 1970 – 1995 there are 14 CRs for which \({\langle}R{\rangle}_{CR}\) exceeds 234.8, the largest value seen after 1995). Hence making use of the data from 1970 – 1995 extends the range of solar activity conditions contributing to the analysis. Section 2 compares the OSF generated with and without strahl data and quantifies the percent uncertainties \({\epsilon}\) in \([F_{s}]_{IMF}\) estimates made without strahl observations when there are gaps in the data series: this is done by synthetically introducing gaps into CRs with a full complement of observations. Unfortunately, in the data for 1970 – 1995 only 191 out of the 333 CRs contain enough data to give \({\epsilon} {\leq}20\)%. As a result, we here use the strahl-derived data after 1995 to generate the multiple regression fit of the geomagnetic data and use the data from before 1995 for which \({\epsilon} {\leq}20\)% as test data.
Section 2 and Appendix A.2 discuss the rationale for using a certain averaging interval \({\tau}\) with Equation 3 to allow for excess flux. They also give the details of the generation of the estimates of the uncertainty, \({\epsilon}\), caused by data gaps.
After describing the geomagnetic data in Section 3, Section 4 demonstrates why a combination of the aaH and IDV(1d) geomagnetic indices can yield an OSF value and derives the algorithm for using these geomagnetic data to predict OSF on CR timescales. Section 5 presents the results and Section 6 evaluates the uncertainties caused by observation errors in the geomagnetic data. Section 7 compares with previous reconstructions.
Table 1 lists the all the datasets used in the present study and the intervals (and CR numbers) over which they are employed. This table also gives the percentages of CRs for which the data gaps are few enough and short enough to give percentage errors \({\epsilon}\) of less than 20%.
2 Near-Earth Interplanetary Magnetic Field Data
This section contrasts and compares the two methods for deriving CR averages of the OSF from in situ spacecraft observations of the radial IMF component. The errors introduced by data gaps are evaluated.
Equation 2 gives us a method for computing OSF when we have strahl electron data that allows us to determine the magnetic connectivity of field lines to the solar corona and hence to compute the excess flux, \({\Delta}F\) (Owens et al., 2017; Frost et al., 2022). This can be applied to interplanetary data obtained after 1995, but before then we have to use Equation 3 with the optimum averaging interval of \({\tau}\) of 20 h derived by Frost et al. (2022). This result is emphasised in Section A.2 of the Appendix, which confirms that 20 h is indeed the optimum averaging interval.
Figure 1 is a detailed look at the effects of averaging and then taking the modulus of one-minute or hourly Omni samples of the radial magnetic field in the near-Earth heliosphere, \({B_{r}}\). Data used are for 1981 – 2022 (inclusive), for which both one-minute and hourly resolution Omni interplanetary data are available.
Figure 1a compares the modulus of hourly averages of the one-minute data, i.e. \(|{\langle}B_{r}{\rangle}_{1h}|\), to hourly averages of the modulus of the one-minute data, \({\langle}|B_{r}|{\rangle}_{1h}\). The format is a “data density plot” (a two-dimensional histogram), in which the logarithm of the number of samples in bins of a given size are plotted as a function of the variables along the two axes. Because \(B_{r}\) of opposite polarity in the averaging interval will cancel, \(|{\langle}B_{r}{\rangle}_{1h}| {\leq} {\langle}|B_{r}|{\rangle}_{1h}\), as can be seen in the plot. Figure 1b is the same as Figure 1a, but for daily means; it shows the same behaviour as for the hourly means but to a greater extent, and the effect is clearly greatest at low values. Figure 1c shows another comparison of daily means. The vertical axis is again \({\langle}|B_{r}|{\rangle}_{1d}\), as in panel b. However, the horizontal axis is \({\langle}|{\langle}B_{r}{\rangle}_{1h^{\prime}}|{\rangle}_{1d}\), where the prime denotes that the hourly means provided by the Omni dataset are used. The same sort of behaviour as seen in panel b is observed, but there is spread in the data which, surprisingly, leads to some data points below the 45-degree line, i.e. \({ \langle}|{\langle}B_{r}{\rangle}_{1h^{\prime}}|{\rangle}_{1d} > { \langle}|B_{r}|{\rangle}_{1d}\), which at first sight should not be possible. This is an effect of the satellite-to-Earth propagation lags employed by the Omni dataset, which are different for hourly and minute data; the hourly Omni data are the averages of the up to 60 available one-minute samples in the same hour of the time of observation at the satellite, the average of which is then lagged allow for the satellite-to-Earth propagation. This is not the same as the averages of the 60 one-minute samples that fall in the same hour at the bow shock, after they have been individually lagged.
Panels d, e, and f look at CR averages. In each case the vertical axis is the mean of the modulus of the one-minute radial field samples in the CR interval. The horizontal axis uses the Omni-produced hourly means for which the modulus is taken after averaging over (panel d) 1 h, (panel e) 12 h, and (panel f) 1 day, respectively, i.e.\({\langle}|{\langle}B_{r}{ \rangle}_{1h^{\prime}}|{\rangle}_{CR}\), \({\langle}|{\langle}B_{r}{\rangle}_{12h^{\prime}}|{\rangle}_{CR}\), and \({\langle}|{\langle}B_{r}{\rangle}_{1d^{\prime}}|{\rangle}_{CR}\). In these cases, the averaging over the CR has caused the shift to above the 45-degree line to be almost the same at all values and not just at low values, although the effect is still greater at lower values. The shift is greater the longer the averaging interval before the modulus is taken. This is because a longer averaging interval (greater \({\tau}\)) causes more cancellation of opposite-polarity field within that interval, and so \({\langle}|{\langle}B_{r}{\rangle}_{\tau}|{\rangle}_{CR}\) is reduced.
Hereafter in this article, only the Omni hourly-averaged data are used, and so the prime symbol is no longer needed. These data give a sequence of continuous CR averages that extends back to 1970, although data gaps within the CRs are common before 1995.
Section A.2 of the Appendix looks at the effect of the averaging interval \({\tau}\) (before the absolute value of \(B_{r}\) is taken) on the agreement between \([F_{s}]_{IMF}\), derived using Equation 3, and \([F_{s}]_{strahl}\), derived using Equation 2 with the excess flux calculated using strahl electrons (Frost et al., 2022). This confirms that \({\tau} = 20\) h is the optimum value, giving a maximum correlation coefficient \(r\) and minimum r.m.s. difference between the two estimates, \({\Delta}_{rms}\). A scatter plot of the two OSF estimates for this optimum value of \({\tau}\) are shown in Figure 2. The polynomial fit to these data gives the regression
This equation has a very small intercept of 0.0081 (in units of \(10^{14}\) Wb), but the slope of 0.986 is a bit smaller than the ideal value of unity. This is because, as shown in panels e and f, the effect of the averaging is slightly greater at low values than at high values. The very small value of the intercept means that \([F_{s}]_{IMF}\) is essentially proportional to \([F_{s}]_{strahl}\), and we here correct \([F_{s}]_{IMF}\) by multiplying the estimates by \(1/0.986 = 1.0142\).
Before the advent of the ACE and Wind spacecraft in 1995, data gaps in the interplanetary record are a serious problem. Figure 3a shows the percentage availability of hourly samples of the radial IMF \(B_{r}\), \(d_{a}\) in CRs from 1970 to the present. The plot shows that after 1995, most CRs have a full complement of data (\(d_{a}\) =100%) but that before 1995, \(d_{a}\) is lower and even falls to 10% in one CR.
Section A.1 of the Appendix describes how the fractional r.m.s.e. (root mean square error) can be estimated by synthetically removing data from the 328 CRs that have a full complement of hourly means, using a mask that removes the same number of samples, and with the same pattern, as for the CR in question, and then comparing with the known value for the complete CR. For each of the 328 full-data CRs available, this is repeated 10 times (for phases between the mask and the data that are increased by 36∘ with each repeat) and the mean error computed. It is shown that, because of the averaging over 20 h, errors are particularly large for CR means of \([F_{s}]_{IMF}\), compared to those for other parameters such as the IMF \(B\), the solar wind speed \(V_{sw}\), and the product \(BV_{sw}^{1.76}\) (which has been used in the past to reconstruct annual means of OSF). Figure 3b shows the variation in the CR values of \([F_{s}]_{IMF}\) with uncertainty bars of plus and minus the \(2{\sigma}\) error in mauve.
Figure 4 compares the values of \([F_{s}]_{IMF}\) and \([F_{s}]_{strahl}\) for averages over 1, 3, 5, and 13 CRs (i.e. 0.075yr, 0.225yr, 0.373 yr, and 0.971 yr). The 1970 – 2022 time-series in the left-hand panels show the \([F_{s}]_{strahl}\) data as black points with estimated error bars from the work of Frost et al. (2022), and the blue line is \([F_{s}]_{IMF}\) for the optimum \({\tau}\) of 20 h, with light blue error bars giving the uncertainty caused by missing data. The right-hand panels are the corresponding scatter plots for the post-1995 data. The plot demonstrates the reduction in the uncertainties and the increased agreement of the two estimates as the averaging interval in increased.
3 Geomagnetic Data
Range geomagnetic indices were introduced by Bartels, Heck, and Johnston (1939). They are based on the range of variation of the background-subtracted horizontal magnetic field observed at a magnetometer station in 3-hour windows. Range indices from near-antipodal stations in southern England and Australia were used by Mayaud (1972, 1980) to generate the aa index, which could be constructed back to 1868. To obtain continuous sequences, data from three observatory sites were needed in both hemispheres. For the Northern Hemisphere, the sites used were Greenwich (IAGA station code GRW: 1868 – 1925), Abinger (ABN: 1926 – 1956), and Hartland (HAD: 1957 – present), and for the Southern Hemisphere, they were Melbourne (MEL: 1868 – 1918), Toolangi (TOO: 1919 – 1979), and Canberra (CNB: 1980 – present). The Northern and Southern Hemisphere data yield aaN and aaS, respectively, and aa is the arithmetic mean of the two. Mayaud intended aa to be used on annual timescales and showed that its annual means correlated exceptionally well with those of the Ap index, which is a range index compiled from 11 – 13 stations (at that time, all in the Northern Hemisphere) calibrated in terms of what would have been seen at Potsdam (see the review by Lockwood et al., 2019b, and references therein). An extension of aa back to 1846 was made by Nevanlinna and Kataja (1993) using the range index data from the Helsinki Observatory.
In constructing aa, Mayaud used the change in the stations to make a crude allowance for the secular change in the geomagnetic field. However, he made no change to the station calibration over the interval of the data from each station, meaning that the old and new stations did not necessarily agree at each of the joins between data series. It has often been assumed that Mayaud “daisy-chained” the data back in time, and so these discontinuities at the joins were thought to reveal errors. This is not the case, there are step-like changes between the stations that account for the secular variation of the intrinsic geomagnetic field. This issue was addressed by Lockwood et al. (2018a) and Lockwood et al. (2018b), who developed the “homogeneous aa index” aaH from the same data. This index continuously adjusts the calibration of each station using the variation in geomagnetic latitude of the station due to the secular variation in the main field, computed using the International Geomagnetic Reference Field 12 (IGRF 12) main field model (Thébault et al., 2015) and extended back to before 1900 using the gufm1 model (Jackson, Jonkers, and Walker, 2000). This means inter-calibration of the stations at the joins is meaningful and was carried out for separate times of year and times of day rather than just using annual means. An indicator of the success of this is that whereas comparison of aaN and aaS showed considerable differences (Lockwood, 2003), comparison of aaHN and aaHS reveals only small differences, despite neither being used in the derivation of the other in any way.
The other geomagnetic index used is IDV(1d). This is based on the IDV (Inter-Diurnal Variation) index developed by Svalgaard and Cliver (2005). For a given station, IDV is the day-to-day difference in the hourly means of the observed horizontal field, taken at the hour closest to magnetic local midnight at the station. Because it uses a day-to-day difference, no background subtraction is required making the index both easier to generate and less prone to errors. In fact, the IDV index is based on the “u-index” of Bartels (1932), but where IDV uses the hourly mean closest to local magnetic midnight, the u-index used the mean of data taken over the whole day.
It is interesting to note why Bartels changed from the difference-based inter-diurnal index to the more difficult and complex range-based indices with his paper in 1939 (Bartels, Heck, and Johnston, 1939). The u-index was criticised because it did not clearly show the recurrent variations (every Carrington rotation) that were seen in geomagnetic data, but these were well captured by the range-based indices. As pointed out by Svalgaard and Cliver (2005), we now know that this was because the u-index responded mainly to changes in the near-Earth IMF \(B\), whereas the range indices responded to a combination of both \(B\) and the solar wind speed \(V_{sw}\) (in fact, the product \(BV_{sw}^{1.76}\) analysed in Figure 15). The recurrent disturbances are caused by corotating interaction regions (CIRs), where fast solar wind catches up with slow solar wind ahead of it, and their signature in \(B\) is smaller than that in \(V_{sw}\) and \(BV_{sw}^{1.76}\). The IDV(1d) index was developed from the IDV concept by Lockwood et al. (2013), but these authors returned to Bartels’ original concept of using the means for the whole day rather than just the midnight value (the “(1d)” in the name stands for “1 day”). The reason for this was three-fold: (1) the averaging reduced the noise in the data; (2) the midnight values were more influenced by the substorm current wedge, which introduced a greater dependence on \(V_{sw}\); and (3) the influence of the current wedge introduced a greater dependence on geomagnetic latitude into IDV. The difference in the responses of the aaH and IDV(1d) indices is very valuable as it can be used to compute both \(B\) and \(V_{sw}\) (Svalgaard and Cliver, 2005; Rouillard, Lockwood, and Finch, 2007; Lockwood et al., 2014b); hence errors were reduced using IDV(1d) as it was more different in its optimum solar wind coupling function to the range indices than was IDV.
There was another major difference in the philosophy of construction of the IDV(1d) and IDV indices. The IDV index used all the available data from different stations, averaged together, which means there are many more stations contributing in recent years than contribute early in the data sequence. Although using more stations does reduce noise, the data sequence is not homogeneous, and so the data being compared with modern satellite data are not the same as the data used to reconstruct historic values. In particular, the value of IDV for one station depends critically on its geomagnetic latitude (Lockwood et al., 2013), and using the mean of all available stations introduces a long-term change because the mean latitude of the stations changes as we go back in time because the distribution of available stations changes. Hence in generating the IDV(1d) index, Lockwood et al. (2013) adopted the philosophy of making the modern day data as similar as possible to the historic data, and because there is only one station available at the start of the reconstruction, this means using only one station throughout. As for the aa index, there is no station that has operated throughout, and it was necessary to spline together the data from different stations at similar magnetic latitudes. The IDV(1d) index used the data from the Helsinki (HEL), Niemegk/Potsdam/Seddin (NGK/POT/SED), and Eskdalemuir (ESK) magnetometers, the main contributions being from HEL and ESK because they were at very similar latitudes. All three were normalised to the geomagnetic latitude of ESK in the year 2000 using the observed variation with geomagnetic latitude and the predictions of the geomagnetic latitude of the stations from the IGRF-12 main field model (Thébault et al., 2015), extended back from 1900 to the start of the HEL data using the gufm1 model (Jackson, Jonkers, and Walker, 2000). Data from HEL were used for 1845 – 1890 (inclusive) and 1893 – 1896 and from Eskdalemuir from 1911 to the present. The gaps are filled using latitude-normalised data from the Potsdam (POT, 1891 – 1892 and 1897 – 1907) and nearby Seddin (SED, 1908 – 1910) and Niemegk (NGK, after 1932) observatories and inter-calibration of the HEL and ESK data achieved using the POT/SED/NGK composite series.
Of course, the difficulty of this approach is that it is more subject to errors in the data from one station, errors that can be reduced (but for later data only) by averaging many stations. Martini and Mursula (2006) noted an error in the hourly means of the ESK data, and this was corrected by Macmillan and Clarke (2011). In addition, Svalgaard (2014) correctly noted that, compared to data from the vertical force variometer, the adopted scale value of the horizontal variometer at Helsinki was too low by \(~30{\%}\) during the years 1866 – 1874.5, and the adopted scale value of the declination variometer appeared to be too low by a factor of about 2 during the interval 1885.8 – 1887.5. This was confirmed by Lockwood et al. (2014a) using the available data from nearby stations and the alternative variometer for the HEL data, and the required corrections to IDV(1d) were made.
The IDV(1d) composite has been checked against latitude-corrected data from several other stations Lockwood et al. (2014a, 2022a). One particularly useful station is Tucson, which started operation in 1910 and so covers the interval of the ESK data; it shows remarkably good agreement with the ESK data once allowance is made for the latitude difference. In addition, for before 1930, we have the u-index generated by Bartels (1932) from a number of stations, as well as some other short data sequences from other stations.
Figure 5 shows 1-CR and 13-CR averages of the aaH and IDV(1d) geomagnetic data series, which are used here in the reconstruction of OSF. The plot also shows the international sunspot number \(R\) in the same format (Clette et al., 2023).
4 The Use of Geomagnetic Data to Compute the OSF
Section 3 has described the two geomagnetic indices used in this paper. This section demonstrates why the combination of the two gives information about the OSF and derives the optimum multivariate fit to the OSF observations.
Figure 6 shows three scatter plots that illustrate why the OSF can be calculated from these geomagnetic activity indices. In each case, the linear correlation coefficient is about 0.8. Panel a shows the correlation between the aaH index and the product \(BV_{sw}^{1.76}\), which was used by Lockwood et al. (2014b) and Lockwood et al. (2022a) in their reconstructions of \(B\), \(V_{sw}\), and \(F_{s}\). Using an automated series of Nelder–Mead simplex searches (Nelder and Mead, 1965; Lagarias et al., 1998), it was found that the optimum linear correlation with \(V_{sw}\) is using \([\mathrm{aa}_{\mathrm{H}}-\mathrm{IDV(1d)}]\), as shown in panel b. Hence panel b offers the potential to remove the dependence of aaH on \(V_{sw}\) but then we would need to convert the IMF \(B\) derived into \(F_{s}\), which could be done using the correlation shown in Figure 6c.
However, implementing each relationship in this three-step procedure leads to a compounding of uncertainties that can be avoided. Instead, we here used a series of automated searches with the Nelder–Mead procedure to maximise the correlation between the prediction (\([F_{s}]_{G}\)) and the value from interplanetary observations (we studied using both \([F_{s}]_{strahl}\) and \([F_{s}]_{IMF}\)). The significance of each correlation was evaluated allowing for the number of free fit parameters, and the largest correlation and greatest significance was found for the formulation
Figure 7 shows the results of one implementation of such fitting. This plot uses all \([F_{s}]_{IMF}\) values from the modulus of 20-h means of the radial field for which the fractional error due to data gaps is less than 20%. In the scatter plots on the right, the yellow points are for 1995 and after, whereas the blue points (with error bars) are for before 1995. The predicted linear least-squares fit and its \(1{\sigma}\) uncertainties are shown by the mauve line and pink area, respectively. The plots to the left show the corresponding temporal variations of \([F_{s}]_{IMF}\) (in blue) and the best-fit from geomagnetic activity \([F_{s}]_{G}\) (in mauve). Rows, from top to bottom, are for averages over 1 CR, 3 CRs, 5 CRs, and 13 CRs.
We do not further employ the fits shown in Figure 7 because it is not possible to evaluate the effects of data gaps on the derived fits. Overfitting, where the fit is influenced by noise in the data and loses predictive power as a result, is always a concern. Consequently, we use a simple two-fold procedure with a fitting data set and a separate testing data set. We use the near-continuous \([F_{s}]_{strahl}\) data for 1995 and after for fitting and test against the 1970 – 1995 \([F_{s}]_{IMF}\) data. This has the advantage that the uncertainties due to data gaps apply exclusively to the test data and the associated uncertainties are easier to allow for in the tests than in the fitting.
The results are shown in Figure 8. The fit data are shown in the scatter plots in the left-hand column, and the test data in the right-hand column. Rows, from top to bottom, are for averages over 1 CR, 3 CRs, 5 CRs, and 13 CRs, as before. The orange line is for equality of \([F_{s}]_{G}\) with the in situ data (i.e. for the left column \([F_{s}]_{strahl}\) and for the right column \([F_{s}]_{IMF}\)). For the continuous fit data, the only error accounted for is in the \([F_{s}]_{G}\) data, and they are the estimated \(1{\sigma}\) fit errors (vertical grey error bars). Note that there will, most likely, be errors in both the IMF OSF estimates arising from propagation uncertainties from the L1 satellite to Earth (both spatial and temporal) (Lockwood, 2022) and spacecraft measurement uncertainties. However, these uncertainties cannot be quantified. For the black points in Figure 8, \([F_{s}]_{G}\) and the in situ data agree to within the predicted \(1{\sigma}\) uncertainties. For the red/blue points, \([F_{s}]_{G}\) is, respectively, greater/smaller than the in situ values by more than the predicted uncertainties. If those uncertainties were truly at the \(1{\sigma}\) level, then we should expect 16% of points to be blue and 16% to be red. On each plot, the actual percentages are given, and they are, in most cases, considerably smaller than 16%, even considering the unquantified errors that will be present in the in situ values. The percentages are not, in the main, smaller than 2.5%, and so the uncertainty estimates are not at the \(2{\sigma}\) level. However, we can say they are very conservative estimates of the \(1{\sigma}\) errors. Note that for the test data in Figure 8, only data with estimated percentage error due to missing data of 20% or less are considered; however, including all data made only a small differences to the numbers in Table 2 or to the percentages disagreeing by more than estimated uncertainties given in the figure.
The right-hand plots are for the test data in the same format. For these data, there are often considerable errors in \([F_{s}]_{IMF}\) due to error gaps (horizontal grey bars). The red and blue dots are now for points that do not agree to within the combination of the two uncertainties. If anything, the percentages of red and blue points are lower than for the fit data, and, again, all are smaller than the 16% we would expect for \(1{\sigma}\) uncertainties. This confirms that we can regard the uncertainties as conservative \(1{\sigma}\) estimates.
Table 2 gives the coefficients in Equation 5 for each of the four CR averaging periods studied. Note that these are somewhat different for the four cases, indicating that the variation timescales influence the relationships between the OSF and the geomagnetic index. There is, however, a very small inconsistency in the reconstructions if we only apply the coefficients in Table 2. That is because, for example, if we take 13-point running means of the 1-CR reconstruction, then we do not get exactly the same variation as generated in the 13-CR reconstruction. The r.m.s. difference is less than 0.5%, but we here correct for it by adopting the 13-CR reconstruction and then multiplying the 1-CR reconstruction by the ratio of the 13-CR reconstruction and the 13-point soothed 1-CR reconstruction. This ensures that we have the near annual variation of the 13-CR variation in the 1-CR reconstruction, but we also maintain the higher frequency variations of the 1-CR reconstruction. Using the same procedure, we then correct the 3-CR and 5-CR reconstructions so that they match the 3- and 5-point running means of the corrected 1-CR variation; these corrections were extremely small (smaller than 0.1%). This procedure ensures that all four reconstructions are consistent. The correlations of \([F_{s}]_{G}\) and \([F_{s}]_{IMF}\) are always massively significant (the \(p\)-values of the null hypothesis are essentially zero), and correlations are always slightly higher for the fit dataset than the test dataset, which is expected because of the large errors in some of the test \([F_{s}]_{IMF}\) data due to the data gaps. The correlations increase and the r.m.s. deviations decrease with increased averaging interval, as we would expect and as can be seen from the scatter in Figure 8.
5 Reconstructed OSF Data Series
Figure 9 shows the reconstructed time series for the four averaging intervals as mauve lines with the grey lines bounding the uncertainty of plus and minus \(1{\sigma}\) (which the tests in Figure 8 show are conservative estimates). The optimum reconstructions are superposed in Figure 10 on the same plot to show the effect of normalising the 13-point running means. A notable feature is that there are individual CRs in which there is a considerably increased OSF (up to a factor 2 larger than the value for surrounding CRs). These all occur around solar maximum and can also be seen as spikes in the IDV(1d) composite data series and are also found as similar spikes in the corresponding data from other stations. These events will be the subject of a later study.
6 Uncertainties Introduced by Errors in the Geomagnetic Data
The uncertainties shown in Figure 9 allow only for the uncertainties due to the polynomial fitting of modern data and do not account for any errors in the geomagnetic data that the reconstructions are based on. As discussed in Section 3, by comparisons with data from other stations, various errors have been detected and expunged. A problem is that there are increasingly fewer available stations to make comparisons with as we go back in time.
However, for both aaH and IDV(1d), there are data that we can use to check the results. Rather than search for and quantify errors and then try to evaluate the propagation of that error through the procedure, we use a more direct approach: we substitute the alternative data into the reconstruction and analyse what difference it makes.
The aaH index is the arithmetic mean of the Northern and Southern Hemisphere indices aaHN and aaHS. As discussed in Section 3, these are derived using observations and procedures that are completely independent of each other; in other words, aaHN does not, in any way, influence the derivation of aaHS, and vice versa. One of the important facets of the aaH index, as compared to the classic aa index, is that the Northern and Southern Hemisphere indices agree to a considerable degree, despite this independence from each other. This is stressed in Figure 11. Panels a and b show the time series of aaHN and aaHS, with 1-CR means in grey and 13-CR means in mauve. The similarity of the two is stressed by the scatter plot of the 1-CR data in panel c.
Using aaHN and aaHS instead of aaH in the polynomial Equation 5 generates two fully independent OSF reconstructions that are compared on panel d. The uncertainties are shown as grey error bars. On average, the two reconstructions differ by about a quarter of the estimated uncertainties. Because aaH is the arithmetic mean of aaHN and aaHS, this means that the uncertainties in the aaH geomagnetic data cause errors in the reconstructed OSF that are roughly an eighth of the estimated polynomial fit uncertainties.
Figure 12 shows a corresponding test of the effect of the uncertainties caused by errors in the IDV(1d) index. In this case, the IDV(1d) composite value is replaced by the value derived by the same procedure but using the inter-diurnal difference of the horizontal field measured by the Tucson magnetometer IDV(1d)TUC, data that is available continuously from 1910 to the present day. These Tucson data are latitude-corrected, using the procedure described by Lockwood et al. (2013), but were not used in any way to derive the IDV(1d) composite, and so they provide an independent test of IDV(1d). Panel c shows the agreement of 1-CR means of IDV(1d) and IDV(1d)TUC is not as close as that for the hemispheric aaH indices shown in Figure 11c, but Figure 12d shows that this has very little effect on the OSF estimate. Only for the very largest OSF values we do see any scatter, and it is again much smaller that the polynomial fit uncertainties. This is because the fitted polynomial gives a much greater dependence on aaH than IDV(1d).
We do not have a single station that can be used to test the IDV(1d) composite before 1910, but Lockwood et al. (2013) did test this composite against a number of short data series from different, independent stations. However, Bartels (1932) gives monthly means of his u index for 1872 – 1930. This index is the same as IDV(1d) but was compiled from an evolving mix of stations, the weighted average of which was taken in any month. The stations used by Bartels were: Seddin (SED, 1905 – 1928); Potsdam (POT, 1891 – 1904); Greenwich (GRW, 1872 – 1890; Bartels notes errors in the later data and makes corrections but therefore gives them a lower weighting factor); a composite of stations near Bombay including Colaba (CLA, 1872 – 1927); Batavia (BTV, 1884 – 1926; various calibrations were needed to allow for instrument changes); Honolulu (HON, 1902 – 1930); Puerto Rico (SJG, 1902 – 1914); Tucson (TUC, 1917 – 1930); and Watheroo (WAT, 1919 – 1930). Many of these data, along with others from Wilhelmshaven (WLH, 1883 – 1895), St Petersburg (SPE, 1850 – 1862), Parc St Maur (PSM, 1883 – 1901), and Ekaterinburg (EKT, 1887 – 1929) were used by Lockwood and Owens (2013) to test the accuracy of IDV(1d).
Unfortunately, we have only monthly means of Bartels results, rather than Carrington rotation means. We here use linear interpolation of the the monthly values to the mid-points of the CR intervals. This is not ideal because sharp spikes in the u values will be reduced in amplitude unless the centres of the month and the CR intervals happen to coincide. In addition, the IDV(1d) values are scaled to the magnetic latitude of Eskdalemuir in the year 2000, whereas u is compiled from stations at a range of latitudes. To account for this, the interpolated u values are scaled in terms of IDV(1d) by linear regression, giving values we denote as uc. These are compared to IDV(1d) for the period of overlapping data (1872 – 1930) in Figure 13.
The results in Figure 13 and very similar to those in Figure 12, other than OSF and geomagnetic activity values, were notably lower before 1930 than after.
7 Comparison with Previous Reconstructions
Lastly, we compare the present 13-CR reconstructions with previous reconstructions of annual means. The results are shown in Figure 14. The black line surrounded by the orange uncertainty band are the 13-CR (0.971 yr) OSF reconstructions presented in this paper. The blue line surrounded by the pale blue uncertainty band is the reconstruction of annual means by Lockwood et al. (2022a) from the same geomagnetic data (LEA22). Where the uncertainty bands for these two reconstructions overlap is shown in green; such overlap is always present. The uncertainties band is generally narrower for the present reconstruction and generally lies in the middle of the band for the previous reconstruction. Only in the first solar cycle of the period of overlap (Cycle 11), there is any consistent difference, but even here the two do still (just) agree to within estimated uncertainties.
Also shown on the plot are the reconstructions by Lockwood, Owens, and Barnard (2014) from geomagnetic data (LEA14) and by Krivova et al. (2021) (KEA21). The LEA14 reconstruction does use the same pairing of aaH and IDV(1d) as used here, but that is only one of four index pairings used, the results of which are averaged together. The KEA21 reconstruction is different; it is based on modelling and the monthly sunspot number \(R\). There are some differences between these reconstructions, notably during Cycle 20. This is not a surprise as the modelled association between sunspot number and OSF has been unable to reproduce the observed OSF variation, indicating that another factor was important in this cycle, presumably because of the large and sudden decline in sunspot activity between Cycles 19 and 20. It is likely that resolving this difference in Cycle 20 would also improve the small disagreements found at other times. Nevertheless, the overall agreement is very good.
8 Conclusions
This article has presented Carrington rotation (CR) averages of open solar flux (OSF), derived from two geomagnetic activity indices for 1878 to the present day. The data are available for 1-CR, 3-CR, 5-CR, and 13-CR means (0.07 yr, 0.224 yr, 0.373 yr, and 0.971 yr, respectively) in the supplementary information file attached to this article. These values are all given with (conservative) \(1{\sigma}\) uncertainty estimates. The OSF values are generated by polynomial fits of the geomagnetic indices to values from interplanetary satellite observations. These OSF data are generated in two ways. The fit data used are for 1995 – 2022 and use observations of strahl electrons to determine connectivity to the solar corona and thereby allow for the excess flux caused by orthogardenhose flux and switchbacks. It is shown that these data are closely matched by interplanetary observations that use the averaging interval \({\tau}\) to allow for excess flux. These are available for 1970 – 2022 and are used as tests of the polynomial fitting. However, before 1995, data gaps are a serious problem for some of the Carrington rotations, and the errors they cause have been quantified by synthetic removal of data from CRs with a full complement of observations.
We have tested for errors caused by inaccuracies in the geomagnetic data by substituting independent data into the polynomials and evaluating how much difference to the OSF estimates this causes. These errors are considerably smaller than the polynomial fitting uncertainties.
The OSF reconstructions on different averaging timescales have been normalised to make them consistent in their smoothed variations with the 13-CR means. The uncertainty band around the 13-CR means is narrower than that around previous annual reconstructions, and the former lies within the latter for almost all CRs. There is considerable variability from one CR to the next in the 1-CR reconstructions, and some CRs near solar maximum can show factor of 2 increases in OSF. These CRs are marked by particularly high values of the IDV(1d) index, which is seen in corresponding records from a great many magnetometer stations. These CRs may, for example, indicate bursts of high CME activity which raises questions about how isotopic or coincidentally Earth-directed such bursts may be. They will be the subject of further studies.
Data Availability
The OSF data series generated in this paper are all available in an attached ascii supplementary information file. The input data used in the paper are all publicly available. The strahl-corrected OSF CR means are contained in the supplementary information file of the paper by Frost et al. (2022), available from https://github.com/AnnaMarieFrost/Estimating-the-Open-Solar-Flux-from-In-Situ-Measurements. The 1-minute OMNI interplanetary data are available from https://omniweb.gsfc.nasa.gov/ow.html and the hourly OMNI data from https://omniweb.gsfc.nasa.gov/ow.html. CR means of the IDV (1d) composite are available in the second supplementary information file attached to this paper. The Bartels u-index is published in Bartels (1932). The homogeneous aa index aaH is available from the supplementary information file to the paper by Lockwood et al. (2018b), available from this link. This can be updated to the present day using the k-indices for Hartland from British Geological Survey, Edinburgh https://geomag.bgs.ac.uk/operations/hartland.html and Canberra from Geoscience Australia https://geomagnetism.ga.gov.au/geomagnetic-indices/k-index. The Tucson IDV (1d)TUC index is made from hourly means of the Tucson data, available from the World Data Centre for Geomagnetism, Edinburgh Data portal at https://wdc.bgs.ac.uk/dataportal/.
References
Altschuler, M.D., Newkirk, G.: 1969, Magnetic fields and the structure of the solar corona. I: methods of calculating coronal fields. Solar Phys. 9, 131. DOI.
Arge, C.N., Pizzo, V.J.: 2000, Improvement in the prediction of solar wind conditions using near-real time solar magnetic field updates. J. Geophys. Res. Space Phys. 105, 10465. DOI.
Bale, S.D., Badman, S.T., Bonnell, J.W., Bowen, T.A., Burgess, D., Case, A.W., Cattell, C.A., Chandran, B.D.G., Chaston, C.C., Chen, C.H.K., Drake, J.F., De Wit, T.D., Eastwood, J.P., Ergun, R.E., Farrell, W.M., Fong, C., Goetz, K., Goldstein, M., Goodrich, K.A., Harvey, P.R., Horbury, T.S., Howes, G.G., Kasper, J.C., Kellogg, P.J., Klimchuk, J.A., Korreck, K.E., Krasnoselskikh, V.V., Krucker, S., Laker, R., Larson, D.E., MacDowall, R.J., Maksimovic, M., Malaspina, D.M., Martinez-Oliveros, J., McComas, D.J., Meyer-Vernet, N., Moncuquet, M., Mozer, F.S., Phan, T.D., Pulupa, M., Raouafi, N.E., Salem, C., Stansby, D., Stevens, M., Szabo, A., Velli, M., Woolley, T., Wygant, J.R.: 2019, Highly structured slow solar wind emerging from an equatorial coronal hole. Nature 576, 237. DOI.
Balogh, A., Forsyth, R.J., Lucek, E.A., Horbury, T.S., Smith, E.J.: 1999, Heliospheric magnetic field polarity inversions at high heliographic latitudes. Geophys. Res. Lett. 26, 631. DOI.
Bartels, J.: 1932, Terrestrial-magnetic activity and its relations to solar phenomena. Terr. Magn. Atmos. Electr. 37, 1. DOI.
Bartels, J., Heck, N.H., Johnston, H.F.: 1939, The three-hour-range index measuring geomagnetic activity. Terr. Magn. Atmos. Electr. 44, 411. DOI.
Borovsky, J.E.: 2016, The plasma structure of coronal hole solar wind: origins and evolution. J. Geophys. Res. Space Phys. 121, 5055. DOI.
Clette, F., Lefèvre, L., Chatzistergos, T., Hayakawa, H., Carrasco, V.M.S., Arlt, R., Cliver, E.W., Dudok de Wit, T., Friedli, T.K., Karachik, N., Kopp, G., Lockwood, M., Mathieu, S., Muñoz-Jaramillo, A., Owens, M., Pesnell, D., Pevtsov, A., Svalgaard, L., Usoskin, I.G., Van Driel-Gesztelyi, L., Vaquero, J.M.: 2023, Recalibration of the sunspot-number: status report. Solar Phys. 298, 44. DOI.
Cranmer, S.R.: 2009, Coronal holes. Living Rev. Solar Phys. 6. DOI.
Frost, A.M., Owens, M.J., Macneil, A., Lockwood, M.: 2022, Estimating the open solar flux from in situ measurements. Solar Phys. 297(82), 1. DOI.
Horbury, T.S., Matteini, L., Stansby, D.: 2018, Short, large-amplitude speed enhancements in the near-Sun fast solar wind. Mon. Not. Roy. Astron. Soc. 478, 1980. DOI.
Jackson, A., Jonkers, A.R.T., Walker, M.R.: 2000, Four centuries of geomagnetic secular variation from historical records. Phil. Trans. Roy. Soc., Math. Phys. Eng. Sci. 358, 957. DOI.
Jagarlamudi, V.K., Raouafi, N.E., Bourouaine, S., Mostafavi, P., Larosa, A., Perez, J.C.: 2023, Occurrence and evolution of switchbacks in the inner heliosphere: Parker solar probe observations. Astrophys. J. Lett. 950, L7. DOI.
Jones, G.H., Balogh, A., Forsyth, R.J.: 1998, Radial heliospheric magnetic fields detected by Ulysses. Geophys. Res. Lett. 25, 3109. DOI.
Kahler, S.W., Crooker, N.U., Gosling, J.T.: 1996, The topology of intrasector reversals of the interplanetary magnetic field. J. Geophys. Res. Space Phys. 101, 24373. DOI.
Koskela, J., Virtanen, I., Mursula, K.: 2019, Revisiting the coronal current sheet model: parameter range analysis and comparison with the potential field model. Astron. Astrophys. 631, A17. DOI.
Krivova, N.A., Solanki, S.K., Hofer, B., Wu, C.-J., Usoskin, I.G., Cameron, R.: 2021, Modelling the evolution of the Sun’s open and total magnetic flux. Astron. Astrophys. 650, A70. DOI.
Lagarias, J.C., Reeds, J.A., Wright, M.H., Wright, P.E.: 1998, Convergence properties of the Nelder–Mead simplex method in low dimensions. SIAM J. Optim. 9, 112. DOI.
Linker, J.A., Caplan, R.M., Downs, C., Riley, P., Mikic, Z., Lionello, R., Henney, C.J., Arge, C.N., Liu, Y., Derosa, M.L., Yeates, A., Owens, M.J.: 2017, The open flux problem. Astrophys. J. 848, 70. DOI.
Lockwood, M.: 2003, Twenty-three cycles of changing open solar magnetic flux. J. Geophys. Res. 108, 1128. DOI.
Lockwood, M.: 2013, Reconstruction and prediction of variations in the open solar magnetic flux and interplanetary conditions. Living Rev. Solar Phys. 10, 4. DOI.
Lockwood, M.: 2022, Solar wind—magnetosphere coupling functions: pitfalls, limitations, and applications. Space Weather 20, e2021SW002989. DOI.
Lockwood, M.: 2023, Universal time effects on substorm growth phases and onsets. J. Geophys. Res. Space Phys. 128, e2023JA031671. DOI.
Lockwood, M., Milan, S.E.: 2023, Universal time variations in the magnetosphere. Front. Astron. Space Sci. 10, 1139295. DOI.
Lockwood, M., Owens, M.: 2009, The accuracy of using the Ulysses result of the spatial invariance of the radial heliospheric field to compute the open solar flux. Astrophys. J. 701, 964. DOI.
Lockwood, M., Owens, M.J.: 2011, Centennial changes in the heliospheric magnetic field and open solar flux: the consensus view from geomagnetic data and cosmogenic isotopes and its implications. J. Geophys. Res. Space Phys. 116, A04109. DOI.
Lockwood, M., Owens, M.J.: 2013, Comment on “What causes the flux excess in the heliospheric magnetic field?” by E. J. Smith. J. Geophys. Res. Space Phys. 118, 1880. DOI.
Lockwood, M., Owens, M.J.: 2014, Centennial variations in sunspot number, open solar flux and streamer belt width: 3. Modeling. J. Geophys. Res. Space Phys. 119, 5193. DOI.
Lockwood, M., Owens, M.J., Barnard, L.: 2014, Centennial variations in sunspot number, open solar flux, and streamer belt width: 2. Comparison with the geomagnetic data. J. Geophys. Res. Space Phys. 119, 5183. DOI.
Lockwood, M., Owens, M.J., Barnard, L.A.: 2023, Universal Time variations in the magnetosphere and the effect of CME arrival time: Analysis of the February 2022 event that led to the loss of Starlink satellites. J. Geophys. Res. Space Phys. 128. DOI.
Lockwood, M., Owens, M.J., Macneil, A.R.: 2019, On the origin of ortho-gardenhose heliospheric flux. Solar Phys. 294(85), 1. DOI.
Lockwood, M., Owens, M., Rouillard, A.P.: 2009a, Excess open solar magnetic flux from satellite data: 1. Analysis of the third perihelion Ulysses pass. J. Geophys. Res. Space Phys. 114, A11103. DOI.
Lockwood, M., Owens, M., Rouillard, A.P.: 2009b, Excess open solar magnetic flux from satellite data: 2. A survey of kinematic effects. J. Geophys. Res. Space Phys. 114, A11104. DOI.
Lockwood, M., Rouillard, A.P., Finch, I.D.: 2009, The rise and fall of open solar flux during the current grand solar maximum. Astrophys. J. 700, 937. DOI.
Lockwood, M., Stamper, R., Wild, M.N.: 1999, A doubling of the Sun’s coronal magnetic field during the past 100 years. Nature 399, 437. DOI.
Lockwood, M., Forsyth, R.B., Balogh, A., McComas, D.J.: 2004, Open solar flux estimates from near-Earth measurements of the interplanetary magnetic field: comparison of the first two perihelion passes of the Ulysses spacecraft. Ann. Geophys. 22, 1395. DOI.
Lockwood, M., Barnard, L., Nevanlinna, H., Owens, M.J., Harrison, R.G., Rouillard, A.P., Davis, C.J.: 2013, Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr – part 1: a new geomagnetic data composite. Ann. Geophys. 31, 1957. DOI.
Lockwood, M., Nevanlinna, H., Barnard, L., Owens, M.J., Harrison, R.G., Rouillard, A.P., Scott, C.J.: 2014b, Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr – part 4: near-Earth solar wind speed, IMF, and open solar flux. Ann. Geophys. 32, 383. DOI.
Lockwood, M., Nevanlinna, H., Vokhmyanin, M., Ponyavin, D., Sokolov, S., Barnard, L., Owens, M.J., Harrison, R.G., Rouillard, A.P., Scott, C.J.: 2014a, Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr – part 3: improved representation of solar cycle 11. Ann. Geophys. 32, 367. DOI.
Lockwood, M., Owens, M.J., Barnard, L.A., Scott, C.J., Watt, C.E.: 2017b, Space climate and space weather over the past 400 years: 1. The power input to the magnetosphere. J. Space Weather Space Clim. 7, A25. DOI.
Lockwood, M., Owens, M.J., Imber, S.M., James, M.K., Bunce, E.J., Yeoman, T.K.: 2017a, Coronal and heliospheric magnetic flux circulation and its relation to open solar flux evolution. J. Geophys. Res. Space Phys. 122, 5870. DOI.
Lockwood, M., Chambodut, A., Barnard, L.A., Owens, M.J., Clarke, E., Mendel, V.: 2018a, A homogeneous aa index: 1. Secular variation. J. Space Weather Space Clim. 8, A53. DOI.
Lockwood, M., Finch, I.D., Chambodut, A., Barnard, L.A., Owens, M.J., Clarke, E.: 2018b, A homogeneous aa index: 2. Hemispheric asymmetries and the equinoctial variation. J. Space Weather Space Clim. 8, A58. DOI.
Lockwood, M., Bentley, S.N., Owens, M.J., Barnard, L.A., Scott, C.J., Watt, C.E., Allanson, O.: 2019a, The development of a space climatology: 1. Solar wind magnetosphere coupling as a function of timescale and the effect of data gaps. Space Weather 17, 133. DOI.
Lockwood, M., Chambodut, A., Finch, I.D., Barnard, L.A., Owens, M.J., Haines, C.: 2019b, Time-of-day/time-of-year response functions of planetary geomagnetic indices. J. Space Weather Space Clim. 9, A20. DOI.
Lockwood, M., Owens, M.J., Barnard, L.A., Scott, C.J., Frost, A.M., Yu, B., Chi, Y.: 2022a, Application of historic datasets to understanding open solar flux and the 20th-century grand solar maximum. 1. Geomagnetic, ionospheric, and sunspot observations. Front. Astron. Space Sci. 9, 960775. DOI.
Lockwood, M., Owens, M.J., Yardley, S.L., Virtanen, I.O.I., Yeates, A., Mũnoz-Jaramillo, A.: 2022b, Application of historic datasets to understanding open solar flux and the 20th-century grand solar maximum. 2. Solar observations. Front. Astron. Space Sci. 9, 976444. DOI.
Lowder, C., Qiu, J., Leamon, R.: 2017, Coronal holes and open magnetic flux over cycles 23 and 24. Solar Phys. 292, 18. DOI.
Lowder, C., Qiu, J., Leamon, R., Liu, Y.: 2014, Measurements of EUV coronal holes and open magnetic flux. Astrophys. J. 783, 142. DOI.
Mackay, D., Yeates, A.: 2012, The Sun’s global photospheric and coronal magnetic fields: observations and models. Living Rev. Solar Phys. 9. DOI.
Macmillan, S., Clarke, E.: 2011, Resolving issues concerning Eskdalemuir geomagnetic hourly values. Ann. Geophys. 29, 283. DOI.
Macneil, A.R., Owens, M.J., Wicks, R.T., Lockwood, M., Bentley, S.N., Lang, M.: 2020, The evolution of inverted magnetic fields through the inner heliosphere. Mon. Not. Roy. Astron. Soc. 494, 3642. DOI.
Macneil, A.R., Owens, M.J., Wicks, R.T., Lockwood, M.: 2021, Evolving solar wind flow properties of magnetic inversions observed by helios. Mon. Not. Roy. Astron. Soc. 501, 5379. DOI.
Mancuso, S., Giordano, S., Barghini, D., Telloni, D.: 2020, Differential rotation of the solar corona: a new data-adaptive multiwavelength approach. Astron. Astrophys. 644, A18. DOI.
Martini, D., Mursula, K.: 2006, Correcting the geomagnetic IHV index of the Eskdalemuir observatory. Ann. Geophys. 24, 3411. DOI.
Mayaud, P.-N.: 1972, The aa indices: a 100-year series characterizing the magnetic activity. J. Geophys. Res. 77, 6870. DOI.
Mayaud, P.N.: 1980, Derivation, Meaning, and Use of Geomagnetic Indices, Geophysical Monograph Series 22, American Geophysical Union, Washington ISBN 978-0-87590-022-3. DOI.
Morgan, H.: 2011, The rotation of the white light solar corona at height \(4R_{\odot }\) from 1996 to 2010: a tomographical study of large angle and spectrometric coronagraph C2 observations. Astrophys. J. 738, 189. DOI.
Muñoz-Jaramillo, A., Sheeley, N.R., Zhang, J., DeLuca, E.E.: 2012, Calibrating 100 years of polar faculae measurements: implications for the evolution of the heliospheric magnetic field. Astrophys. J. 753, 146. DOI.
Nelder, J.A., Mead, R.: 1965, A simplex method for function minimization. Comput. J. 7, 308. DOI.
Neugebauer, M., Goldstein, B.E., McComas, D.J., Suess, S.T., Balogh, A.: 1995, Ulysses observations of microstreams in the solar wind from coronal holes. J. Geophys. Res. Space Phys. 100, 23389. DOI.
Nevanlinna, H., Kataja, E.: 1993, An extension of the geomagnetic activity index series aa for two solar cycles (1844 – 1868). Geophys. Res. Lett. 20, 2703. DOI.
Owens, M.J., Crooker, N.U., Lockwood, M.: 2013, Solar origin of heliospheric magnetic field inversions: evidence for coronal loop opening within pseudostreamers. J. Geophys. Res. Space Phys. 118, 1868. DOI.
Owens, M.J., Lockwood, M., Riley, P.: 2017, Global solar wind variations over the last four centuries. Sci. Rep. 7, 41548. DOI.
Owens, M.J., Arge, C.N., Crooker, N.U., Schwadron, N.A., Horbury, T.S.: 2008, Estimating total heliospheric magnetic flux from single-point in situ measurements. J. Geophys. Res. Space Phys. 113, A12103. DOI.
Owens, M.J., Lockwood, M., Riley, P., Linker, J.: 2017, Sunward strahl: a method to unambiguously determine open solar flux from in situ spacecraft measurements using suprathermal electron data. J. Geophys. Res. Space Phys. 122, 10980. DOI.
Permata, K., Herdiwijaya, D.: 2019, The measurement of solar differential rotation from proper motion of individual sunspots. J. Phys. Conf. Ser. 1231, 012019. DOI.
Priest, E.: 2014, Magnetohydrodynamics of the Sun 1st edn. Cambridge University Press, Cambridge, 978 ISBN 978-0-521-85471-9. DOI.
Riley, P., Gosling, J.T.: 2007, On the origin of near-radial magnetic fields in the heliosphere: numerical simulations. J. Geophys. Res. Space Phys. 112, 2006JA012210. DOI.
Riley, P., Linker, J.A., Mikić, Z.: 2001, An empirically-driven global MHD model of the solar corona and inner heliosphere. J. Geophys. Res. Space Phys. 106, 15889. DOI.
Riley, P., Lionello, R., Linker, J.A., Mikic, Z., Luhmann, J., Wijaya, J.: 2011, Global MHD modeling of the solar corona and inner heliosphere for the whole heliosphere interval. Solar Phys. 274, 361. DOI.
Rouillard, A.P., Lockwood, M., Finch, I.: 2007, Centennial changes in the solar wind speed and in the open solar flux. J. Geophys. Res. Space Phys. 112, A05103. DOI.
Ruždjak, D., Brajša, R., Sudar, D., Skokić, I., Poljančić Beljan, I.: 2017, A relationship between the solar rotation and activity analysed by tracing sunspot groups. Solar Phys. 292, 179. DOI.
Schatten, K.H., Wilcox, J.M., Ness, N.F.: 1969, A model of interplanetary and coronal magnetic fields. Solar Phys. 6, 442. DOI.
Smith, E.J.: 2011, What causes the flux excess in the heliospheric magnetic field?. J. Geophys. Res. Space Phys. 116, A12101. DOI.
Smith, E.J., Balogh, A.: 1995, Ulysses observations of the radial magnetic field. Geophys. Res. Lett. 22, 3317. DOI.
Smith, E.J., Balogh, A., Forsyth, R.J., McComas, D.J.: 2001, Ulysses in the south polar cap at solar maximum: heliospheric magnetic field. Geophys. Res. Lett. 28, 4159. DOI.
Smith, E.J., Marsden, R.G., Balogh, A., Gloeckler, G., Geiss, J., McComas, D.J., McKibben, R.B., MacDowall, R.J., Lanzerotti, L.J., Krupp, N., Krueger, H., Landgraf, M.: 2003, The Sun and heliosphere at solar maximum. Science 302, 1165. DOI.
Suess, S.T., Smith, E.J.: 1996, Latitudinal dependence of the radial IMF component: coronal imprint. Geophys. Res. Lett. 23, 3267. DOI.
Suess, S.T., Smith, E.J., Phillips, J., Goldstein, B.E., Nerney, S.: 1996, Latitudinal dependence of the radial IMF component – interplanetary imprint. Astron. Astrophys. 316, 304.
Suess, S.T., Phillips, J.L., McComas, D.J., Goldstein, B.E., Neugebauer, M., Nerney, S.: 1998, The solar wind-inner heliosphere. Space Sci. Rev. 83, 75. DOI.
Svalgaard, L.: 2014, Correction of errors in scale values for magnetic elements for Helsinki. Ann. Geophys. 32, 633. DOI.
Svalgaard, L., Cliver, E.W.: 2005, The IDV index: its derivation and use in inferring long-term variations of the interplanetary magnetic field strength. J. Geophys. Res. Space Phys. 110, 2005JA011203. DOI.
Thébault, E., Finlay, C.C., Beggan, C.D., Alken, P., Aubert, J., Barrois, O., Bertrand, F., Bondar, T., Boness, A., Brocco, L., Canet, E., Chambodut, A., Chulliat, A., Coïsson, P., Civet, F., Du, A., Fournier, A., Fratter, I., Gillet, N., Hamilton, B., Hamoudi, M., Hulot, G., Jager, T., Korte, M., Kuang, W., Lalanne, X., Langlais, B., Léger, J.-M., Lesur, V., Lowes, F.J., Macmillan, S., Mandea, M., Manoj, C., Maus, S., Olsen, N., Petrov, V., Ridley, V., Rother, M., Sabaka, T.J., Saturnino, D., Schachtschneider, R., Sirol, O., Tangborn, A., Thomson, A., Tøffner-Clausen, L., Vigneron, P., Wardinski, I., Zvereva, T.: 2015, International geomagnetic reference field: the 12th generation. Earth Planets Space 67, 79. DOI.
Wallace, S., Arge, C.N., Pattichis, M., Hock-Mysliwiec, R.A., Henney, C.J.: 2019, Estimating total open heliospheric magnetic flux. Solar Phys. 294, 19. DOI.
Wang, Y.-M., Sheeley, N.R. Jr.: 1992, On potential field models of the solar corona. Astrophys. J. 392, 310. DOI.
Welch, B.L.: 1947, The generalization of student’s problem when several different population variances are involved. Biometrika 34, 28. DOI.
Yeates, A.R., Mackay, D.H., van Ballegooijen, A.A., Constable, J.A.: 2010, A nonpotential model for the Sun’s open magnetic flux. J. Geophys. Res. Space Phys. 115, A09112. DOI.
Zirker, J.B.: 1977, Coronal holes and high-speed wind streams. Rev. Geophys. 15, 257. DOI.
Acknowledgments
The authors are grateful to the many scientists, engineers and funding agencies who contributed to the production of the data used here, including the geomagnetic data and the interplanetary observations. We also thank the data centres that maintain and distribute the data, in particular British Geological Service, Edinburgh, the World Data Centre for Geomagnetism, Edinburgh, and NASA’s Space Physics Data Facility, Goddard Space Flight Center. We also thank the UK Science and Technology Facilities Council (STFC) for grant support.
Funding
M.L. and M.J.O. are part-funded by the UK Science and Technology Facilities Council (STFC), grant number ST/V000497/1.
Author information
Authors and Affiliations
Contributions
ML and MJO jointly conceived the study and wrote the manuscript. Analysis and processing of data was carried out by ML
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests. MJO is an Associate Editor of the journal Solar Physics, but has not been involved in the peer review process of this article.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Appendix
Appendix
1.1 A.1 Errors in CR Means Due to Data Gaps
The fractional errors due to missing interplanetary data were evaluated by using the number and pattern of data gaps in a given CR to make a mask, which was then used to remove data from the 328 CRs available that have valid means for all hours (i.e. \(d_{a}\) = 100%). The resulting synthetic CR means were then compared to the known true value for the full-data CR and the fractional error caused by the data gaps evaluated for each of the full-data CRs. To increase numbers of fractional error samples, each full-data CR was masked 10 times using 10 different phasings of the CR mask, \(36^{\circ}\) apart, relative to the data in the full-data CR. This gives 3280 estimates of the fractional uncertainty for a given CR, of which we take the root mean square (r.m.s.) value.
Figure 15 shows the results of the percentage error \({\xi}\) as a function of the percentage data availability \(d_{a}\) in the CR. The panels are for the IMF \(B\), the solar wind speed \(V_{sw}\), the product \(BV_{sw}^{1.76}\), and the open solar flux derived from the radial field using Equation 3, \([F_{s}]_{IMF}\) with the optimum averaging interval of \({\tau}\) of 20 h.
The full-data CRs (\(d_{a}\) = 100%) obviously give \({\xi}=0\), and the errors \({\xi}\) increase with decreasing \(d_{a}\). However, there is scatter because the pattern of the data gaps for a given \(d_{a}\) has an effect.
Figure 15 demonstrates that the errors are smallest for a given \(d_{a}\) for \(V_{sw}\), as expected because of its greater persistence (Lockwood et al., 2019a; Lockwood, 2022). The errors for \(B\) are larger, and for \(BV_{sw}^{1.76}\), they are larger still. For any parameter, the variation of \({\xi}\) with decreasing \(d_{a}\) will be hyperbolic, tending to infinity as \(d_{a}\) approaches zero. Nevertheless, for the parameters shown in panels a, b, and c of Figure 15, the variation is approximately linear for \(d_{a} {\geq}\) 25%. Hence, order-of-magnitude percentage errors in CR means can by estimated from \(d_{a}\) (\(d_{a} { \geq} \) 25%) using the equation
where \({\xi}\) and \(d_{a}\) are in percent, and \(s\) = 0.144 for \(B\), \(s\) = 0.089 for \(V_{sw}\), and \(s\) = 0.242 for \(BV_{sw}^{1.76}\).
Panel d of Figure 15 shows that the error in \([F_{s}]_{IMF}\) is only quasi-linear with \(d_{a}\) for \(d_{a} {\geq} \) 50% and that \(s\) is relatively large (0.440) even for that range of \(d_{a}\).
In this paper, Equation 6 is not used because the value for the CR in question is always used. Nevertheless, this equation does provide a rapid away of computing an estimate of the error caused by missing data.
Panel d of Figure 15 is used in the present article to set a limit to the allowed errors in the OSF estimates. We only use data for which \({\xi} {\leq} 20{\%}\), which generally requires \(d_{a}\) exceeding 50%.
1.2 A.2 Effect of Averaging Timescale on OSF Estimates from IMF Data
Figure 16 shows the effect of the averaging timescale \({\tau}\) (before the absolute value is taken) on the \([F_{s}]_{IMF}\) estimate from Equation 3. In each panel, the vertical grey band marks where the difference between \([F_{s}]_{IMF}\) and \([F_{s}]_{strahl}\) is not significantly different from the value for \({\tau}\) = 20 h at the \(2{\sigma}\) level, computed using Welch’s t-test (Welch, 1947). Panel a shows that the correlation \(r\) of \([F_{s}]_{IMF}\) with \([F_{s}]_{strahl}\) peaks at \({\tau}\) = 20 h, but it is a flat peak, and so values around 20 h do not give a significantly lower correlation. However, panel b shows it gives a better-defined minimum in the r.m.s. difference \({\Delta}_{rms}\) between the two. Panel c shows the slope \(s\) of linear regressions of \([F_{s}]_{IMF}\) against \([F_{s}]_{strahl}\). It can be seen that \({\tau}\) = 20 h gives an \(s\) of 0.986, slightly lower than the ideal value of unity, a value that is only achieved at \({\tau}\) = 38 h, for which \(r\) is significantly lower and \({\Delta}_{rms}\) is significantly higher. However, the intercept of the regression \(c\) is very close indeed to the ideal value of zero at \({\tau}\) = 20 h. Thus \([F_{s}]_{IMF}\) is proportional to \([F_{s}]_{strahl}\), and so \([F_{s}]_{IMF}\) for \({\tau}\) = 20 h can be corrected for the slightly low \(s\) by multiplying by \(1/0.968 = 1.014\).
1.3 A.3 Solar Rotation Periods Detected at 1AU in Interplanetary and Geomagnetic Data
The period of heliospheric rotation at \(r = R_{AU}\) can be measured from the peak near 27 days in the autocorrelation functions (a.c.f.s) of interplanetary or geomagnetic parameters. Figure 17c shows that the peak of the a.c.f. of the radial IMF \(B_{r}\) is at just 2.6 hours shorter than the nominal CR rotation interval. Given that \(B_{r}\) is dominated by (and changes polarity with) the interplanetary sector structure, this gives a good estimate of how the low-latitude heliospheric sector structure rotates on average. The solar wind speed a.c.f. shown in Figure 17b peaks within 1 h of this estimate, indicating that the streamer belt and coronal holes that give fast and slow solar wind, respectively, also rotate with essentially the CR period on average.
Panel a of Figure 17 shows the a.c.f. of the aaH index. This a.c.f. reveals an additional diurnal variation, which, obviously, is not seen in interplanetary space. This could have arisen from a local time response of the stations, but that possibility is eliminated by the fact that the diurnal variations in the Northern and Southern Hemisphere sub-indices, aaHN and aaHS, are in phase, despite the stations being close to 180∘ apart in longitude. Instead, this demonstrates the Universal Time variation in solar wind-magnetosphere coupling discussed by Lockwood, Owens, and Barnard (2023), Lockwood and Milan (2023), and Lockwood (2023). This diurnal variation contribution to the a.c.f. for aaH peaks at whole numbers of days and so shifts the peak of the overall a.c.f.s for geomagnetic indices to the nearest whole number of days to the CR peak, which is 27 days. Hence the diurnal variation in solar wind-magnetosphere coupling (caused by the eccentric nature of the Earth’s main dipole field) is the reason why geomagnetic phenomena are organised by Bartels intervals of exactly 27 days, whereas the driving coronal and heliospheric phenomena are organised by the Carrington rotation intervals of 27.2753 days.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lockwood, M., Owens, M. Reconstruction of Carrington Rotation Means of Open Solar Flux over the Past 154 Years. Sol Phys 299, 28 (2024). https://doi.org/10.1007/s11207-024-02268-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11207-024-02268-0