Skip to main content Skip to navigation

Physics Department News

Show all news items

An improved Bayesian algorithm for modelling time series with long memory and heavy tails

It has long been known that for many processes, the likelihood of encountering an extreme event, or sequence of large events, is in fact much larger than would be expected from the statistics we are familiar with. Examples range from fluctuations in financial markets, to the height of the river Nile, to explosive solar flares releasing energy from the Sun. These processes are connected by the mathematics used to describe them: some are examples of long-range dependent time series, meaning that the value of the process in the far past has a tangible effect on its value in the future, allowing long correlated “runs” of values to occur; others exemplify heavy-tailed time series, where values which would be rare in a Gaussian distribution are seen much more often.

 

These two mechanisms were named by Mandelbrot as the ‘"Joseph"’ and "‘Noah"’ effects. The "‘Joseph’" effect is named after the Biblical character’'s prediction of seven years of good harvests and seven years of bad, i.e. increased likelihood of sequential values being similar. The "‘Noah"’ effect captures the occurrence of dramatic extreme events, which while rare can dominate the action of the process (for example, the extreme rainfall that caused Noah’'s flood). Each of these effects is described by a parameter in the heavy-tailed ARFIMA model; these parameters must be accurately determined to effectively model the process, in particular its extreme behaviour.

 

Our algorithm uses a Bayesian approach to estimate both parameters simultaneously. This approach is both more general and computationally “"better value"” than past algorithms, which estimate the two parameters separately. We first test the accuracy of the algorithm using synthetic data, randomly generated from known ARFIMA models, then apply it to solar X-ray data from NASA’s Geostationary Operational Environmental System (GOES) satellites. Our results suggest that a heavy-tailed ARFIMA model is appropriate for the solar flare time series.

  • Caption to Figures: An image of the M-class solar flare that occurred on 2nd October 2014, captured by NASA's SDO spacecraft. Credit to NASA/Goddard/SDO, image available under a Creative Commons Attribution 2.0 Generic License.
  • Publication: Graves, T., C.L.E. Franzke, N.W. Watkins, R.B Gramacy, and E. Tindale (2017), Systematic inference of the long-range dependence and heavy-tail distribution parameters of ARFIMA models, Physica A, 473, pp. 60-71
  • DOI: 10.1016/j.physa.2017.01.028
Tue 17 Jan 2017, 16:04 | Tags: Research