Skip to content
All library documents

Updating ARIMA Forecasts as New Observations Arrive

Article Quant Q&A · Author: Ericcheng

Summary

The document discusses how to update a one-step-ahead ARIMA forecast after a new observation arrives. It outlines several choices: refit the model parameters while keeping the selected orders fixed, repeat model selection as well as estimation, keep parameters unchanged, or use a rolling window that drops older observations. A Kalman filter is also mentioned as a natural sequential updating approach.

The answers explain that the choice depends on assumptions and practical constraints. If ARIMA is treated as the true data-generating process, repeated selection and estimation can improve forecasts asymptotically. If the model is only an approximation and structural change is a concern, recent data may warrant replacing old observations and re-estimating. The discussion offers no empirical comparison or universal rule; computational cost, data volume, and model complexity influence how frequently to refit.

Key ideas

  • Updating parameters with each new observation is one possible forecasting protocol.
  • A fixed rolling window can emphasize recent data when structural change is a concern.
  • Model selection can be repeated alongside parameter estimation, though it may be computationally costly.
  • A Kalman filter provides a sequential approach to updating estimates and forecasts.
  • The suitable update procedure depends on model assumptions and practical constraints.

Tags

Full text
# Updated Time Series Prediction Model When acquiring new data Points - Basic Question


# Updated Time Series Prediction Model When acquiring new data Points - Basic Question












Suppose I have a Time Series Model (assume ARIMA) and use it to make one-step ahead prediction.

If I acquire a new data point, (for example I was originally using the first 100 days to fit an Arima model to predict 101st day, now I observe the data of 101st day and want to use 101 days of data to predict the 102nd day), Should I?

- Refit everything, including mega parameters $p,d,q$?

- Let $p,d,q$ remain what it is, but refit the coefficient of the ARIMA model?

- Or if there's other protocol when we face this kind of problem?

I am relatively new to this area so any advice, insights and suggestions will be appreciated. Thanks.

## Answer by Stéphane (score 1)

https://quant.stackexchange.com/a/51361

Think about it this way.

If you believe that the data generating process is in fact an ARIMA model, you have a very clear prescription: if you perform both model selection AND estimation anew, basic asymptotics would show that you will reduce your forecasting error.

Now, what happens if you aren't crazy and you know the model is false, though potentially useful? If you fear structural changes, you would be wise to drop the first observation, add the last one and at least re-estimate model parameters if not also perform model selection anew.

The real constraint here with regards to estimate and model selection is that it is computationally intensive. There is little statistical reason to not take new information into account. Now, if you are backtesting ARIMA models to forecast a handful of variables for a handful of horizons, even a cheap laptop is likely to be able to re-doing everything systematically. But, if you deal with heaps of data and complicated models, you have to impose constraints somewhere.

## Answer by mark leeds (score 0)

https://quant.stackexchange.com/a/51359

Hi: What you describe is a pretty common problem when estimating time-series models and predicting based off of them. I don't think there's oner answer but rather choices like you mentioned and others.

1) use some fixed rolling window of observations to re-restimate the same model and then predict the next value.

2) use all previous observations + new data point to re-estimate the same model and predict the next value.

3) don't re-estimate at all but use the new observation for prediction of the next value.

4) use a kalman filter to re-estimate and predict the next value which is the same as 2) but it's the more "natural" way of doing it since KF is an updating mechanism.

I don't think model choice is generally re-done when a new data point comes in but that's also possible of course. Like I said, there's not one answer.

Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)

This summary was written by Stratmill's research agent from the original; it is not a copy of the source.