Approximating Expected Volatility in GARCH and Stochastic Volatility Models
Summary
The document asks whether the expected conditional volatility in a standard GARCH(1,1) model can be derived analytically. It notes that the stationary mean of conditional variance has a simple expression, while the mean of its square root is harder to obtain. One answer expands the square root around the known mean variance. The first-order term vanishes after taking expectations, yielding a second-order approximation that also uses the variance of conditional variance.
The approximation has a remainder whose size is uncertain. The answer cautions that higher moments may fail to exist under some parameter conditions, which can undermine a Taylor expansion, and recommends simulation to assess accuracy for particular parameters. A second answer distinguishes GARCH’s predictable conditional variance from a stochastic volatility model’s random volatility state, then derives a lognormal mean for a simple stationary stochastic volatility specification. These results depend on model assumptions and stationarity; the discussion supplies no numerical validation of the approximation.
Key ideas
- The mean of GARCH conditional variance is easier to obtain than the mean of conditional volatility.
- A second-order Taylor expansion gives an approximation using the mean and variance of conditional variance.
- The approximation depends on a small remainder and may be unreliable when higher moments do not exist.
- Simulation can check approximation quality for chosen parameter values.
- A stationary lognormal volatility state in a simple stochastic volatility model has an analytically available mean.
Tags
Full text
# GARCH model, expectation of volatility?
# GARCH model, expectation of volatility?
Consider a time series $\{r_t\}$ following a standard GARCH(1,1) model, i.e., $$ r_t = \sigma_t \epsilon_t,$$ where $\epsilon_t \sim N(0,1)$ and are i.i.d, and $$\sigma_t^2 = \omega + \alpha_1 r_{t-1}^2 + \beta_1 \sigma_{t-1}^2, $$ where $\omega, \alpha_1, \beta_1$ are constant.
My question is: can we derive analytically the expectation of the random variable $\sigma_t$ for a given $t$, i.e., $\mathbb{E}(\sigma_t)$?
It is easy to derive $\mathbb{E}(\sigma_t^2) = \frac{\omega}{1-\alpha_1 - \beta_1}$, assuming $\mathbb{E}(\sigma_t^2)$ is constant over time, but I did not find any result on $\mathbb{E}(\sigma_t)$?
## Answer by Colin T Bowers (score 3)
https://quant.stackexchange.com/a/19047
You can see fairly quickly that an exact answer to this question is not going to be feasible because your functional transformation is to take the square root of $\sigma_t^2$, and the square root function has a countably infinite number of derivatives. This implies that a Taylor expansion is going to leave us with a countably infinite number of terms, most of which won't vanish.
So is all hope lost? No. Interestingly enough, for an appropriate choice of constant to expand around, the first order term in the Taylor expansion drops out, and the second term is known, so we can get a fairly good approximation.
Specifically, define $c_0 = \mathbb{E} \sigma_t^2$, which, as you point out in the question, is a known quantity. Note also that $\mathbb{V} \sigma_t^2$ is a known quantity (it is a reasonably complicated function of the parameters of the GARCH model - I can't remember the reference off the top of my head but you should be able to google it fairly easily). Using Taylor's theorem, we have:
\begin{equation} \sigma_t = \sqrt{c_0} + \frac{1}{2} c_0^{-\frac{1}{2}}(\sigma_t^2 - c_0) - \frac{1}{8} c_0^{\frac{-3}{2}}(\sigma_t^2 - c_0)^2 + R \end{equation}
where $R$ is the remainder term from the expansion. Taking expectations of both sides, you can see immediately that the first order term is going to vanish, since we will get $(\mathbb{E} \sigma_t^2 - c_0)$ which by definition of $c_0$ will equal zero. Further, note the bracketed portion of the second order term will become $\mathbb{E} (\sigma_t^2 - c_0)^2$ which again, given our initial choice of $c_0$, will simplify to $\mathbb{V} \sigma_t^2$. Thus, assuming that $\mathbb{E} R$ is small, we have:
\begin{equation} \mathbb{E} \sigma_t \approx \sqrt{\mathbb{E} \sigma_t^2} - \frac{1}{8} (\mathbb{E} \sigma_t^2)^{\frac{-3}{2}} (\mathbb{V} \sigma_t^2) \end{equation}
As I said before, $\mathbb{E} \sigma_t^2$ and $\mathbb{V} \sigma_t^2$ are both known expressions w.r.t. to the parameters of the model, and so the right hand side of this equation is known (albeit it would be very messy if I wrote it out with all the parameters from a GARCH model).
So how good is the above approximation? Initially I was tempted to suggest that it might be quite good (I was short on time and it seemed an easy way to tie off the answer). However, the comment made by @ZacharyBlumenfeld is a good one, and now I'm not so sure.
There are many factors at play here, some promising, and some not.
1) The series has alternating signs, i.e. $x_1 + x_2 - x_3 + x_4 - x_5 + ...$. This is good, as the conditions for a series with alternating signs to converge are much weaker than for a series with the same sign.
2) The Taylor coefficients get small quite quickly. They go up in the factorial, i.e. $\frac{1}{2!}, \frac{1}{3!}, \frac{1}{4!}$.
3) If $\omega > 1 - \alpha - \beta$, then $c_0 > 1$ and so $c_0^{k}$ gets small quickly as $k \rightarrow -\infty$. This is good. However, note that if $\omega < 1 - \alpha - \beta$ we get the opposite effect, which would be bad. So the parameters of the model matter.
4) We have moments of $\sigma_t^2$ increasing as the terms increase. This is the one that worries me the most. I'm fairly sure I read a paper a while back on laws of large numbers for GARCH processes that shows that under quite reasonable conditions, higher moments of $\sigma_t^2$ may not exist, i.e. are infinite. This would be very bad for our approximation.
If this question is really important to you, I would recommend leveraging the wonderful amount of computing power we have these days and running some simulations for different input parameter values and seeing how good the above approximation really is. Feel free to report back here with your findings!
Cheers, hope this helps.
-colin
## Answer by Zachary Blumenfeld (score 0)
https://quant.stackexchange.com/a/19032
"conditional volatilities from GARCH models are not stochastic since at time $t$ the volatility is completely pre-determined (deterministic) given previous values"-https://en.wikipedia.org/wiki/Stochastic_volatility
$\sigma_t$ is still a random variable in the sense that it has an unconditional distribution. However, this unconditional distribution is not known in full parametric form (all we know is it's first two moments). As such the GARCH model is not really built to answer the types of questions your interested in like $E[\sigma_t]$, $\mathrm{VAR}[\sigma_t]$, etc. You can approximate these values using calculus which is what @ColinTBrowns does below...but that can get messy.
A class of model better suited to answer your question is the stochastic volatility (SV) model. For example, a simple SV model goes something like
$$ r_t=\varepsilon_t\sigma_t,\;\;\sigma_t=e^{h_t/2}$$ $$ h_t=\alpha_0+\alpha_1h_{t-1}+v_t $$
$$ \varepsilon_t\stackrel{iid}{\sim}N(0,1),\;\;v_t\stackrel{iid}{\sim}N(0,w^2) $$
Assuming $h_t$ is stationary its unconditional distribution is $h_t \sim N \bigg(\frac{\alpha_0}{1-\alpha_1},\frac{w^2}{1-\alpha_1^2} \bigg)$ so $\sigma_t$ is log normally distributed $$ \sigma_t \sim LN \bigg(\frac{\alpha_0}{2(1-\alpha_1)},\frac{w^2}{4(1-\alpha_1^2)} \bigg) $$ Thus $$ E[\sigma_t]=exp\bigg(\frac{\alpha_0}{2(1-\alpha_1)}-\frac{w^2}{2(1-\alpha_1^2)} \bigg) $$ See the Wikipedia pg for the log-normal distribution if the last step is hard to follow (i.e. it comes from the formula of the mean for a log-normal)
Long story short, if you are interested in the statistical properties of the underlying volatility states, it's better to use a model that treats those states as stochastic variables. There are also a lot more SV models to choose from in addition to the one used in this example.Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)
This summary was written by Stratmill's research agent from the original; it is not a copy of the source.