Why Sample Covariance Estimates Can Destabilize Portfolios
Summary
The document explains why a sample variance-covariance matrix may predict future stock-return risk poorly and destabilize mean-variance portfolio choices. With finite data, each estimated covariance is uncertain; when the number of assets is large relative to the observations, estimating every pair independently creates many noisy inputs. The cited discussion notes that plausible estimation errors can lead to markedly different optimized portfolios, even without long-term economic change.
It describes structured alternatives, including Bayes-Stein estimation and factor models, which constrain how the covariance matrix is estimated. Resampled efficient frontiers are presented as a way to illustrate how portfolio solutions vary when estimated inputs are perturbed. A second response adds that volatilities and correlations can shift with market conditions and suggests implied parameters when available. These approaches do not remove uncertainty: the document offers references and intuition, not a comparative empirical test or a universally best estimator.
Key ideas
- Finite samples make covariance estimates uncertain.
- Estimating many asset pairs from limited observations can produce noisy risk inputs.
- Small plausible changes in estimated inputs may lead to substantially different optimized portfolios.
- Bayes-Stein estimation and factor models impose structure on covariance estimation.
- Covariances can also change as economic and market conditions evolve.
Tags
Full text
# Explanations regarding Minimum Variance Portfolio # Explanations regarding Minimum Variance Portfolio I am sorry in advance if this question seems a bit stupid but during my class my lecturer said that: "The traditional estimator of the variance-covariance matrix is the sample covariance. However variance- covariance matrices computed in this way display poor out-of-sample performances, i.e. their predictive power regarding the future variances and covariances of stock returns is generally small." Do you have any idea what may have led him to affirm that ? Thank you for your help Kindest Regards ## Answer by nbbo2 (score 2, accepted) https://quant.stackexchange.com/a/33323 Unless you have an infinite amount of data any estimator only provides an "estimate" (an approximate measurement) of any parameter (such as covariances). For the Markowitz Problem, the seriousness of the issue was realized as soon as 1974: Barry, C.B. "Portfolio Analysis under Uncertain Means, Variances and Covariances",Journal of Finance, 1974. The problem arises because the number of covariances to be estimated tends to be large compared to the number of observations available (for example with 500 stocks you have 125,250 covariances to be estimated, but since 1929 there have only been 1056 months of stock market data). As a result each element of the estimated matrix is highly uncertain (this can be shown theoretically as well as empirically). Two somewhat more recent references on this problem are Broadie “Computing Efficient Frontiers with Estimated Parameters”, Annals of Operations Research, 1993 and Chopra and Ziemba "The Effects of Errors in Means, Variances and Covariances on Optimal Portfolio Choice", Journal of Portfolio Management, 1993. In a word, the effect is drastic, with very different optimal portfolios found if the inputs vary a plausible amount. A technique called the Resampled Frontier by Michaud can be used to illustrate the problem by solving the Markowitz problem over and over with the covariance matrix perturbed at random by a judicious amount. Attempts have been made to come up with alternatives to the "traditional estimator". The main one is the Bayes Stein estimator Jorion "Bayes-Stein Estimation for Portfolio Analysis", Journal of Financial and Quantitative Analysis, September 1986. There are also Factor Models of the covariance. All these solutions attempt to impose some structure on the covariance matrix instead of attempting to estimate each entry independently. In addition to this, there is also the problem mentioned by Eduardo that the covariance matrix may change due to changes in the economy. But the "estmation problem" for large covariance matrices is serious even in the absence of long term economic changes. ## Answer by Eduardo (score 0) https://quant.stackexchange.com/a/33322 Variance-Covariance matrices are too unstable - whatever happened last year will change going forward (correlations, volatilities, etc). It's better to use implied parameters (if available) to build the covariance matrix. And even so you may imply different parameters on different days, depending on market conditions.
Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)
This summary was written by Stratmill's research agent from the original; it is not a copy of the source.