Skip to content
All library documents

Why Mean-Variance Optimization Produces Unstable Corner Portfolios

Article Quant Q&A · Author: develarist

Summary

The document explains why mean-variance optimization can assign nearly all capital to one asset as the asset universe grows. Its account centers on covariance structure: many assets share a small number of meaningful risk factors, leaving other variance directions with very small eigenvalues. Inverting the covariance matrix amplifies those directions, making estimated optimal weights highly sensitive to small changes in the inputs.

When assets appear similar in risk and correlation, the optimizer may treat them as interchangeable and favor whichever has the highest estimated return, producing a corner allocation. Such allocations can change dramatically when the covariance estimate changes. The answer gives an intuitive linear algebra explanation and notes that remedies exist, but does not describe them or compare their effectiveness. It also does not present a dataset or empirical test, so the account is a conceptual diagnosis rather than evidence that every large-universe optimization will behave this way.

Key ideas

  • Mean-variance weights depend on the inverse of the estimated covariance matrix.
  • Small covariance eigenvalues can make the inverse and resulting weights sensitive to estimation changes.
  • Assets with similar risk and correlation profiles may appear interchangeable to the optimizer.
  • The optimizer can concentrate on the asset with the highest estimated return among such assets.
  • Corner allocations may shift sharply when covariance estimates change.

Tags

Full text
# Why does the likelihood of corner solutions in portfolios increase as the number of assets grows?


# Why does the likelihood of corner solutions in portfolios increase as the number of assets grows?












A three- asset portfolio doesn't seem prone to generating corner solutions, which are very high allocations to one of the assets and $0$ to the others. Instead, when the number of assets is low, these small portfolios are fairly diversified

When the number of assets grows, however, the problem of corner solutions becomes more apparent since, even when optimizing 50 assets, it is not uncommon to find only 1 out of those 50 being given a weight of $100%$ by the mean-variance model, while the other 49 get $0$.

What explains this massive leap in the mean-variance model's pumping out of corner solutions when $N$ is very large? And am I right to view this as a bad thing since corner solutions imply overconcentration/lack of diversification

## Answer by vanguard2k (score 4)

https://quant.stackexchange.com/a/58315

The source of the problem is twofold:

- Dimensionality of variance directions is low (most directions have close to 0 variance)

- Portfolio Optimization is prone to an unstable covariance matrix (which almost always is the case)

And now I will try to explain what that means in more detail and then sum it up in a simple, intuitive statement:

- If you have a variance covariance matrix $\Sigma$, linear algebra lets us find a basis transformation to other assets that are now uncorrelated. $\Sigma = E^{'} \Lambda E$. $\Lambda$ is then a diagonal matrix with its diagonal being the variances of the uncorrelated portfolios - also called the eigenvaleus $\lambda_i$. In theory, the idea is to switch from your correlated assets into these uncorrelated portfolios, do all analysis/optimization there and then transform back. In practice, when the number of assets is higher (think of a stock index for example), only the first few variances $\lambda_i^{1/2}$ show a meaningful difference from 0. Those represent the more meaningful market factors theses stocks share. These are usually somewhere between 2 and 7 or so. These eigenvalues correspond to "dimensions of variance", meaning all other directions of variance are negligible in comparison. From this, you might already suspect that this fact could translate back into the asset space somehow.

- The basic solution of the unconstrained portfolio optimization problem is $w^{*} \approx \Sigma^{-1} \mu$, where $\approx$ means up to a constant which I have forgotten right now. The important part is the $\Sigma^{-1}$. If we remember the eigenvalue decomposition from before, almost all $\lambda_i$ were close to 0. We know that $\Lambda_i^{-1}$ is obtained by inverting the diagonal elements, $\lambda_i^{-1}$. If the $\lambda_i$ are close to $0$, your $\Sigma^{-1}$ will change a lot if one $\lambda_i$ changes. Therefore, your optimal asset weights $w_i^{*}$ will change a lot.

So, for these two reasons, many of your assets will have similar risk and correlation profiles, making them interchangeable from an optimizers point of view. If they are interchangeable in both variance and correlation aspects, the optimization problem is easy: Put everything into the asset with the highest return. This is why you obtain lots of corner solutions.

My second point however shows, that these corner solutions are usually not stable at all. The second the $\Sigma$ changes a little bit, the corner solution can change completely.

There are plenty of means around this, but they would be beyond the scope of this answer.

Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)

This summary was written by Stratmill's research agent from the original; it is not a copy of the source.