Out-of-Sample Evaluation of Moment-Based Utility Portfolios

# How to compare mean-variance-skewness-kurtosis portfolios obtained by expected utility maximization?


# How to compare mean-variance-skewness-kurtosis portfolios obtained by expected utility maximization?












Suppose I have some portfolios which are the result of maximizing the expected utility of different approximations of a utility function, how do you test these portfolio's out-of-sample and how do you compare these results?

More specifically, I am trying to compare the MV (mean-variance), MVS (mean-variance-skewness) and MVSK (mean-variance-skewness-kurtosis) portfolio's for a same set of assets, based on the CARA utility function. I maximized these three equations and for each I have a maximum expected utility and the solution in the form of a set of weights. So I now have three different portfolios, and these are based on the same sample set of 4 years (edit: 4 years of daily returns). Can I now test these portfolio's on a fifth year (one out-of-sample year, following the four year sample set) and compare some characteristics? If so which characteristics should I compare? Can you compare achieved utility, or is this not the right intention?

Edit: Some clarifications:

The fourth-order approximation of the expected value of the utility function is as follows:

$E[U(W)] \approx U(\bar{W})+\frac{1}{2} U^{(2)}(\bar{W}) \sigma_{p}^{2}+\frac{1}{3 !} U^{(3)}(\bar{W}) s_{p}^{3}+\frac{1}{4 !} U^{(4)}(\bar{W}) \kappa_{p}^{4}$

where $U(W)$ is the utility function, $\bar{W}$ is the expected wealth, and $\sigma_{p}^{2}, s_{p}^{3}$ and $\kappa_{p}^{4}$ are the portfolio variance, skewness and kurtosis.

The utility function I am using is the CARA utility function,

$U(W)=-\exp (-\gamma W)$,

where $\gamma$ represents the constant risk aversion coefficient.

This results in the following equation,

$E[U(W)] \approx-\exp \left(-\gamma \mu_{p}\right)\left[1+\frac{\gamma^{2}}{2} \sigma_{p}+\frac{\gamma^{3}}{3 !} s_{p}^{3}+\frac{\gamma^{4}}{4 !} \kappa_{p}^{4}\right]$,

which is our objective function to maximiz, in case of MVSK. If we consider MV, we drop the last two terms of the second operand of the last equation. For MVS, we only drop the last term.

These moments are represented by $\begin{aligned} \mu_{p} &=\omega^{\prime} \mu \\ \sigma_{p}^{2} &=\omega^{\prime} \mathrm{M}_{2} \omega \\ s_{p}^{3} &=\omega^{\prime} \mathrm{M}_{3}(\omega \otimes \omega) \\ \kappa_{p}^{4} &=\omega^{\prime} \mathrm{M}_{4}(\omega \otimes \omega \otimes \omega) \end{aligned}$ where $\mathrm{M}_{i}$ represents the i'th matricized cumulant tensor, so for $i = 2$ this is the covariance matrix, for $i = 3$ the matricized coskewness tensor and for $i = 4$ the matricized cokurtosis tensor. With matricization of a tensor, the frontal slices of the tensor are placed sidewise, so for $i = n$ we get an $n \times n^{(i-1)}$ matrix.

Concerning the optimization, it can be solved by using multiple attempts of SLSQP. Although we are not guaranteed a global optimum, I have found that this works rather well, as most tries find the same optimum.

Now, whether or not we find a global optimum for the MVS and MVSK optimizations, I still do not get how to compare my resulting portfolios. As Pontus Hultkrantz mentioned, utility should b-e my measure of performance out of sample, but how do I measure realised utility?

I should also note that the moment tensors are being approximated. My research objective is to show that these approximations are adequate enough to be used in this application.

Thanks

## Answer by Kermittfrog (score 3)

https://quant.stackexchange.com/a/59663

I want to add two comments to this.

1. Empirical utility-based-optimization and moments

I would argue that comparing different degrees of a Taylor approximated utility optimization (a.k.a. a moment based model with two, three, four, ..., infinite moments) adds additional assumptions to your model when working with an asset universe whose statistics are not under your control, i.e. when using empirical asset returns.

With a full-utility-function mean-variance optimization, you are not only identifying an (ex-post) mean-variance optimal portfolio under some strong assumptions regarding the iid-ness of your data, but also under the assumption that the asset universe is well represented by its (pairwise) first two moments. This is reconciled by restricting the utility function to be quadratic as well, though. As you then begin to add moments, you introduce additional implicit assumptions regarding the existence and stability of higher moments of the (unobservable) data generating process (DGP).

Let me put it yet differently: Performing statistical tests on some utility-based optimal portfolios could be re-interpreted as some (most probably quite weak) joint test of the assumptions for your DGP i.e. its mean, variance, skew, kurt, higher moments.

2. Comparing across utility functions Say that we have now successfully identified $N$ utility-based optimal portfolios under $N$ different utility functions, say quadratic, cubic, quartic, ... You can then analyse realised utility (or the certainty equivalents), but you cannot compare realised utilities across utility functions. What you can do is to compare the realised utilities of a given utility function, say quadratic, across the portfolios and see which performed best. The real deal is of course to plug your estimated portfolios into the full utility function and compare those, but keep my comments under 1. above in mind.

## Answer by Pontus Hultkrantz (score 1)

https://quant.stackexchange.com/a/59657

If utility is your measure of performance, then it will still be your measure of performance out of sample, since it is what you care about. You can see utility as a measure of the balance between profit and risk, where risk is some combination of variance, skew, kurtosis...

Your wealth is a random variable $X$ that can be described by its moments. First moment is related to the mean, second moment related to variance, third moment related to skew, fourth moment related to kurtosis.

If you do a Taylor expansion of your utility function, and taking expectation, you will see that it can be written in terms of its moments. So the choice of utility function dictates how you look at risk, is it only variance or also higher moments?

In Mean-Variance, you risk is the variance, since skew and kurtosis are all zero (normal distribution assumption). If the distribution is not normal, then a very negative skew might cause extreme losses for you, which you want to avoid, and hence include in your utility. So in Mean-Variance, you ignore any moment higher than 2nd, in Mean-Variance-Skew you ignore moments higher than 3rd, in Mean-Variance-Skew-Kurt you ignore any moments higher than 4th.

Edit: By definition, the portfolio that was found using a cost function that best approximate your utility function will on expectation be best.

So when you evaluate your portfolios OOS, you just plug in the final wealth $\mathcal{U}(W_T) = -e^{\gamma W_T}$ (no need to make it "Taylor-made"). So the problem is now that you only observe a single observation, hence a single utility value. So how can you estimate the expected utility? If you care about monthly utility, then you can obviously split the 1Y into 12 months and get 12 observations. Else, you can do some kind of resampling of the data, see for instance two common resampling procedures But you would also have the same problem with finite samples for your in sample data set, so I am not sure how you solved that?