Why White’s Reality Check Tests the Best Strategy

Summary

The document asks why White’s Bootstrap Reality Check (BRC) evaluates the best-performing strategy in a group. It proposes applying the same procedure to the second-best strategy, then to lower-ranked strategies, by comparing each strategy’s scaled mean performance with a bootstrap distribution to obtain a p-value.

The text does not provide an answer, derivation, or empirical evidence. It is a question about how to interpret and extend a multiple-strategy significance test, rather than a complete method. Any conclusion about testing additional ranked strategies would need to account for how selection and repeated comparisons affect statistical inference; those issues are not resolved in the document.

Key ideas

• The document asks why the Bootstrap Reality Check focuses on the best strategy in a tested set.
• It proposes comparing lower-ranked strategies with a bootstrap distribution as well.
• It does not explain whether those additional comparisons yield valid significance tests.

Tags

# Bootstrap Reality Check - Why does it only assess the best trading strategy?


# Bootstrap Reality Check - Why does it only assess the best trading strategy?












I wonder why White's BRC only determines whether the best trading strategy is statistically profitable.

What prevents us from comparing the average V of the second best strategy (i.e. square root of the number of observation multiplied by the mean of the strategy) and comparing it with the distribution obtained by using White to obtain the pvalue (just as we do with the best strategy)? Similarly, why can't we do the same with the third best strategy, and so on?

Thanks

Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)

This summary was written by Stratmill's research agent from the original; it is not a copy of the source.