Skip to content
All library documents

Market Anomalies, Factor Replication, and Multiple-Testing Hurdles

Article Quant Q&A · Author: Quantopik

Summary

The document seeks a broad inventory of reported market anomalies and points to research catalogs covering many proposed return factors. It highlights a study that frames the large number of factor discoveries as a multiple-testing problem, arguing that conventional significance thresholds can overstate evidence when researchers test many hypotheses and publication bias is present. The cited work proposes higher standards for evaluating newly claimed factors.

It also summarizes a replication study of hundreds of U.S. stock anomalies. According to the excerpt, many results weaken when microcaps have less influence, returns are value-weighted, and stricter significance thresholds account for data snooping; even anomalies that replicate may have smaller economic effects than first reported. These findings caution against treating published factors as robust trading opportunities. The document does not provide a complete anomaly list or assess each factor individually, and the reported replication conclusions depend on sample and testing choices. It also points readers to an external factor catalog for further exploration.

Key ideas

  • Large collections of published return factors make multiple testing and data mining central concerns.
  • Conventional significance thresholds may be too permissive when many candidate factors have been tested.
  • Replication results can change when microcaps receive less weight and returns are value-weighted.
  • The cited replication study reports that many anomalies fail stricter statistical tests and that surviving effects may be smaller.
  • A factor catalog can help survey reported anomalies, but publication alone does not establish a tradable edge.

Tags

Full text
# What are the main market anomalies/inefficiencies detected in quantitative finance?


# What are the main market anomalies/inefficiencies detected in quantitative finance?












I wondered about the existence of a complete list of the anomalies detected in quantitative finance.

Generally, a market anomaly or inefficiency is a asset price and/or rate of return distortion on a financial market that actually contradicts the efficient-market hypothesis, as conceived by Fama's (1970) seminal paper.

Can you provide a list of them by posting the references of the relative books or papers?

Possibly, it would be greatly appreciated that you post the seminal paper reference, as, for instance, Basu (1977) in the case of the size effect or Thaler (1987) for the January effect.

I do not care about if they disappeared or not, but, instead, I'm interested to construct a full complete list of them.

Any help or suggestion will be appreciated.

NOTE: I will update a list every time I find something new or a user post an answer with a new anomaly, in order to maintain the list updated.

## Answer by vonjd (score 9, accepted)

https://quant.stackexchange.com/a/18187

The best overview I have seen so far is this paper which lists 214 (!) factors (or anomalies if you like) on over one hundred (!) pages:

Harvey, Campbell R. and Liu, Yan and Zhu, Caroline, …and the Cross-Section of Expected Returns (February 3, 2015). Available at SSRN: https://ssrn.com/abstract=2249314 or http://dx.doi.org/10.2139/ssrn.2249314

Abstract:

> Hundreds of papers and hundreds of factors attempt to explain the cross-section of expected returns. Given this extensive data mining, it does not make any economic or statistical sense to use the usual significance criteria for a newly discovered factor, e.g., a t-ratio greater than 2.0. However, what hurdle should be used for current research? Our paper introduces a multiple testing framework and provides a time series of historical significance cutoffs from the first empirical tests in 1967 to today. Our new method allows for correlation among the tests as well as publication bias. We also project forward 20 years assuming the rate of factor production remains similar to the experience of the last few years. The estimation of our model suggests that today a newly discovered factor needs to clear a much higher hurdle, with a t-ratio greater than 3.0. Echoing a recent disturbing conclusion in the medical literature, we argue that most claimed research findings in financial economics are likely false.

EDIT The authors now provide a datasheet with an exhaustive overview of all factors: https://tinyurl.com/y23ozzkc

The following chart is taken from the paper and summarizes its key results:

EDIT A new record! The following new paper lists and tests 452 (!) anomalies on more than 130 pages:

Hou, Kewei and Xue, Chen and Zhang, Lu, Replicating Anomalies (October 2018). Review of Financial Studies, forthcoming; Fisher College of Business Working Paper No. 2017-03-010; Charles A. Dice Center Working Paper No. 2017-10. Available at SSRN: https://ssrn.com/abstract=3275496

It indicates "that most published U.S. stock market anomalies are not replicable after reasonably demoting microcaps to a very minor role, and especially after raising the threshold for significance to account for data snooping." Source and summary of the paper (behind a paywall): https://www.cxoadvisory.com/29802/big-ideas/most-stock-anomalies-fake-news/

Abstract

> Most anomalies fail to hold up to currently acceptable standards for empirical finance. With microcaps mitigated via NYSE breakpoints and value-weighted returns, 65% of the 452 anomalies in our data library, including 96% of the trading frictions category, cannot clear the single test hurdle of the absolute t-value of 1.96. Imposing the higher, multiple test hurdle of 2.78 at the 5% significance level raises the failure rate to 82.1%. Even for the replicated anomalies, their economic magnitudes are much smaller than originally reported. In all, capital markets are more efficient than previously recognized.

## Answer by nbbo2 (score 5)

https://quant.stackexchange.com/a/18189

You have started a huge job, an enormous number of anomalies have been reported. The web site quantpedia.com has a list, here for example is their writeup on momentum effect in stocks

Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)

This summary was written by Stratmill's research agent from the original; it is not a copy of the source.