Open Research Problems in Quantitative Finance
Summary
The document surveys several active research questions in quantitative finance. It highlights the transition from interbank offered rates to replacement overnight reference rates, which requires new or adapted pricing and risk models despite limited calibration data. It also describes concerns about reproducibility in empirical asset pricing: reported factors and anomalies may fail in longer samples or other markets, motivating stronger statistical tests and corrections for multiple comparisons.
Other topics include using machine learning to speed up computationally expensive pricing and risk calculations, and the difficulty of translating some techniques into production because of implementation effort. For predictive modeling, the discussion emphasizes persistent gaps between in-sample and out-of-sample results, especially for volatility forecasts, portfolio weights, and longer-horizon return predictions. It notes that simulation can study expected generalization behavior but cannot determine the best settings for a unique dataset. The final suggestion links market efficiency to the unresolved complexity question P versus NP. These are a collection of respondent observations, not a comprehensive or ranked research agenda, and several claims are presented without detailed evidence in the document.
Key ideas
- Reference-rate transitions create demand for new pricing and risk models calibrated with limited data.
- Many published asset-pricing factors and anomalies may not replicate across samples or markets.
- Multiple-testing corrections and stricter evidence standards are proposed to improve empirical research.
- Machine learning may accelerate computationally intensive pricing and risk tasks, though implementation can be difficult.
- Out-of-sample forecasting and portfolio estimation remain challenging, particularly over longer horizons or with limited data.
- The discussion presents diverse viewpoints rather than an exhaustive research roadmap.
Tags
Full text
# What are the most crucial research areas currently in quantitative finance/interesting subfields? # What are the most crucial research areas currently in quantitative finance/interesting subfields? What are some of the things that are currently being researched, or what are the big unanswered questions of quantitative finance that researchers are trying to solve? What are some interesting and extremely important topics being researched with direct massive applications to quantitative finance? ## Answer by Magic is in the chain (score 10) https://quant.stackexchange.com/a/58808 The most pressing topic in the interest rate world is the modelling of the New RFRs (SOFR, SONIA, ESTR etc) as part of the IBOR transition. New products are being developed, models for pricing these products need to be developed (or existing models adapted), and risk models need to be calibrated using limited data. This is probably the biggest development since the introduction of multi curve frameworks. ## Answer by Kevin (score 9) https://quant.stackexchange.com/a/58810 As far as empirical asset pricing goes, there occurs to be a replication crisis, similar to other social sciences. Many published results, factors and anomalies cannot be replicated, others don't hold in extended samples or international markets. This questions what we really know about the cross section of returns. Harvey, Liu and Zhu (2016, RFS): > We argue that most claimed research findings in financial economics are likely false. Hou, Xue and Zhang (2020, RFS): > Most anomalies fail to hold up to currently acceptable standards for empirical finance. [..] Even for replicated anomalies, their economic magnitudes are much smaller than originally reported. In all, capital markets are more efficient than previously recognized. There's much research going into developing new econometric tests, including correcting for multiple tests, proposing new test hurdles and higher standards for publication. ## Answer by Daneel Olivaw (score 6) https://quant.stackexchange.com/a/58816 Research into leveraging machine learning to speed up models seems to be gaining traction. This can be useful in computationally-expensive problems such as Greeks for products valued through Monte-Carlo, the pricing of valuation adjustments (CVA, FVA, etc.) or optimal collateral posting. See for example Huge & Savine (2020), Itkin (2020), Henry-Labordère (2019) or Horvath, Muguruza & Tomas (2019). However I am not seeing these methods being implemented in the field yet. In particular, I know that in some places Automatic Adjoint Differentiation (AAD) has been discarded due to the human and temporal resources involved in rewriting pricing libraries to accomodate this technique. ## Answer by develarist (score 6) https://quant.stackexchange.com/a/58821 The application of machine learning to enhance the prediction or forecasting performance of financial models using historical data-driven algorithms (like boosting, support vector machine) has been unable to entirely close the gap between in-sample and out-of-sample performance. Unanswered questions dealing with models fitted using train/test split or other cross-validation techniques, in attempts to generalize better to unseen, test data are: - how to estimate financial volatility forecasting models in-sample that can accurately predict unseen test data (out-of-sample) for time horizons longer than 1-day or 5-days ahead. - how to estimate optimal portfolio weights in-sample that remain optimal out-of-sample up to the next rebalance date for small (monthly) sample sizes, which is known to increase misestimation error as the available number of historical observations decreases - how to forecast asset returns reliably for horizons longer than 1-step ahead, despite them being stationary compared to return volatility, still is an open-ended question, mainly due to the known difficulty (for decades now) in estimating the asset mean Monte Carlo simulations can indicate how consistent we can expect certain supervised learning algorithms' out-of-sample performance to be, but do not instruct the optimal calibration of hyperparameters for unique, un-simulated, datasets. ## Answer by simzoor (score 3) https://quant.stackexchange.com/a/58815 One of the greatest question (which is not only linked to quantitative finance) is, whether $P=NP$. Maymin (2002) found out that markets are efficient if and only if $P=NP$. So one could finally pin that discussion once and for all.
Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)
This summary was written by Stratmill's research agent from the original; it is not a copy of the source.