A Practical Process for Financial Risk Model Validation
Summary
The document outlines a model validation workflow and points readers toward regulatory guidance, books, and research on model risk. Its practical sequence begins with conceptual soundness: independently derive or review the model’s mathematics, identify assumptions, and assess suitability and limitations. It then recommends testing implementation through an independent library where possible, or through carefully chosen scenarios such as extreme or boundary inputs. Documentation should also be reviewed for completeness and clarity.
The validator’s final deliverable is an independent report describing the model, derivation, tests, and limitations. The answer stresses constructive communication with model developers as part of effective review. The broader resource list spans U.S., Canadian, and U.K. supervisory material and references on model risk, including quantitative finance and machine-learning contexts. These are recommendations rather than a detailed set of test specifications; the appropriate tools and depth of review depend on the model and its use. The discussion provides a process framework, not a single universal validation standard.
Key ideas
- Review a model’s assumptions, mathematical basis, intended use, and limitations.
- Test implementation independently when possible, including behavior under boundary or extreme scenarios.
- Check that developer documentation is complete, consistent, and clear.
- Write an independent validation report that records the analysis, tests, and limitations.
- Constructive engagement with model developers can improve the quality of validation work.
Tags
Full text
# Risk Model Validation # Risk Model Validation I have such a general question regarding risk model validation. Which tools are most often used for validation and how does the process work? Could you recommend any books that focus on this topic? ## Answer by Dimitri Vulis (score 13, accepted) https://quant.stackexchange.com/a/66320 You should read this regulatory guidance: U.S.: Edit: SR 26-2 was published April 17, 2026. It replaces and rescinds the prior SR 11-7. See How does the U.S. SR 26-2 Revised Guidance on Model Risk Management differ from the prior SR 11-7 Guidance on Model Risk Management? for comparison and analysis of changes. Cover: https://www.federalreserve.gov/supervisionreg/srletters/SR2602.pdf (FRB version) / https://www.occ.treas.gov/news-issuances/bulletins/2026/bulletin-2026-13.html (OCC version) / https://www.fdic.gov/news/press-releases/2026/agencies-issue-revised-model-risk-guidance (FDIC version) Appendix: https://www.federalreserve.gov/supervisionreg/srletters/SR2602a1.pdf (FRB version) / https://www.occ.treas.gov/news-issuances/bulletins/2026/bulletin-2026-13a.pdf (OCC version) / https://www.fdic.gov/model-risk-management-revised-guidance.pdf (FDIC version) The old SR 11-7: https://www.federalreserve.gov/supervisionreg/srletters/sr1107a1.pdf (it was similar to FHFA AB 2013-07 Model Risk Management Guidance, FHFA AB 2022-03: Supplemental Guidance to Advisory Bulletin 2013-07 – Model Risk Management Guidance , https://www.fhfa.gov/advisory-bulletin/ab-2022-03, OCC brochure on model risk management (August 2021) and similar guidance that we can expect to be updated to reflect SR 26-2. Canada (very similar): OSFI Enterprise-Wide Model Risk Management for Deposit-Taking Institutions E23 https://www.osfi-bsif.gc.ca/Eng/Docs/E23.pdf U.K.: PRA. Supervisory Statement SS1/23. Model risk management principles for banks (May 2023) https://www.bankofengland.co.uk/-/media/boe/files/prudential-regulation/supervisory-statement/2023/ss123.pdf PRA. Supervisory Statement SS3/18. Model risk management principles for stress testing (April 2018) https://www.bankofengland.co.uk/-/media/boe/files/prudential-regulation/supervisory-statement/2018/ss318.pdf (although the focus is on stress testing, much of it applies to models in general.) Bank of England. Consultation Paper 6/22 – Model risk management principles for banks. https://www.bankofengland.co.uk/prudential-regulation/publication/2022/june/model-risk-management-principles-for-banks and these books: Massimo Morini. Understanding and Managing Model Risk: A Practical Guide for Quants, Traders and Validators. Wiley (2011) Christian Meyer, Peter Quell. Risk Model Validation. Risk Books (3rd edition, 2020) Sergio Scandizzo. The Validation of Risk Models: A Handbook for Practitioners. Palgrave Macmillan (2016) Jonathan Schachter, Martin Goldberg. Model Risk Management. (2025) Ludger Rüschendorf, Steven Vanduffel, Carole Bernard. Model Risk Management: Risk Bounds under Uncertainty. (2024) focus on VaR-like models Other related resources worth mentioning: American Academy of Actuaries. Model Risk Management: A Public Policy Practice Note (May 2019). Model Risk Managers' International Association. White papers. https://mrmia.org/white-papers/ See also MRMIA Best Practices: Volume 1 Journal of Risk Model Validation https://www.risk.net/journal-of-risk-model-validation (subscription needed) Los Alamos National Laboratory. Ben Thacker et al. Concepts of Model Verification and Validation (V&V). 2004. LA-14167-MS https://doi.org/10.2172/835920 (This older paper greatly influenced SR 11-7 and other regulatory guidance.) U.S. Environmental Protection Agency. Guidance Document on the Development, Evaluation, and Application of Environmental Models. (2009) Seppe vanden Broucke and Bart Baesens. Managing Model Risk: Lessons and experiences from industry and research on the challenges and dangers of analytical models (2021) - much focus in AI/ML models Aruna Joshi (Visa). Managing Risk of Financial Models: A Smart and Simple Guide for the Practitioner (2017) George Christodoulakis and Stephen Satchell, Editors. The Analytics of Risk Model Validation (Quantitative Finance) (2007) (This is a collection of narrowly focused articles, somewhat dated.) Daniel Rösch and Harald Scheule, editors. Model Risk: Identification, Measurement and Management. Risk Books (2010) (Another collection of narrowly focused articles.) Radu Sebastian Tunaru. Model Risk In Financial Markets: From Financial Engineering To Risk Management ## Answer by Jan Stuller (score 9) https://quant.stackexchange.com/a/66367 Model Validation process usually consists of: 1. Conceptual Soundness Review (model assumptions, mathematical representation, limitations) - Here you should try to re-derive the model from scratch and ask yourself what the assumptions that you are making along the way are, which should then tell you what the model limitations are. Alternatively if you don't want to rederive the model from scratch / can't / can't due to time constraints, you can go through the maths provided by the model developer and check all the assumptions with a focus on model suitability. 2. Testing (through reimplementation or developer's interface) - Here, you test the model implementation. Ideally, your model validation team will have an independent library where you test the model independently and see whether it agrees with the developer's implementation. If the model validation team doesn't have its own library, the developer will provide an interface where you can at least try some "corner" scenarios and see if the model performs as expected (if it's a pricing model, how does it behave when volatility or rates go to zero, how does it behave when volatility or rates become very large, etc.). 3. Assessment of Model Documentation (written by model developer) - This might be frowned upon, but a big part of model validator's job is to make sure the model documentation (provided by the developers) is spot on and up to scratch. In other words, model validators job is to help improve the front-office model developer's documentation. You can ask for more testing to be done and documented if the documented testing is not sufficient. You should also check that all graph-axes are being clearly labelled, that variable names are consistent throughout the doc, etc (these things are "trivial" but very important). 4. Writing a self-contained Validation Document describing the Model - Finally, once all of the above is done, the model validator should produce an independent doc where all his / her work is well documented. This should mainly include an independent derivation of the model and the independent testing completed, and it should clearly state all model limitations (i.e. deterministic volatility model cannot be used to price forward-starting options, etc.). Attention to detail and ability to challenge the FO quants constructively and politely are critical skills here: if the challenges are "stupid" or the FO quants feel that you're not trying to help, the long-term cooperation will not be very productive. On the other hand, if you ask smart questions and try to work together, the work with FO developers can be enjoyable and a model-val role can be a good opportunity to do deep-dives into specific models and increase your understanding of these models.
Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)
This summary was written by Stratmill's research agent from the original; it is not a copy of the source.