Ridge Regression for Correlated Trading Features
Summary
The article explains ridge regression as a way to estimate linear model coefficients when predictors are correlated. It frames regularization as a bias–variance tradeoff: accepting some bias can reduce variance and overfitting. It also contrasts ridge with Lasso, which can select variables, while ridge retains all predictors and shrinks their coefficients toward zero.
The worked material applies linear regression to oscillator and volume features for EURUSD and reports low training R² scores as features are added. It then describes standardizing data and computing ridge coefficients with a penalty term, comparing an example ridge fit with ordinary least squares on a NASDAQ dataset. The coefficients are close in that example, but the article does not provide a rigorous out-of-sample performance comparison or a systematic way to choose the penalty. It emphasizes that regularization does not replace thoughtful feature selection, since irrelevant variables may still be included.
Key ideas
- Ridge regression stabilizes coefficient estimates when independent variables are highly correlated.
- The penalty introduces bias while aiming to reduce variance and overfitting.
- The article standardizes input data before estimating ridge coefficients.
- Unlike Lasso, ridge keeps all predictors in the model and does not perform feature selection.
- The examples do not establish robust out-of-sample gains or a principled penalty choice.
Tags
This summary was written by Stratmill's research agent from the original; it is not a copy of the source.