Ridge Regression Eigenvalue Shift - Quant Trader Interview Question
Difficulty: Medium
Category: Linear Algebra & Machine Learning
Practice quant interview questions from top firms including Jane Street, Citadel, Two Sigma, DE Shaw, and other leading quantitative finance companies.
Topics: ridge-regression, eigenvalues, linear-algebra, machine-learning
Problem Description
In ridge regression, the ordinary least squares (OLS) estimate is modified by adding a penalty term, resulting in the estimator: $ (X^T X + \lambda I)^{-1} X^T Y $ where $X$ is the feature matrix, $Y$ is the target variable, and $ \lambda $ is the regularization parameter. Consider a scenario where you're tuning a ridge regression model. How does increasing $ \lambda $ affect the eigenvalues of the matrix $X^T X$?
Practice this medium trader interview question on MyntBit - the all-in-one quant learning platform with 200+ quant interview questions for Jane Street, Citadel, Two Sigma, and other top quantitative finance firms.