About this question

Gradient Descent Learning Rate Impact

Medium · Linear Algebra & Machine Learning · Quant Trader interview question · gradient-descent, learning-rate, optimization, machine-learning

You are training a machine learning model using gradient descent to minimize a cost function $J(\theta)$. The learning rate, denoted by $ \alpha $, controls the step size during each iteration. Consider a scenario where you set the learning rate to a very large value. What is the most likely outcome regarding the convergence of the gradient descent algorithm?