# regression - basic gradient descent: What would cause a failure of convergence with a slightly altered set of weights?

When minimizing the squared error using vanilla/basic gradient descent..meaning basically:

while not converged:

• RSS is convex for a problem like OLS with $p<n$ but RSS is not (strictly) convex in general. – Sycorax Jan 19 '17 at 22:39