I was running some LassoCV and RidgeCV and wanted to know whether it is possible for CV MSE functions of lambda for say Ridge regression can have multiple minima.
e.g. multiple values of lambda such that derivatives $dMSE/d\lambda == 0$
(not saddle points or maxima)
typically R or python will show some graph with a minima of MSE vs $\lambda$ and I am just questioning how robust these graphs are if there are multiple minima, is it going to give you the global minimum etc.
EDIT: after reviewing the sub-satsifactory answers here, you can find out more about this issue here: What causes lasso to be unstable for feature selection?