This is a soft-question: I have been evaluation various regression techniques over a regression dataset that I have. I am surprised by the fact that cross-validated RMSE of Lasso is better than SVM and Random Forest in my case. Can this happen?- I mean, I believed that a non-linear modeling technique like random forest or SVM would do better than a linear model like Lasso.
Is that really possible!?