What are some good ways of presenting/comparing cross-validated RMSE errors for regression using various models, graphically via plots? As of now, I have been presenting the quantitative results in tabular form.
If just a series of RMSE, ideally a bar chart should do if you don't have extra information to add. However, if you lined up the RMSE in a nice descending order in the table, I don't think a plot is necessary.
If you wish to emphasize the change in residual for individual point, a parallel coordinate plot should work quite well. See a pretty rough example below.