I'll just formulate some ideas and give leads to free introductory material.
The raw MSE figure in itself doesn't tell you much.
Depending on the quantities in your sample space, sqrt(4.31) could be very small, or very big, which may make you want to use the model or not.
What you can use it for is the comparison of different models, and favor the one with smallest MSE. Within the data you have, your model with MSE = 4.31 could be the worst as well as the best.
From the Wikipedia Mean squared error page:
The MSE is a measure of the quality of an estimator—it is always non-negative, and values closer to zero are better.
The article contains further links about specifics on regression and prediction if you look for more advanced content.
For an accessible video introduction: Khan Academy has a serie on Squared Error
To sum it up: MSE is a relative measure of how well your model fits your sample data.
There is more to it if you know more about the distribution of the different variables, dependent, independent and residuals, and you might be interested in ANOVA and goodness of fit to go further on the topic.
I hope this helps,
All the best,