What are the theoretical reasons for why extrapolation "less reliable" than interpolation? Extrapolation is in general "unreliable".  (See "What is wrong with extrapolation?") 
But it is also commonly said that extrapolation is "less reliable" than interpolation. 
But why should we generally assume that the model is "more reliable" between two known data points than to the right of the right-most data point (or the left of the left-most data point)?
From empirical examples, I can see that indeed, interpolation is often "more reliable" than extrapolation. But is there a more formal, theoretical justification for why this assertion is, in general, true? 
Or is it just a purely empirical observation that interpolation tends to be "better"?
 A: It's partly empirical, partly theoretical. Theoretically, we are trying to fit a model to the observed data, hence our choice of function is determined by the data points we have, not by what we don't have. Thus, our model is selected by the observed data, and we have no guarantees that we'd choose a similar model if we had more extreme observations. 
Related to this is the fact that we can only cross-validate with observed data, so we can only check it's accuracy against observed points. If a model has very high cross-validation accuracy, then all we know is that it is probably a reliable estimator for points within the boundary of the observed data. Outside this region, we have no data and no estimate of how we would do.
That's the theoretical part. Empirically, we usually assume continuity and smoothness of a response surface, since many processes behave that way. Hence, we assume that the true model comes from a class of well-behaved functions, not crazy, jagged-edged monsters. This is a key regularization step in model fitting. With that assumption, we get the idea that points close in inputs space should be close in their function values, with convergence to $0$ difference as the points approach one another.
A: It is a theoretical result, at least for linear regression. Indeed, if one computes the so-called ''prediction error'' (see this link, slide 11), one can easily see that the further the independent variable $x$ is away from the sample average $\bar{x}$ (and for extrapolation one may be far away), the larger the prediction error.  In the link that I referred to one can also see that in a graphical way. 
A: Check Goedel's Theorem, for a more rigorous explanation of why extrapolation is less reliable than interpolation. Actually, empiricism merely confirms the rigor of Goedel's theorem. Intuition however is the tool we normally use to discredit the more everyday argument against what we then call generalizing, (or more formally, inductive logic) in everyday parlance. (Many mental illnesses, especially paranoia, result from this intuitive leap of logic from the specific to the general.)
