What is between regression and ordinal classification (or called ordinal regression)? There are many articles explaining the difference between regression and ordinal classification, most of them mentioned that regression is for continuous response while ordinal classification is for discrete response. However, I think it in another way, and that's my question:
As more and more discrete values added to the response set, it is more and more approximate a continuous response. Shall we really separate regression and ordinal classification as two different worlds? What models lie between regression and ordinal classification? What if i have a large number of discrete values in response variable (but still no rigorous continuous), integer 1 to 10000 for instance, what kinds of model can handles this issue? 

 A: All continuous interval-scaled variables are ordinal, but not all ordinal variables are interval-scaled.  An ordinal variable may have any number of distinct values, all the way to having no ties in the data.  See the ordinal regression for continuous Y chapter in RMS.  The R rms package orm function can computation-time-wise handle more than 6000 distinct ordinal values for Y.  That is the number of intercepts in the model plus one.  The number of slopes stays the same no matter how many intercepts you have, and the intercepts are forced to be in order, hence the model is not overparameterized.
A: 
As more and more discrete values added to the response set, it is more and more approximate a continuous response

No, you're wrong about this.
We use integers as group labels out of convenience. We could just as easily use strings as labels. Our problem is actually about predicting to which set an observation belongs, not a number per se.
Adding more and more categories does not make the problem any closer to regression, and so the two are still rightfully different.
A: So if I understood you correctly, what you are thinking is in a problem in which the response variable is formed by integer numbers, for example, as you said, numbers from 1 to 1000. For dealing with this kind of situations there is an specific kind of generalized regression models, called binomial models. In those models, you assume that the distribution of your response variable is a binomial distribution, which is the one that best fits this integer response situation.
