2
$\begingroup$

i suppose one way to characterize data is by a combination of the variable types that comprises it:

 Continuous/Continuous  |  Continuous/Discrete
 -----------------------|---------------------
 Discrete/Discrete      |  Discrete/Continuous

Each of the four cells comprising the 2x2 table just above is comprised of two descriptors, one for the Explanatory Variables (EV), which we'll assume are all of the same type, and one for the Response Variable (RV):

Explanatory Variable Type / Response Variable Type

The columns represent the EV type; the rows, the CV type.

Nearly all of the data i see can be placed in either of the two cells that comprise the first row.

So for instance, OLS Regression is a suitable model type for data in row1/col1; and for data in row1/col2, Logistic Regression is an appropriate model choice.

It's the second row, and in particular row2/col2, that my Question is directed to.

I'm aware of a few regression techniques like ordinal regression which handle a particular type of discrete variables (ordinary or rank, 1st, 2nd, 3rd,....) but i am interested in techniques for handling discrete data more generally, given that most categorical variables do not have an implicit ordinal relationship among the values that comprise them.

For instance:

Sex | City_of_Residence | Car_Make&Model | Married? | DUI? | Prior_3P_Claims?
 F  |   Cleveland       |  Chevy Camaro  |   No     |  No  |   Yes

And the Response Variable is continuous--e.g., building a model to predict the quotes offered by major auto insurers--a price.

Improve this question
$\endgroup$
1
  • 3
    $\begingroup$ I suspect this question is answered many times over in the threads you will find by searching our site $\endgroup$
    – whuber ♦
    May 24, 2012 at 21:38

1 Answer 1

Reset to default
1
$\begingroup$

The type of regression is related to the dependent variable only. When the dependent variable is continuous, you can consider OLS regresssion, regardless of whether the independent variables are categorical or continuous or both. Ordinal independent variables are a bit tricky - sometimes they are treated as continuous sometimes as categorical.

If the independent variables are categorical, there are a variety of methods including effect coding and dummy coding to deal with them.

Of course, OLS makes assumptions beyond the idea that the dependent variable is continuous (or nearly so). e.g. it assumes that the residuals are independent and $\sim{N(0,1)}$

Improve this answer
$\endgroup$
6
  • 3
    $\begingroup$ I might be misreading the question, but it seems that in spirit it is asking for more than how to code a purely nominal explanatory variable. (The clue for that comes from the reference to ordinal regression.) Perhaps the best answer is "use some kind of dummy coding," but maybe, on the other hand, the question that's really lurking here concerns the choices one makes for modeling data that appear to be categorical but might have some structure: perhaps not an order, but something that would allow one to use many fewer parameters than categories. But maybe I'm being too imaginative ... $\endgroup$
    – whuber ♦
    May 24, 2012 at 22:00
  • $\begingroup$ Except that the last line says the response variable is continuous. I'm not sure what he wants. $\endgroup$
    – Peter Flom
    May 24, 2012 at 22:09
  • 1
    $\begingroup$ Well, now we're making real progress! We have identified a possible point of misunderstanding in the question (which, as an expert consultant, you know is a key step towards developing a truly useful and correct answer). Let's ask the OP: @Doug, could you expand on this issue so we can create a common unambiguous understanding of what you are asking? $\endgroup$
    – whuber ♦
    May 24, 2012 at 22:13
  • $\begingroup$ Indeed! And @doug has been here a while, so an answer should be forthcoming. $\endgroup$
    – Peter Flom
    May 24, 2012 at 22:17
  • 1
    $\begingroup$ @macro is right I mean $N(0,\sigma^2)$ and also about the errors, not the residuals, but we don't know the errors, only the residuals. $\endgroup$
    – Peter Flom
    May 25, 2012 at 14:42

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.