1
$\begingroup$

I would like to regress the values on the y-axis by the values of the x-axis. As you can see, the relationship is not linear. Values of y are only positive can not exceed 4, values of x are always positive.

Is it possible (and do you think it is a good idea) to do the following:

  • Use dummy variables for bins of x-values (bins of 0.5 for example)
  • As an extra restriction, the value of the dummy variable coefficient in bin i can not be lower than the value of the dummy variable of bin i-1

That way I hope to get a nice smooth monotonic rising regression function through the data. (I want to avoid the decrease of the at the end of the X range of the LOESS fit as it is not meaningful)

Do you think this is a good idea and is this possible in R?

Thank you beforehand.

enter image description here

$\endgroup$
  • 2
    $\begingroup$ Not a good idea to discretize continuous predictors: see here. At best it does little harm. $\endgroup$ – Scortchi - Reinstate Monica Feb 28 '14 at 17:15
2
$\begingroup$

As @Scortchi said, it's probably not a good idea, especially if all you're trying to accomplish is as you've described it. You seem to have a cluster of data in the $X=[18–23],Y=[2.2–2.7]$ range; that might be influencing your LOESS model. You seem convinced that those data aren't meaningful, but be careful not to discount them if only because they complicate your model. If you have better reasons to discount them in mind, it may be unnecessary to model them at all.

Still, excluding them might not make a big difference. It looks like your $Y$ range is restricted and causing some ceiling and floor effects. If you model $Y(X)$ as a polynomial function of at least degree three (or a LOESS model, clearly), you'll pick up that flattening of the otherwise monotonic function beyond the values of $X$ for which $Y(X)\approx0\text{ or }4$. In case you don't have an idea of how $Y(X)$ would work as a polynomial function of degree three, I've tweaked a model in WolframAlpha: $Y=.2-.15X+.055X^2-.002X^3$
Pretty close, no? Yet I wonder if it would make sense for $Y(25)<0$, if $X=25$ is even possible...

You might want to explore alternatives for handling ceiling / floor effects in regression, if that's really what's going on here, and if you're sure that odd patch of observations beyond $X>17$ is negligible. Some other useful questions about models of bounded dependent variables exist here, including:

Since you asked about polychotomization, here are some points on why to not do it:

Nonetheless, I don't want to leave you thinking that your ideas are unmanageable, indefensible, or otherwise just plain terrible...(and I also want to offer those I've tagged here something to mull over!) You can smooth the dummy coefficients for a polytomous, ordinal, independent variable so that adjacent values don't differ too sharply using penalized regression, which (thanks yet again to Scortchi) I've mentioned in answers to these two questions:

  • Continuous dependent variable with ordinal independent variable, and originally,
  • Effect of two demographic IVs on survey answers (Likert scale)
    • For this, I also cited Tsuruta and Bax (2006), whose article is a little more relevant here. They describe the $C$ index "as a measure of the predictive ability of an independent regressor variable" that has been polychotomized. Unfortunately, I don't see them using it on models of continuous outcomes – only binary – so I'm not sure if it (maybe after modifications?) can quantify the harm done by polychotomization for your case. Regardless, it's a nice example of when one could want to polychotomize something badly enough to develop such an index for optimizing the process. You've probably got better options, but that may not always be so.

References

- Cohen, J. (1983). The cost of dichotomization. Applied Psychological Measurement, 7(3), 249–253. Retrieved from http://www.unc.edu/~rcm/psy282/cohen.1983.pdf.
- Tsuruta, H., & Bax, L. (2006). Polychotomization of continuous variables in regression models based on the overall C index. BMC Medical Informatics and Decision Making, 6(41). Retrieved from http://www.biomedcentral.com/1472-6947/6/41/.

| cite | improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.