Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

In R, if I write

lm(a ~ b + c + b*c) 

would this still be a linear regression?

How to do other kinds of regression in R? I would appreciate any recommendation for textbooks or tutorials?

share|improve this question
    
I tried to reword a little bit your question. I'm afraid it looks like you're asking two very different questions. For the second one, a lot of resources is available on this site, but also on CRAN. – chl Mar 23 '11 at 20:11
    
@chl, yeap, thanks, I wasnt clear. My questions is really this: If I write LM in R does R understands it as linear always or triesd to fit any model, not necessarily linear regression but any regression ? – suprvisr Mar 30 '11 at 20:06
    
No, lm() stands for a linear regression. Your model includes three parameters (minus the intercept) for b, c, and their interaction b:c, which stands for b + c + b:c or b*c for short (R follows Wilkinson's notation for statistical models). Fitting a Generalized Linear Model (i.e., where the link function is not identity, as is the case for the linear model expressed above) is requested through glm(). – chl Mar 30 '11 at 20:16

Linear refers to the relationship between the parameters that you are estimating (e.g., $\beta$) and the outcome (e.g., $y_i$). Hence, $y=e^x\beta+\epsilon$ is linear, but $y=e^\beta x + \epsilon$ is not. A linear model means that your estimate of your parameter vector can be written $\hat{\beta} = \sum_i{w_iy_i}$, where the $\{w_i\}$ are weights determined by your estimation procedure. Linear models can be solved algebraically in closed form, while many non-linear models need to be solved by numerical maximization using a computer.

share|improve this answer
3  
+1 Specifically, in a "linear model" the dependent variable $y$ is a linear function of the parameters but not necessarily of the data. – whuber Mar 24 '11 at 21:14
    
1st one is linear ? really - the one to the power of x ? – suprvisr Mar 25 '11 at 16:12
2  
Yes, because $x$ is not the quantity of interest (the one you optimize for) but instead $\beta$ is. Thus, it is linear in $\beta$. – bayerj Apr 1 '11 at 15:34
    
+1, but this answer could be improved by commenting on the formula in the question. – naught101 Apr 17 '12 at 5:26
1  
I notice, upon a second reading, that the second half of this reply confuses "linear model" with "linear estimator." The two concepts are separate and different. Nonlinear models often have linear estimators and linear models can have nonlinear estimators (consider GLMs, for instance). – whuber Apr 17 '12 at 6:23

I would be careful in asking this as an "R linear regression" question versus a "linear regression" question. Formulas in R have rules that you may or may not be aware of. For example:

http://wiener.math.csi.cuny.edu/st/stRmanual/ModelFormula.html

Assuming you're asking if the following equation is linear:

a = coeff0 + (coeff1 * b) + (coeff2 * c) + (coeff3 * (b*c))

The answer is yes, if you assemble a new independent variable such as:

newv = b * c

Substituting the above newv equation into the original equation probably looks like what you're expecting for a linear equation:

a = coeff0 + (coeff1 * b) + (coeff2 * c) + (coeff3 * newv)

As far as references go, Google "r regression", or whatever you think might work for you.

share|improve this answer
    
How does renaming something make it linear? I don't understand, if the identity newv = b * c holds, it's not linear at all. I am confused. – bayerj Mar 24 '11 at 8:21
    
@bayer: newv is a new variable. The new equation is a linear function of three variables (b, c, newv), where the coefficients provide a linear relationship. Neither equation is a linear combination of just two variables. – bill_080 Mar 24 '11 at 15:17
    
@bayer See the reply by @Charlie. In the present example, both models are linear (whether or not R views them as such) because in both of them a is a linear function of the four coefficients. – whuber Mar 24 '11 at 21:16
    
thanks, it makes sense... can I simply add new variable neww being b*c for each case in the database (medical) and then treat it as linear regression ? – suprvisr Mar 30 '11 at 20:05

This post at minitab.com provides a very clear explanation:

  • A model is linear when it can be written in this format:
    • Response = constant + parameter * predictor + ... + parameter * predictor
      • That is, when each term (in the model) is either a constant or the product of a parameter and a predictor variable.
    • So both of these are linear models:
      • $Y = B_0 + B_1X_1$ (This is a straight line)
      • $Y = B_0 + B_1X_1^2$ (This is a curve)
  • If the model cannot be expressed using the above format, it is non-linear.
    • Examples of non-linear models:
      • $Y = B_0 + $$X_1^{B_1}$
      • $Y = B_0 \centerdot \cos (B_1 \centerdot X_1)$
share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.