259 views

### Regression with random X [duplicate]

Suppose we have a standard regression model $$Y= X\beta + \epsilon$$ with $$\epsilon \sim \sigma^2$$ $$X \sim N(\mu,\gamma^2)$$ Are the estimated coefficients the same as if $X$ was fixed? Is ...
• 523
1 vote
239 views

### Random Explanatory / Independent Variables [duplicate]

Are explanatory variables in regression always considered non-stochastic? If the explanatory variables are random or stochastic will the regression be still valid? What are the implications on the ...
• 567
58 views

### Meaning of & intuition behind predictors being fixed in linear regression [duplicate]

My question is a bit naive. I'm trying to get the exact & clear meaning of the phrase "predictor variables are fixed and not random in linear regression". According to my understanding, ...
27 views

• 2,549
3k views

### Definition and delimitation of regression model

An embarrassingly simple question -- but it seems it has not been asked on Cross Validated before: What is the definition of a regression model? Also a support question, What is not a regression ...
• 56.9k
5k views

### What is the difference between conditioning on regressors vs. treating them as fixed?

Sometimes we assume that regressors are fixed, i.e. they are non-stochastic. I think that means all our predictors, parameter estimates etc. are unconditional then, right? Might I even go so far that ...
• 917
2k views

### What does the assumption: "The independent variable is not random." in OLS mean?

What does the assumption: "The independent variable is not random." in OLS mean? How can you verify that hypothesis?
• 965
401 views

### Which likelihood function is used in linear regression?

When trying to derive the maximum likelihood estimation for a linear regression, We start by a likelihood function. Does it matter if we use either of these 2 forms? $P(y|x,w)$ $P(y,x|w)$ All pages ...
• 1,250
922 views

1 vote
543 views

### Regression's population parameters

Suppose I've specified a linear regression model: $$Y = \beta_0 + \beta_1 X + \epsilon$$ where $\beta_0$, $\beta_1$ are the population parameters. My question is: why are these parameters ...
• 137
1 vote
1k views

### When can we use fixed design regression results for the random design setting? [closed]

Suppose I have an independent vector $X$ and a dependent scalar random variable $Y$ and I wish to construct a regression model to predict $Y$ using $X$ given data $\{(x_i,y_i)\}_{i=1}^{n}$. For ...
485 views

### Proof that Regression Sum of Squares and Residual Sum of Squares are independent random variables

Having consulted a number of sources, I still can't find a complete proof that Regression Sum of Squares ($SS_{regression}$) and ($SS_{residual}$) are independent random variables. I'll be doubly ...
• 3,358
288 views

### Why does regression model theory not use measure-theoretic sigma-field type notation but counting process models do?

I have been studying counting process theory for time to recurrent event processes and am interested in the explicit use of the conditioning set in the model notation; E[dN(t)|\mathcal{F}_{t^{-}}]=\...
• 668
Consider the following model. Assume $(x_i, u_i)$ is sequence of independent identically distributed random vectors in $\mathbf{R}^{d+1}:$ $x_i$ are $\mathbf{R}^d$-value random vectors, which will ...