Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

learn more… | top users | synonyms (1)

0
votes
0answers
7 views

Co-linear covariate in regression what if take one out?

I understand that there are a few ways to deal with correlated or co-linear covariates ( PLS or AIC, and Lasso) But my problem here is: If you have 2 covariates x1 and x2 that are correlated(you ...
2
votes
2answers
51 views

Bayesian Linear Regression

I have the following question concerning Bayesian linear regression on my machine learning assignment: Consider $f = w^Tx$, where $p(w) ∼ N(w | 0, Σ)$. Show that $p(f | x)$ is Gaussian. I ...
0
votes
0answers
10 views

question about using R to find cofindence interval for the subpopulation [on hold]

I am stucking on several statistic questions. I have no idea which direction should i go. Please help! The variables are x=height of father and y = height of corresponding son. The unit is centimetre ...
3
votes
1answer
31 views

Causal links with omitted variables

So I have a fairly basic setup, with $X\rightarrow Y$. However, I've run across a potential third variable, Z, that is probably correlated with both X and Y. However, the causality for Z is unusual ...
0
votes
0answers
6 views

How to build the A MAtrix for a A-Model(Amat) after a REDUCED VAR in R

i have a doubt in how to build the A MAtrix(Amat) for Estimating a SVAR model in R: I estimated a reduced VAR with the GDP, interest rate and inflation variables . With the economic theory and the ...
0
votes
1answer
31 views

Why are my time series predictions constant?

I have a time series of log returns (from 2007 to 2012). I need to predict the $t+1,t+2, \ldots t+1510$ log stock returns. I have therefore done the following coding in ...
3
votes
0answers
20 views

Prior for the coefficients of a linear regression model

I have a linear regression model $\bf Y=\bf{X}\bf{\beta}+\epsilon$. I want to assign a prior on $\bf\beta$ in order to derive the posterior predictive model $p(y_{predictive}|\bf{y},\bf{X},\beta)$. ...
2
votes
1answer
42 views

Bayesian linear regression question

I am doing a problem on Bayesian regression but I'm having a lot of trouble with it. Here is the question: Consider $f=w^Tx$, $p(w)\sim N(w|0,\Sigma)$. Show that $p(f|x)$ is Gaussian. Find the mean ...
2
votes
0answers
16 views

What to do with this non-normally distributed and near-categorical data?

I have a dependent variable (monetary transfers made by 'dictators' in an experimental dictator game) that is non-normally distributed, and which also appears to be multi-modal (it was collected as a ...
0
votes
0answers
15 views

How can the relative importance of a categorical variable in a linear regression model be determined?

A simple example can be seen here:http://www.ats.ucla.edu/stat/spss/output/reg_spss.htm Gender is a dummy coded variable. I completely understand how to interpret this variable. I cannot use the ...
0
votes
0answers
8 views

Linear Regression and error calculation with streaming data [on hold]

How to calculate error when perform linear regression if data is in streaming pattern ?
0
votes
0answers
11 views

Obtaining adjusted proportions in repeated measurements design

I want to compare the blood pressure trend in a population. I have 1000 individuals, roughly and they have been examined from 2003 to 2012. Some individuals, but not all, have been examined several ...
0
votes
0answers
13 views

Linear regression with faster decrease in coefficient error/variance?

Suppose we have set of variables $Y$ and $X$, which know are related by a linear relation $y_i=\alpha x_i +\beta$, and important for us is to find $\alpha$ and $\beta$ and the error in estimating ...
0
votes
0answers
12 views

Metrics for regression error

Suppose I undertake a least squares regression on some data. I end up with a function such as $\hat{f}(x,y,\ldots)=\hat{\beta_0}+\hat{\beta_1}\cdot x+\hat{\beta_2}\cdot y+\hat{\beta_3}\cdot ...
0
votes
0answers
22 views

How to create an index to compare regression lines

Suppose I have the actual and fitted values of two regression lines. Each regression line is modeling the sales of some good. The fitted and actual values of one of the regression lines is much ...
0
votes
0answers
18 views

Non parametric clustering by discretizing continuous IV

My final target is to develop a predictive model for a rate (fraction) DV. The DV showed bimodality and I have no variable that separates the two modes. Hence I created an IV using two observed IVs ...
1
vote
0answers
9 views

Repeated measures ANOVA with custom standard errors

I want to see if there's a difference in size of some cells after several measurements, compared to a baseline (0.5, 1, 3, 6 hours versus 0 hours). I have 3 samples. Each measurement is actually a ...
2
votes
1answer
34 views

How is the Akaike Information Criteron applied for model with large number of predictors?

I am reading a paper (details not very relevant) which assumes that the market cost $C$ of a trade is related to $N$ predictors $X_1,\dots,X_N$ (page 25) through a linear relationship $$C = \beta_0 + ...
0
votes
0answers
7 views

Input normalization effect on Polynomial regression

Here there is a good explanation proving that column normalization does not affect linear regression. But I need to know if this is the same in polynomial regression as well. Thanks in advance,
3
votes
1answer
43 views

Can I do panel regression if all my covariates are time-invariant?

We have a data set where our outcome of interest varies over 10 years, but the explanatory variable of interest and all of the potential confounders are time-invariant. I am quite certain that a panel ...
0
votes
2answers
20 views

Inferring on an unknown number of function approximation

I want to ask whether a procedure to do the following job exists (or whether it makes sense for it to exist). First, assume we have $k$ functions $f_1,...f_k$ that have the same domain and range. ...
0
votes
0answers
12 views

test of correlation among binary variables prior to running logistic regression analysis

I am running a logistic regression analysis with binary variables on SPSS: dependent variable: preterm birth (Y/N) independent variables: hypertension (Y/N), diabetes (Y/N), C section (Y/N), ...
0
votes
0answers
6 views

troubleshooting R BayesFactor package - error in regressionBF [on hold]

I want to use regressionBF to run all subsets regression. Here is my code: fitness.bf = regressionBF(VO2 ~ ., data=fitnessdata) and here is the error it spits out when I try and run the code: Error ...
1
vote
0answers
10 views

prediction with string similarity

Assume we have an input of an email and we want to predict if it is spam or not spam. Without being a statistician, i would think one of the predictors takes the subject of the input email and ...
1
vote
1answer
21 views

Estimation of a system

Suppose we have a system that essentially evolves as follows: ...
1
vote
2answers
65 views

What criteria tell us that the prediction of a model is reliable

What criteria can be used to tell whether the prediction of a model will be more reliable than other specifications. Background: We have data with $N$ computers. However, prices available only ...
0
votes
0answers
26 views

Find distribution of Bus arrival time

I am currently working on a problem in my research which can be modeled into the following question: Let's say I have a rich dataset with values for the variable $A$ which is equal to ...
1
vote
0answers
10 views

Machine learning/random forests with noisy response data

Machine learning techniques like random forests seem to assume that the responses in the training set are known perfectly. Specifically for regression applications, it seems one needs to account for ...
0
votes
1answer
28 views

What is the connection between regularization and the method of lagrange multipliers ?

To prevent overfitting people people add a regularization term (proportional to the squared sum of the parameters of the model) with a regularization parameter $\lambda$ to the cost function of linear ...
1
vote
1answer
26 views

Gaussian Process: Using partitions of a Cholesky decomposition solution for conditional deduction

If I define a GP over observed values, $y$, of a sensor reading over time, $t$, as (for simplicity assuming discrete time series e.g lets say readings after every 5 mins) : $y=f(t)+\epsilon$ where ...
1
vote
0answers
9 views

Adjusting for mediating variables (everyone does it!)

I have always learned that when doing multivariable regression, one should not adjust for mediating variables between the independent and dependent variables of interest. I have seen in the academic ...
0
votes
1answer
24 views

What to make of countervailing spatial regression coefficients?

I am running regressions across a country's counties (N about 300). I divide the country in two regions A and B to control for potential unobservables. My explanatory variable varies at the county ...
3
votes
1answer
39 views

Finding significant predictors of psychiatric readmissions

The set of data I am working contains nearly 17,000 independent spells (each spell consists of a number of hospital episodes) each belonging to a unique patient ID. I have spent a very long time ...
4
votes
2answers
146 views

Do you see trends in my residual plots?

Do you see trends in my residual plots? These residuals plot show the standardized residuals against fitted values, origin period, calendar period, and development period. The patterns in any ...
3
votes
1answer
35 views

Principal Component Regression with an additional factor

I am looking to tease out the significance and contribution of a particular variable to 2 different continuous responses. I have 7 continuous variables I know to be influential on the two responses ...
0
votes
0answers
8 views

Does it make sense to report equally-fit, more complex, model, if it fits better a theory?

I have two (logistic) regression models for which the deviance is not significantly distinct (p = 0.7). One of them has education, gender and age explaining variable Y. In the other, I have added a ...
0
votes
0answers
31 views

Regression with Measurement Errors in X and Y

I am trying to find the equation of a line that best fits my data. However, I have errors on the X and Y data points. Here is what my data points look like: ...
4
votes
1answer
48 views

S-curve in residuals plot: a problem?

I am doing some linear regression and am predicting a absolutely non-normal dependent variable (for context: we are forecasting the amount of units sold for a shop). Therefore, we have transformed the ...
1
vote
0answers
29 views

Estimate Probability of being in a time interval

​You arrive at a bus stop in an unfamiliar part of town. Assume that buses arrive at the stop with an unknown (to you) distribution and wait in the bus stop for a few ​minutes. The wait time ...
1
vote
0answers
16 views

Regression with multiple observations of the independent variable for each dependent observation

Let's say I have data where y is measured at some higher level than x. For instance y represents a State level outcome over time and x represents a county level data. (Additionally, the data is such ...
1
vote
0answers
36 views

Prediction based on multiple time series - Python

I have 3 predictors and 1 variable that represents ground truth. They all are linked time series. My purpose is with the 3 predictors to try to forecast the ground truth data. For example : ...
-1
votes
1answer
25 views

Prediction on multiple regression - Python

I have 3 list of value and 1 ground truth data. They all belongs to the same time series. My purpose is with 3 list try to forecast the ground truth data. For example : ...
5
votes
4answers
103 views
+50

Nonlinear effect in an interaction term

If you have B, which is a 0/1 outcome variable, S, which is a continuous variable, and ...
1
vote
0answers
20 views

Forecasting Revenue with Layered Regression

Our business rents products to customers using a variety of payment plans.. ranging from 3-month (high \$ per month) to a continuous rental (low \$ per month). I've created a spreadsheet that shows ...
0
votes
0answers
9 views

Adding a new factor to an existing factor model for stock returns

Let's assume I have a three factor model of stock returns (Cross-sectional model): $R_i = \alpha + \beta_{1,i} X_1 + \beta_{2,i} X_2 + \beta_{3,i} X_3 + \epsilon_i$ for $i =1,..,N.$ where ...
-1
votes
0answers
16 views

Linear Regression on multiple categorical variable [on hold]

Can anyone explain How I can interpret my result from the below model : I am trying to build the linear regression model for finding the transaction behavior of the customer in bank accounts. I have ...
1
vote
2answers
46 views

Does the order of input matter in cross-validation in linear regression?

Please imagine the following problem: A linear regression problem with one input variable (X) and one output (Y) The number of input data is 50 instances. The input data is sorted in increasing ...
0
votes
1answer
23 views

Logistic regression: should I remove observations with IV combinations that cannot lead to DV=1?

I am studying the effect of changes in household state on transport mode changes in people's life trajectories. My model is such that each observation I have is a 2-year period in a person's life. My ...
0
votes
0answers
12 views

Means data in a regression Or Raw data in an anova? What's more appropriate?

I would like to learn what is the correct way to approach analysis of this data: I have 5 grasslands, and in each grassland I have 30 spiders. For each spider I have an estimate of what proportion of ...
0
votes
0answers
23 views

Can anyone explain this error message in R? [duplicate]

I am running a mixed effect logistic regression, with two categorical predictors each of which are dichotomous. This is my formula, with variable names changed: ...