Refers to the variables used in a model to predict a response. This tag can also be used for $X$ variables in explanatory & descriptive modeling, not just predictive modeling. This same construct goes by many names in different contexts, including: independent variable, explanatory variable, ...

learn more… | top users | synonyms (1)

1
vote
1answer
16 views

Relative importance of predictors in the final model

A common question that frequently comes up, while presenting the findings of a predictive model to a Business audience (with non-statistical background) is - Which variable/predictor is most important ...
1
vote
0answers
17 views

Determining relative contribution of independent variables in predicting dependent variables in regresssion

I am running a multiple regression in which the dependent variable and both predictor variables are continuous, numeric and positive. lm(DV ~ PV1 + PV2, mydata) ...
0
votes
1answer
33 views

What kind of independent variables can I use for multiple regression?

I'm very new to statistics. My assignment requires me to use one statistical method taught during lesson so I only have a choice between multiple regression, logistics regression and MANOVA. My ...
0
votes
0answers
7 views

Variable selection algorithm based on meta study

Suppose I would like to conduct a survey and want to know which variables to include. Literature review and theoretical guidance both help. What I would like to know is whether there is a way to do a ...
0
votes
0answers
10 views

Optimal Predictor under symmetric loss [self-study]

I am seeking to prove that, under symmetric squared error loss $C(e)=e^2$ where $e$ is the forecast error h periods ahead $e=y_{t+h}-\hat y_{t+h}$, the optimal predictor $\hat y_{t+h}$ = ...
0
votes
0answers
12 views

What are valid ways of analysing predictors for a response variable that changes with time?

I have a cohort of similar patients who are likely to get a certain disease over time. I am trying to find out how some continuous health markers (e.g. weight) at time 0 are related to their disease ...
0
votes
1answer
43 views

How to treat variable in logistic regression?

I have a variable I do not know how I should handle my logistic regression. The variable is the number of registered students each semester. If I plot it against my binary outcome, I get the following ...
0
votes
1answer
17 views

Quantitative and categorial predictor in one model

This is what I would like to know, due to some logical problem behind! I have a model as: Crown radius = Diameter at breast height + Location DBH is quantitative, like 30cm, 40cm... Location is ...
1
vote
0answers
28 views

Comparing predictors based on ROC AUC and cross-validation error

I am analysing how well some continuous variables (e.g. weight, height) predict the occurrence of a given disease after surgery. I have computed the area under the curve of the receiver-operator ...
0
votes
0answers
9 views

Screening/Filter Method for classification problem

I have a data set with 100 variables. And the output is binary (case/control). What kind of method would be a good choice for screening variables at the beginning stage.
0
votes
0answers
11 views

Multiple regression summary for different predictor classes

One question on regression: Following model: M1 <- lm(y ~ x1 + x2 + x3) x1 and x2 are in ratio scale, x3 is a nominal variable, they have values as x1= 1.4, 1.3, 1.2,... x2= 2.1, 2.2,2.3,.... ...
0
votes
0answers
24 views

Combining Collinear Variables

I have a set of 10 variables: 9 explanatory, 1 response. I wish to do a constrained regression on the variables and use the values of the coefficients as weights in a TOPSIS analysis. I am having ...
1
vote
1answer
30 views

What impact does squaring a dependent variable have in a model?

I am performing some regression here to study the association between the length of time an auditor has been auditing a company and the choice of auditor. In this case, my DV is auditor tenure ...
0
votes
1answer
41 views

Justification for variable reduction by removing predictors with near zero variance

I have a large number of variables that I'm trying to reduce, and I've stumbled on Kuhn's (2008) suggestion that I eliminate variables with zero or near-zero variance. This makes sense to me, it's ...
0
votes
0answers
43 views

Choosing predictor variables (IVs) for inclusion in multiple regression

I am stuck on something and think I may have made a big error. My DV is ticket sales and I have 5 potential IVs: ticket price, income, review score, travel distance, and performance costs. I am ...
0
votes
1answer
90 views

Getting negative predicted values after linear regression

I'm using linear regression to predict a price which is obviously positive. I have only one feature which is gross_area. I standardized it (z-score) I got this kind of value: ...
4
votes
0answers
62 views

Opposite of $p$-value for null hypothesis?

Disclaimer: I have no statistical background. So please excuse, and correct me please, if I make several amateur mistakes below. I have two groups (let's call them $A$ and $B$) and a particular ...
1
vote
0answers
30 views

Recommendation system and baseline predictors

I'm participating in programming contest, where I have a data, and where the first number is a user, second number is a movie, and the third is a number in then-points rating. ...
0
votes
0answers
34 views

Cox regression with two dependent expanatory variables

I am doing a Cox regression to model how survival times of sick patients, after taking a certain number of pills. There are in total 10 different pills patients can ...
0
votes
0answers
20 views

What issues may I face when interpolating my dependent variable in an OLS regression?

I'm doing my undergrad dissertation on what host-country factors impact FDI inflows - FDI inflows to the UK is my dependent variable. All of the independent variables I have managed to find at a ...
0
votes
0answers
27 views

Why added predictors improved performance in decision trees if they don't appear in the model?

although I've been working some months now with decision trees, I still have issues understanding some things and also finding a right source to answer my questions. Maybe I'm not using the right ...
2
votes
0answers
16 views

A control variable that forms part of the definition of the dependent variable: Drop it or transform it?

My aim is to analyze, using OLS, how Y (firms' benefits) depend on some factors. To normalize Y, I divide it by firms' size (S). Therefefore, my dependent variable is Y/S. To know how size affect ...
0
votes
0answers
8 views

Identifying the significant properties

(The problem is in linguistics.) I have a list of vowels from various words, some of which underwent a change, and for each of them a list of phonetic properties. I believe that the mechanism is this: ...
0
votes
0answers
21 views

Setting predictor values in MLR

I am just getting started with Multiple Linear Regression (MLR), and had a question regarding setting predictor values while using the prediction equation. Suppose, I have two predictors $x_1$ and ...
0
votes
1answer
31 views

Multicollinearity and categorical predictor with three levels

If I have a continuous DV and two IV, where one is categorical with three levels and the other is continuous, what assumptions do I need to check for multiple regression? Scatter plots are for ...
4
votes
2answers
113 views

Can I safely use variable importance of a random forest in a paper?

Background: I just started with machine learning and I'm considering using it on old data based on which I'm writing a paper. The paper deals with radiation-induced lung damage and the data comprise ...
0
votes
1answer
14 views

Finding the significance of certain questions in a survey

My company performs a Go/No-Go questionnaire to determine whether or not to go after a particular opportunity. In this questionnaire is a series of 14 yes/no questions. We have accumulated a ...
2
votes
1answer
117 views

Change in order of predictors breaks logistic model estimation (glm, R)

I am fitting a binomial logistic regression in R using glm. By chance, I have found out that if I change the order of my predictor variables, glm fails to estimate the model. The message I get is ...
0
votes
1answer
23 views

Generalized linear model - independent variables with many zeros

I am carrying out glms on count data, several of my variables consist of largely of zero values, i was previously told to exclude these variables as it would reduce the model fit. I can't find a ...
0
votes
1answer
28 views

Interpreting Coefficients of a Dummy variables derived from an Ordinal variable

I have a variable that is measure societal complexity (SC) on a 3 point scale. 1 being the least complex and 3 being the most complex, and I think that this can safely be classed as a ordinal ...
1
vote
1answer
35 views

Can I add more cases and/or predictors to existing set of data?

If I have a set of data with 40 cases and 3 predictors can I add more cases and/or predictors later to the existing set of cases if I want to explore the effect of more possible predictors? The data ...
1
vote
0answers
26 views

Logistic regression and IV that depends on another IV value

I am modeling the effect of aspects of house change and marital status change on a (binomial) DV. Each observation in my data is a 3-year period in someone's life. Thus, for family change, I have a ...
2
votes
1answer
45 views

Is testing predictors separately theoretically sound?

I am running a regression analysis to understand the effect of several IVs on the transport mode choice of questionnaire respondents. My sample of respondents is of 100, and I have more than 10 ...
3
votes
2answers
129 views

Predictor variables sum up to 1 but not necessarily correlated - is it a problem? [closed]

I am trying to fit hierarchical mixture model (using ML and MCMC, but this shouldn't matter) where the linear predictor part contains 17 independent variables. These are habitat variables: for each ...
2
votes
1answer
100 views

Is log transformation a proper way to reduce the weight of high vs. low values in logistic regression, and how do I diagnose when the DV is binary?

Consider the following case: I am analyzing a the effect of (among other variables) the age of a firm on a specific binary event. Theoretically my perception is that age matters, but not linearly. ...
0
votes
0answers
60 views

Multple linear regression, adding one predictor with almost perfect fit make others irrelevant

I found something interesting while playing with some data and linear regression. I built a regression with various predictors, more or less correlated with the outcome. Then I added one predictor ...
0
votes
0answers
23 views

Variability within Predictor Variable and Random Forest Over-Fitting

I have a predictor variable that has low variability within it (small range of values) and it is rated very high importance within my Random Forest Model, will this cause over-fitting of my model? I ...
0
votes
0answers
85 views

Linear regression with log dependent variable

I have the following regression: $log(Y) = \alpha + \beta X + \epsilon$ with $E[\epsilon] = 0$ and $var(\epsilon) = \sigma^2$. There is no assumption on the distribution of the errors $\epsilon$. In ...
0
votes
1answer
109 views

graphical representation of fixed effects from lmer

I have run a lmer model in R: ...
1
vote
1answer
81 views

Assume (x,y) are drawn from independent & identical distribution when y=f(x)

Sometimes we say the following: $X$ is some training data given by $X:=\{(x_1,y_1),...,(x_l,y_l)\}\subset R^d \text{x}R$. Assume that the training data had been drawn from independent and identical ...
0
votes
1answer
182 views

Prediction with categorical variables in Cox regression

I'm doing survival analysis with Cox PH. I have my final model based on averaged models and I have four categorical variables with multiple levels each. I computed the fitted values using ...
1
vote
0answers
63 views

logistic regression with sparse predictor variables

I am currently modeling some data using a binary logistic regression. The dependent variable has a good number of positive cases and negative cases - it is not sparse. I also have a large training set ...
0
votes
0answers
8 views

Coefficients flip sign in general linear model depending on what predictors are included: collinearity is NOT a problem [duplicate]

I have a general linear model with several predictors (~10). The sign (beta) of one of the predictors (Pred1) is negative when all predictors are included. It's STILL negative when the most correlated ...
0
votes
0answers
20 views

How do I best possible model future risks for Organization?

Using following concept is it possible to define or layout future risk or in security terms future root-causes that are critical for organization operations and businesses. Those concepts are:- 4 ...
0
votes
0answers
28 views

Dealing with covariate*predictor interactions

I have one DV, four IV and 4 covariates. The assumptions to do the traditional ANCOVA are not met, therefore I am including the interactions predictor*covariate (1 to 4) in my model. My covariates are ...
1
vote
0answers
74 views

Using log of dependent variable as regressor

I am running a regime switching (hidden) Markov model, and I found out that if I construct the following model, it gives very interesting and useful state switches: $ y = \alpha_{S_t} + \beta_{S_t}\ ...
0
votes
0answers
7 views

given a set of pairs of graphs, build a model that accept a graph and predicts it matching graph

Training Data I have a set of pairs of normally distributed graphs, each with a concrete last sample (maximal X) Question I want to build a model (formula) from the data input: a single graph ...
0
votes
1answer
325 views

CHAID decision tree - Binning continuous variables

I am running a CHAID classification tree on SPSS to classify my data set. I have a couple independent variables including categorical and continuous ones. For continuous variables, I've noticed that ...
0
votes
0answers
14 views

How to model data

I am attempting to model a specific variable's sensitivity to a feature set. In concrete terms, I am trying to predict the duration (PAUSE_KS) of a letter (...
1
vote
1answer
154 views

combining/merging correlated variables

I performed a correlation analysis on my IVs to see which are related. As this is data from an experiment, I also have variables that are in general not so easy to capture from people in real life ...