4
votes
3answers
811 views

Can independent variables with low correlation with dependent variable be significant predictors?

I have eight independent variables and one dependent. I have run a correlation matrix, and 5 of them have a low correlation with the DV. I have then run a stepwise multiple regression to see whether ...
1
vote
1answer
27 views

Significance Test for Comparison of Variables

I am not sure how to ask this question without giving an example. I am trying to measure the "cleanliness" of office buildings. I have two variables that try to measure this. Variable one is a ...
0
votes
1answer
238 views

Effect of features that are highly correlated with each other on a decision tree

I have a dataset of roughly 500 features and am training a binary classifier using GBM - gradient boosted machines, an ensemble of decision trees. Of these 500 variables, I am sure some are highly ...
4
votes
0answers
75 views

Which variables are driving correlations within groups

I'm running an analysis on a few data sets that each typically have 100-200 cases measured across 120-160 variables - something similar to looking at gene expressions. Each variable is a non-centered ...
-1
votes
1answer
86 views

How logical to select features with respect to the correlation matrix and weigthing?

Is it logical to name low correlated features as valuable and choosing the low corelated ones for classification? Or it depends on the algorithm used for the purpose? How do I need to interpret a ...
2
votes
2answers
87 views

Can feature selection be considered a way to observe relationship between variables like correlation?

In correlation we can observe relationship between a pair of variables, let me call it X1 and Y. Now, considering I have the predicting variables X1, X2, ..., Xn and the variable Y. Does the ...
4
votes
1answer
528 views

When does LASSO select correlated predictors?

I'm using the package 'lars' in R with the following code: ...
0
votes
1answer
32 views

Inter-feature ratio explicitly or implicitly?

Let's say I have two numerical features were is suspect that the ratio between them is the most meaningful way of looking at them. I have a NN learner. Should I add the ratio as a third feature or is ...
2
votes
4answers
277 views

Suggestions for identifying key features

I have a large set of customer data. For these customers, I have devised a customer loyalty score which is a measure of the loyalty of the customer. I want to find the features that are strongly ...
7
votes
1answer
185 views

How to quantify redundancy of features?

I have three features that I use to solve a classification problem. Originally, these features produced boolean values, so I could evaluate their redundancy by looking at how much the sets of positive ...