Questions tagged [boruta]

A feature selection algorithm based on random forest. This tag relates to both the algorithm as well as the R package.

Filter by
Sorted by
Tagged with
0
votes
0answers
23 views

Find Correlation between Grouped and Ungrouped Data

I have 2 datasets. First is a Quarter-yearly data that has PTR (Pay-through-rate) value associated with an Agent for every Quarter. The second dataset has the detailed data for Sales related to those ...
0
votes
1answer
57 views

Boruta feature selection method

I have a general question about boruta. I know that it is not necessarily going to improve accuracy, as by design it is not meant to do this. However, what about using it before a regularization ...
0
votes
0answers
23 views

Discrepancies in p-values between t.test vs regression after random forest analysis [duplicate]

I was trying to analyze two groups of samples for multiple variables. I first used Boruta (random forest analysis) test to determine the importance of variables in my data. ...
0
votes
1answer
260 views

all-relevant feature selection vs minimum optimum feature selection

There are many different ways to selection features in modeling process. One way is to first select all-relevant features (like Boruta algorithm). And then develop model upon those those selected ...
1
vote
0answers
92 views

Problem to get z-score plot with boruta R [closed]

I am working with Boruta R package for selection variable. I am trying to replicate plots from Maya Gopal and Bhargavi: FEATURE SELECTION FOR YIELD PREDICTION USING BORUTA ALGORITHM (2018). https://...
0
votes
1answer
313 views

unstable result using boruta for feature selection

The Boruta algorithm is a wrapper built around the random forest classification algorithm. It tries to capture all the important, interesting features in data with respect to an outcome variable. I'...
2
votes
1answer
2k views

What does z-score mean in Boruta

The boruta algorithm performs the following steps. (here). Can anyone explain me what exactly the z-score means in this context? I am referring to point 5 and 6 in the following list. I only know the ...
0
votes
0answers
98 views

Do I need to specify any particular settings for Boruta feature selection in regression problems?

I trying to solve a linear regression problem and would like to select the most important variables to use. I came across the Boruta package in R. I am using it as ...
4
votes
2answers
1k views

Can random forest based feature selection method be used for multiple regression in machine learning

I would like to have a good feature selection method for a continuous response variable, over around 100 predictors. I would like to keep my model type as linear multiple regression model, rather than ...
0
votes
0answers
60 views

Naive Bayes for GPA classification?

So I am doing a project where I have to find a method that uses a lot of both categorical and numerical variables collected from surveys to predict a child's "discretized" GPA values. For example, ...
4
votes
2answers
2k views

Boruta 'all-relevant' feature selection vs Random Forest 'variables of importance'

Can someone explain the difference between variables of importance from random forest vs all-relevant features from Boruta feature selection? For example, if one were to build a model (could be any ...
1
vote
1answer
526 views

Feature selection step before decision tree?

I want to use rpart (a R package) to build a decision tree model. The data is a high-dimensional expression matrix, with ~50,000 predictors and ~500 samples. The response is a categorical variable. ...
2
votes
1answer
1k views

Boruta feature selection with R

I used Boruta algorithm in R on a data set of ~600 attributes and with a sample of 50K (the original size is 300K). Using the following parametres: pValue = 0.05 getImp = getImpRfZ maxRuns = 11 ...
3
votes
1answer
745 views

Multiple regression or anova or bestglm or forestplot or Boruta

I have data on a continuous health variable and following others: age, gender, height, weight, waist, city and season. I applied multiple regression and got following output: (age, gender, height, ...
4
votes
1answer
96 views

Boruta score goes to minus infinity

I'm running the Boruta algorithm with a $179\times 36$ predictor matrix and a numerical response. Most of the variables have a score going to -Inf. Should I ...
2
votes
1answer
119 views

Boruta test and naive bayes classification

I am currently using Boruta to test which feature is the most important to be used in my model development. For example, I have 3 features(X,Y,Z).Boruta test give the highest importance is Z. However ...
8
votes
3answers
6k views

Does Boruta feature selection (in R) take into account the correlation between variables?

I am a bit of a novice in R and feature selection, and have tried the Boruta package to select (diminish) my number of variables (n= 40). I thought that this method also took into account the possible ...
3
votes
1answer
249 views

k-fold feature selection

I have a data set with 20 K variables. I have tried to select some features via Boruta and FSelector but I could not achieve ...
1
vote
0answers
454 views

Interpretation of Scree plots and Boruta Outcomes

I have 37 features in my dataset. I used Boruta package in R and according to its analysis, all the features are "important" and should be retained. I examined this result of Boruta and found that if ...
6
votes
1answer
778 views

Reference for random forests

I would like to understand how do the Boruta package work. Could you suggest some references for the theoretical aspect of so-called random forests? Below are two illustrative examples of why am I ...