Questions tagged [rpart]

`rpart` is an R package that provides a number of routines related to regression trees and recursive partitioning algorithms. This package is frequently used for classification problems.

Filter by
Sorted by
Tagged with
2
votes
1answer
23 views

Exploratory analysis : Regression trees without splitting train-test data

I am analyzing a small dataset of 76 observations and I want to explore how 9 environmental predictors explain my response variable. For this I have decided to use regression trees because I am ...
0
votes
0answers
16 views

Using a single regression tree for exploratory analysis [duplicate]

Currently I am working with small dataset, 76 samples where I am interested to model how one measure that I have (diversity) is shaped based on 9 environmental variables. We observe multicollinearity ...
0
votes
0answers
10 views

Estimate the optimal complexity parameter in CART by using grid search

In rpart I estimated the complexity parameter to which it is convenient to prune the tree. I used the grid search and the functions of another package, ...
1
vote
0answers
15 views

prediction error measures for Poisson regression in rpart

My question is about an alternative prediction error measure besides the default deviance-based error that is implemented but not documented. The vignette (section 8.1) states that: Prediction error: ...
1
vote
0answers
18 views

Issue poisson method rpart

I tried to use the rpart package to deal with observations count of crop pests, but I realized that there was overfitting with poisson method. In the vignette of the package, it said that it is ...
0
votes
0answers
16 views

Decision Tree model using Rpart

I am trying to create a node-link diagram (decision tree) by using parsnip and tidymodels. What I am performing is building a ...
0
votes
0answers
15 views

How are these definitions of deviance related?

My questions concerns the deviance in the context of CART. In Elements of Statistical Learning II (p. 309), deviance at node $m$ is defined as $-\sum_{k=1}^K\hat{p}_{mk}\mathrm{log}\hat{p}_{mk}$, ...
0
votes
0answers
8 views

Predictions resulting from the cross-validation process using rpart-printcp

When you apply rpart-printcp, is it possible to get the predictions obtained from the cross-validation process? With randomForest, predict(RFfit) is not the same as predict(RFfit, data). The former ...
0
votes
0answers
36 views

Splitting algorithm for survival tree in rpart package

I'm modeling Survival Tree using the package $\fbox{rpart}$ in R. Do you know which splitting criterion is used in this package to build the tree ? I tried to look at its document but it seems that ...
0
votes
0answers
39 views

What's the difference between complexity parameter and deviance?

The tree function in R has a parameter called mindev, which the documentation explains as such: "The within-node deviance must be at least this times that of the root node for the node to be ...
0
votes
0answers
174 views

Plot a tree from RandomForest object

I trained a randomforest using the RandomForest package on R. I am interested in how the most useful variables are split into the classes, So i would like to visualize a tree that is somehow an ...
1
vote
0answers
188 views

Interpreting Rpart.plot() for a Regression tree

I generally understand the CART algorithm but the rpart.plot values are confusing me a bit. Below is a picture of my plot. What exactly is the root node value ...
2
votes
1answer
136 views

Why does rpart not produce a perfect prediction when forced to?

I am trying to understand rpart all the details in rpart package. I am aware of the complexity parameter cp, which prevents a split if the improvement is less than <...
2
votes
1answer
28 views

Different results using randomForest::randomForest with one tree vs rpart

I am wondering what randomForest package handles differently for each individual tree. If I build a random forest with a single tree, no resampling, and allow the usage of all features in a dataset, I ...
1
vote
1answer
187 views

glmertree to fit logistic regression with two-column y

With both glm and glmer, if I wanted to fit a proportion, I could do it as either: ...
1
vote
0answers
21 views

How to interpret output of rpart model with survival object as response?

What do the numbers in terminal nodes represent? And how to interpret the predicted value for new observation obtained from function predict() ?
2
votes
1answer
133 views

GLMERTREE with reponse in [0, 1] and multilevel design

I have multilevel data (with nested random effects: (1 | cluster-of-cluster/cluster) in lme4 syntax) where the response is a continuous variable between $[0, 1]$ (i....
2
votes
1answer
114 views

Why is the error rate from bagging trees much higher than that from a single tree?

I'm running the classification method Bagging Tree (Bootstrap Aggregation) and compare the misclassification error rate with one from one single tree. We expect that the result from bagging tree is ...
0
votes
1answer
29 views

Regression trees with geepack package

I can’t run regression trees without geeglm. I have longitudinal data so rpart wouldn’t work. Is there a way to get regression trees with geeglm?
2
votes
1answer
31 views

How does decision tree decide which variable to use in next split?

The CART (or RPART) algorithm uses gini index to find a threshold value for a variable in each split. But how does it choose which variable will it use for splitting ?
1
vote
2answers
233 views

Does it make sense to use bayesian optimization for tuning of hyperparameters of decision tree model?

Does it make sense to use bayesian optimization for tuning of hyperparameters of decision tree model? I have not found any article or anything related to this, as BO is usually used for black-box ...
1
vote
0answers
49 views

R: rpart or random forest for datasets with multiple rows per subject [closed]

I have some fundamental understanding problem with rpart or train(method="rf") in R. My data is currently structured as follows: Around 100 subjects, each has 2048 rows (so around 204,800 rows) with ...
0
votes
1answer
89 views

When does OLS Regression outperform regression tree in term of out of sample prediction?

In my Master thesis i compare ols regression to regression tree to predict wages. I thought that i will get better prediction with the regression tree because it cathes more interactions. But now i ...
1
vote
0answers
151 views

Rpart and subsets

I am getting unexpected results from an rpart model, where the model selects two variables, one of which is a subset of the other. This in itself is not unexpected, but the seemingly odd thing is that ...
1
vote
0answers
520 views

Why do RMSE values increase on a smaller tree (RPART)

AIM: I want to understand why does RMSE increase on a smaller tree. CONTEXT: I am learning the rpart algorithm. I had some data,...
0
votes
0answers
930 views

Metrics in rpart decision trees

I am currently working with decision trees in R, I am using caret library. Source code of rpart can be found here: https://github.com/cran/rpart/blob/master/R/rpart.R I understand how decision trees ...
0
votes
2answers
272 views

classification tree with rpart()

I'm using the rpart() to build a classification tree using R. I have no experience in this topic... Anyway, I started with the full model, and then I used the varImp() from "caret" to drop some ...
1
vote
0answers
195 views

Performance of Conditional Inference regression Trees updating the influence function at each node

My goal is to compare the performance of $2$ models of trees using the Conditional Inference tree framework described in (ctree: Conditional Inference Trees), I am following the Partykit 2018. ...
2
votes
1answer
468 views

Test statistics used for a conditional inference regression tree?

Following the question asked previously about the interpretation of the Test Statistic used for Conditional Inference Trees (What is the test statistics used for a conditional inference regression ...
2
votes
0answers
69 views

Is rpart randomizing the variables it tries as splits?

I am fitting a decision with rpart on R. I have many variables and it seems to me that it would take a long time for rpart to try them all at every step, to determine what the next best split is. ...
3
votes
1answer
1k views

Are decision trees sensitive to log translations in feature space?

This question was partially answered on Are decision trees sensitive to translations in feature space?, but no references were provided for "Gini impurity and entropy measures are translation ...
4
votes
0answers
22k views

Interpretation of Rpart for Decision Trees

I recently used rpart for an R-decision tree, but am confused on how to read the results.... ...
2
votes
0answers
7k views

Decision Tree in R: rpart on categorical variables

Introduction: I would like to build a classifier which distinguishes between buyers and non-buyers based on user behavior. This data is highly imbalanced (0.009% for positive class), and I'm ...
1
vote
1answer
56 views

Classification in R - seperate category for uncertain classifications

I am constructing classification trees for the first time, so I'm quite new to this use of R. I have observations of behaviours and incoming data that has to be classified as one of these behaviours. ...
0
votes
0answers
1k views

discretization to create intervals for continuous variables

I am new to R and have basic stats understanding. Please excuse me if my questions are basic in nature. I am learning and having these questions and your answers would help me in updating my knowledge....
1
vote
1answer
554 views

Use decision tree to learn precise classification rules: need accuracy of 1

I'm trying to use a decision tree algorithm to learn how general ledger transactions (10 digit code) are classified into revenue, expense, G&A et cetera without actually scripting every ...
1
vote
0answers
2k views

How to interpret variable.importance for an rpart object

How can I interpret the values for the variable.importance in an rpart object? ...
1
vote
1answer
1k views

How can I use estimated probabilities of a class from rpart to identify the top N classes?

Using the rpart library, I'm trying to predict which class each observation belongs to. Here is a reproducible example explaining the steps I am taking: ...
4
votes
1answer
349 views

Disrepencies between Information Gain and Tree Growth

I was wondering if someone can explain to me why in my decision tree some of the variable with the highest importance (highest information - script shown below) do not appear into my tree at all, ...
1
vote
1answer
63 views

What does a decision tree with both GOOD outcome means?

I have a decision tree built in R using rpart() from rpart package. However, when following the nodes, we have one condition leading to both outcomes as GOOD. This is weird for me. What does that ...
2
votes
1answer
1k views

Handle missing value in continuous variable in Decision Tree without losing its meaning

I want to train a Decision Tree model with a dataset, of which some of the continuous variables contain missing values. I want to preserve the meaning of missing value while training, meaning that ...
1
vote
1answer
603 views

Understanding rpart package - unexpected behavior when swaping two columns in explanatory varaibles table

I have a problem understanding the behavior of rpart function of R. Here is the r code part : ...
0
votes
1answer
1k views

Loss matrix to be included in decision tree? Rpart -R

For loss matrix, is it necessary to include it during the decision tree analysis ? What will be the impact if this is excluded from the analysis e.g loss matrix (0,1,1,0) in Rpart-R? Do we usually ...
0
votes
1answer
179 views

Continuous output instead of classification

I was trying to do some classification problem where target variable should be one of 4 classes. I tried rpart and ranger ...
1
vote
0answers
195 views

Classification tree cross val error increasing but test error decreasing

My data has 5000 points. I predict a categorical outcome using 10 numeric variables. I build a tree with 3500 points (in R using rpart) using cross validation and plotcp shows this below ... I have ...
0
votes
1answer
875 views

Use of regression-trees to determine probabilities for a binary variable

I have a binary variable (sold/not sold) and I have used the CART algorithm in R (rpart) to build a classification tree to predict if this product is getting sold or not. Now I would like to add a ...
5
votes
1answer
20k views

rpart, Cross Validation. [closed]

I have a question of using the rpart for the regression tree. I am wondering when i use plotcp, where would my validation data comes from? Currently, I have a ...
1
vote
0answers
2k views

What is the formula of varImp in R?

I'm using varImp function(caret package) in R to get importance of variables and to select variables. I know how can i get result. This is my code and result. ...
1
vote
1answer
448 views

Rpart regression tree using aggregate data instead of record level data – The results are not the same

I have a large dataset (over 6 million records) and I have aggregated the dataset (dplyer package) and tested rpart() on the two ...
2
votes
1answer
2k views

Decision tree with imbalanced data not affected by pruning

I am looking to use a Decision Tree to classify whether or not a car will sell based on attributes of that car. The attributes that I have include price, year, mileage, condition (new, pre-owned, or ...