I am trying to create a decision tree using the
rpart package in R.
To arrive at the optimal depth for the tree, I am using the
plotcp function in the package (which provides the cross validated error rate for various complexity parameter thresholds).
Ideally, you would expect the error to be very high for high values of cp, which will then gradually decrease before increasing again or flattening out (bias-variance trade-off)
However, the plot that I am getting is almost a straight line and as such implies that my optimal tree should have zero nodes. That should not be possible, as I do have a few strong/moderately strong predictors in my data set (and this relationship gets picked up when I try other models like logistic/conditional inference trees (
party package) and the resulting models are reasonably accurate).
I am pasting the cp plot that I got below. Any thoughts on what the issue could be?