I am trying to predict the termination events for a company. I also want to rank the most important variables that lead to termination. I ran a decision tree model and have the following questions:
Is the variable importance (respective ranking of variables) of decision tree reliable, when the overall accuracy, sensitivity, specificity and KAPPA of the model is low?
Decision trees tend to favor variables with high variance. Does this imply that numeric variables will mostly land up higher in the list of variable importance?