Good Day, I believe this issue is more of a lack of understand of R (as I have never used it till recently) than anything else. What I am looking for is references, or documents to help me solve my problem.
I have a set of data that I created a pair of decision tress on (pruned and unpruned). I did this using Weka and 10-fold cross-validation. There was no problem here. I got a higher accuracy for the pruned tree and I have individual accuracies for each of the ten folds.
I am now working on doing statistical testing to these two trees, I want to do a T-Test and the Wilcoxon test. It was suggested that I use the
function for the cross-validation, but I can already do this in weka. For the actual stat tests I can do the t-test similar to the example here by manually feeding the values from the individual fold-tests similar to what is in the code in that example. The Wilcoxon test is what is throwing me off. I found this example but I was told to use the function
in the DMwR package. I looked at the documentation for it and I do not quite understand it. It says to feed in the results from
experiemntalComparison() for the first value, which means I should be doing my cross-validation with that function (vs. weka). I am not understanding how to get the "trees" I made in weka this function. The documentation refers to some usermade class
cv.rpartXse. So I am stumped, being new to this language, on how to accomplish these statistical tests via R.