# cforest and randomForest classification prediction error

I used cforest and randomForest for a 300 rows and 9 columns dataset and received good (almost overfitted - error equal to zero) results for randomForest and big prediction errors for cforest classifiers. What is the main difference between these two procedures?

I admit that for cforest I used any possible input parameters combination e.g. the best one, but still with big classification errors, was cforest_control(savesplitstats = TRUE, ntree=100, mtry=8, mincriterion=0, maxdepth=400, maxsurrogate = 1).

For very big datasets (about 10000 rows and 192 columns) randomForest and cforest have almost the same errors (the former slightly better on the same level as radial kernel svms), but for the mentioned small one for my surprise there is no way to improve cforest prediction accuracy...

-
This is quite strange since those are implementation of the same algorithm... Are you sure you are not comparing OOB error estimation with error on train (this one is usually near 0 for RF, and this does not mean overfitting)? –  mbq Feb 3 '11 at 22:44
RFs are generally not prone to overfitting issues... With default settings, 500 trees will be grown, considering $\sqrt{9}=3$ variables each time. As @mbq said, the cparty package relies on the randomForest package, but add some convenient way to assess "conditional importance". It's hard to tell anything without knowing how data are structured (No. classes, sample size/class, etc.). Of note, if you're trying all parameters combinations for your model without using a cross-validation scheme, then you're likely to break the control exerted by bagging etc. –  chl Feb 3 '11 at 22:54
No, I compare both train errors and for RF it is usually equal to zero, but for cforest (party) it is much bigger and not expected... I know RF errors on additional test data are typically about 10-20%. –  42n4 Feb 3 '11 at 23:12
If so, I'm clueless... As @chl wrote, some code (or, ideally, a reproducible example) would be helpful. It may be also a bug/strange feature of party itself, so it can be a good idea to consult package maintainer. –  mbq Feb 3 '11 at 23:53
@mbq I found that randomForest is based on CART trees and cforest - on unbiased conditional inference trees. –  42n4 Feb 4 '11 at 0:50