# Regression models similar to Random Forest

I am trying to create an ensemble model. I tried some classical models, in which RandForest's accuracy is around 85% and other models like Decision trees, NNet has accuracy from 35%-63%. So I need some models which are close to the working of Randforest or its variants. I am using R and my model is a Regression Model

• Check out RWeka package... it has all the decision tree based classifiers which are similar to Random Forest. Also if your Nnet is performing poorly it must be because of poor training or poor architecture. NNet output should be same if not better than Random Forest, as neural network can theoretically simulate any function given sufficient training and network size. – Gaurav Jul 8 '16 at 6:43
• Try the xgboost package. It has gradient boosted trees, which is an ensemble model and a generalization of adaboost, using trees as the weak classifier. In addition, there is the generalized boosted regression model package, gbm, and the original adaboost is in the ada package. The advantage xgboost has over gbm is speed. Xgboost also support using linear models as the weak classifier. – aichao Jul 8 '16 at 13:04